Skip to content

fix: update stale model IDs in e2e tests#31

Merged
johnnichev merged 1 commit intomainfrom
fix/e2e-stale-models
Mar 24, 2026
Merged

fix: update stale model IDs in e2e tests#31
johnnichev merged 1 commit intomainfrom
fix/e2e-stale-models

Conversation

@johnnichev
Copy link
Copy Markdown
Owner

Summary

  • Anthropic: claude-3-haiku-20240307claude-haiku-4-5 (old model retired by Anthropic)
  • Gemini: gemini-2.0-flashgemini-2.5-flash (old model deprecated for new users)
  • Fix Gemini API key check to accept GOOGLE_API_KEY in addition to GEMINI_API_KEY
  • Fix flaky streaming assertion (short responses can legitimately arrive in 1 chunk)

Test Results

136 e2e tests pass across OpenAI, Anthropic, and Gemini (9 skipped = Ollama not running).

- Anthropic: claude-3-haiku-20240307 → claude-haiku-4-5 (old model retired)
- Gemini: gemini-2.0-flash → gemini-2.5-flash (old model deprecated for new users)
- Fix Gemini API key check to accept GOOGLE_API_KEY in addition to GEMINI_API_KEY
- Fix flaky streaming assertion (short responses can be 1 chunk)

All 136 e2e tests pass across OpenAI, Anthropic, and Gemini.
@johnnichev johnnichev merged commit 7cafc3f into main Mar 24, 2026
5 checks passed
@johnnichev johnnichev deleted the fix/e2e-stale-models branch March 24, 2026 18:08
johnnichev added a commit that referenced this pull request Apr 7, 2026
Addresses 4 items from the latest Galaxy S23 review round plus one new
desktop instruction.

1. **Hidden nav drawer leaving a visible line at the top of the header**
   (Image #29): the previous `transform: translateY(-110%)` with a
   `border-bottom: 1px solid` on .nav-drawer was leaving a faint
   sub-pixel artifact depending on viewport/DPR. Replaced with
   `opacity: 0 + visibility: hidden + transform: translateY(-8px)`,
   using transition-delay to sequence visibility correctly on
   open (immediate) vs close (after fade-out completes). The drawer
   is now completely invisible and non-interactive when closed —
   no peek, no interactive hit zone.

2. **Huge gap between "24 Built-in Tools" and "Multi-Agent Orchestration"
   on mobile** (Image #30): the `mt-16` (64px) between the grid-4 and
   grid-2 card sections created a visible "end of section" break
   mid-content when both collapse to single column. Added a mobile/touch
   override that reduces mt-16 to match the in-grid gap (14px), so the
   cards read as one continuous list.

3. **pip install button looks bad on desktop** (Image #31): completely
   replaced the old .btn-pip squished-text button with a full terminal
   install component inspired by the nv-context-landing pattern the user
   pointed at. Structure:

     ┌─ ● ● ●  ~/your-project                    [Copy] ─┐
     │                                                    │
     │  $ pip install selectools█                          │
     │                                                    │
     └────────────────────────────────────────────────────┘

   - Rounded container with cyan-tinted hover glow
   - Mac-style traffic-light dots (red/yellow/green)
   - `~/your-project` filename in the chrome
   - `$ pip install selectools` with cyan prompt, white cmd, blinking
     cyan caret
   - Reveal-on-hover "Copy" button (always visible on touch)
   - Whole component is click-to-copy with Enter/Space keyboard support
   - "Copied" flash on the Copy button + bottom toast notification
   - Full clipboard API with execCommand fallback for insecure contexts

   Replaces the old `<button class="btn btn-pip">` + `copyPip()` JS.
   The "Try the Builder" and "Read the Docs" buttons move below as a
   standard two-button CTA row. Far more visually distinctive and
   intuitive than a button labeled "pip install selectools".

4. **Desktop header auto-hide** (new instruction): removed the
   nav-hide-on-scroll-down behavior on desktop too. The header now
   stays permanently fixed on all viewports — the previous
   progressive-enhancement auto-hide was confusing even on desktop.
   Also removed the now-dead .nav-hidden CSS class and the
   `allowHide` logic in the scroll-progress IIFE.

Also cleaned up:
- Removed `.nav-drawer { display: block }` overrides from both media
  queries — the drawer is always `display: block` default now, with
  visibility controlling appearance. Simpler, fewer rules.
- Added `.terminal-body .caret` and `.terminal-install:hover`
  neutralization in the prefers-reduced-motion block.
- Added `@media (hover: none)` guard to prevent transform lift on touch.
johnnichev added a commit that referenced this pull request Apr 7, 2026
…43)

Addresses 4 items from the latest Galaxy S23 review round plus one new
desktop instruction.

1. **Hidden nav drawer leaving a visible line at the top of the header**
   (Image #29): the previous `transform: translateY(-110%)` with a
   `border-bottom: 1px solid` on .nav-drawer was leaving a faint
   sub-pixel artifact depending on viewport/DPR. Replaced with
   `opacity: 0 + visibility: hidden + transform: translateY(-8px)`,
   using transition-delay to sequence visibility correctly on
   open (immediate) vs close (after fade-out completes). The drawer
   is now completely invisible and non-interactive when closed —
   no peek, no interactive hit zone.

2. **Huge gap between "24 Built-in Tools" and "Multi-Agent Orchestration"
   on mobile** (Image #30): the `mt-16` (64px) between the grid-4 and
   grid-2 card sections created a visible "end of section" break
   mid-content when both collapse to single column. Added a mobile/touch
   override that reduces mt-16 to match the in-grid gap (14px), so the
   cards read as one continuous list.

3. **pip install button looks bad on desktop** (Image #31): completely
   replaced the old .btn-pip squished-text button with a full terminal
   install component inspired by the nv-context-landing pattern the user
   pointed at. Structure:

     ┌─ ● ● ●  ~/your-project                    [Copy] ─┐
     │                                                    │
     │  $ pip install selectools█                          │
     │                                                    │
     └────────────────────────────────────────────────────┘

   - Rounded container with cyan-tinted hover glow
   - Mac-style traffic-light dots (red/yellow/green)
   - `~/your-project` filename in the chrome
   - `$ pip install selectools` with cyan prompt, white cmd, blinking
     cyan caret
   - Reveal-on-hover "Copy" button (always visible on touch)
   - Whole component is click-to-copy with Enter/Space keyboard support
   - "Copied" flash on the Copy button + bottom toast notification
   - Full clipboard API with execCommand fallback for insecure contexts

   Replaces the old `<button class="btn btn-pip">` + `copyPip()` JS.
   The "Try the Builder" and "Read the Docs" buttons move below as a
   standard two-button CTA row. Far more visually distinctive and
   intuitive than a button labeled "pip install selectools".

4. **Desktop header auto-hide** (new instruction): removed the
   nav-hide-on-scroll-down behavior on desktop too. The header now
   stays permanently fixed on all viewports — the previous
   progressive-enhancement auto-hide was confusing even on desktop.
   Also removed the now-dead .nav-hidden CSS class and the
   `allowHide` logic in the scroll-progress IIFE.

Also cleaned up:
- Removed `.nav-drawer { display: block }` overrides from both media
  queries — the drawer is always `display: block` default now, with
  visibility controlling appearance. Simpler, fewer rules.
- Added `.terminal-body .caret` and `.terminal-install:hover`
  neutralization in the prefers-reduced-motion block.
- Added `@media (hover: none)` guard to prevent transform lift on touch.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant