Guides

Comparison results: command-palette

Comparison overview, scores, protocol and limits

All nine command-palette builds from the 2026-10-15 cohort follow unchanged: three arms, three runs each. These checks grade the resulting apps, not operational safety, complete accessibility or physical-device VoiceOver behavior. Read the overview's protocol notes and limits before comparing scores.

Every run and check

command-palette, shadcn/ui, run 1: 90/100

command-palette
Arm: shadcn
Score: 90
Typecheck: 20/20
Lint: 10/10
Axe: 10/20
50/50
  • axe 390px light: color-contrast in initial (kbd[data-slot="kbd-group"] > .pointer-events-none.h-5.w-fit:nth-child(1), .mt-2 > .pointer-events-none.h-5.w-fit:nth-child(1)); color-contrast in palette-open (kbd[data-slot="kbd-group"] > .pointer-events-none.h-5.w-fit:nth-child(1), .mt-2 > .pointer-events-none.h-5.w-fit:nth-child(1)) (-5)
  • axe 1280px light: color-contrast in initial (kbd[data-slot="kbd-group"] > .pointer-events-none.h-5.w-fit:nth-child(1), .mt-2 > .pointer-events-none.h-5.w-fit:nth-child(1)); color-contrast in palette-open (kbd[data-slot="kbd-group"] > .pointer-events-none.h-5.w-fit:nth-child(1), .mt-2 > .pointer-events-none.h-5.w-fit:nth-child(1)) (-5)

Problems the app had before the agent ran, which cost nothing: 0 type errors, 0 lint errors.

"Search commands" opens a modal dialog titled "Command palette" with the search field focused
Acceptance items: 1, 2
Viewport: desktop
pass
Ctrl+K and ⌘K open the palette
Acceptance items: 1
Viewport: desktop
pass
Typing filters by label ignoring case, hides empty groups, and says when nothing matches
Acceptance items: 3
Viewport: desktop
pass
The first match is highlighted; Down then Enter runs the second, closes the palette and shows it
Acceptance items: 4, 5
Viewport: desktop
pass
Clicking a command runs it
Acceptance items: 4, 5
Viewport: desktop
pass
Escape closes the palette without running anything and focus returns to the button
Acceptance items: 6
Viewport: desktop
pass
At 390px wide the page does not scroll sideways
Acceptance items: 7
Viewport: phone
pass
390px light
Result: **fail**
390px dark
Result: pass
1280px light
Result: **fail**
1280px dark
Result: pass

Screenshots, as evidence only: 8 in scripts/agent-usability/runs/2026-10-15/shadcn/command-palette/1/score/screenshots.

command-palette, shadcn/ui, run 2: 90/100

command-palette
Arm: shadcn
Score: 90
Typecheck: 20/20
Lint: 10/10
Axe: 10/20
50/50
  • axe 390px light: color-contrast in initial (.ml-1 > .pointer-events-none.h-5.w-fit:nth-child(1)); color-contrast in palette-open (.ml-1 > .pointer-events-none.h-5.w-fit:nth-child(1)) (-5)
  • axe 1280px light: color-contrast in initial (.ml-1 > .pointer-events-none.h-5.w-fit:nth-child(1)); color-contrast in palette-open (.ml-1 > .pointer-events-none.h-5.w-fit:nth-child(1)) (-5)

Problems the app had before the agent ran, which cost nothing: 0 type errors, 0 lint errors.

"Search commands" opens a modal dialog titled "Command palette" with the search field focused
Acceptance items: 1, 2
Viewport: desktop
pass
Ctrl+K and ⌘K open the palette
Acceptance items: 1
Viewport: desktop
pass
Typing filters by label ignoring case, hides empty groups, and says when nothing matches
Acceptance items: 3
Viewport: desktop
pass
The first match is highlighted; Down then Enter runs the second, closes the palette and shows it
Acceptance items: 4, 5
Viewport: desktop
pass
Clicking a command runs it
Acceptance items: 4, 5
Viewport: desktop
pass
Escape closes the palette without running anything and focus returns to the button
Acceptance items: 6
Viewport: desktop
pass
At 390px wide the page does not scroll sideways
Acceptance items: 7
Viewport: phone
pass
390px light
Result: **fail**
390px dark
Result: pass
1280px light
Result: **fail**
1280px dark
Result: pass

Screenshots, as evidence only: 8 in scripts/agent-usability/runs/2026-10-15/shadcn/command-palette/2/score/screenshots.

command-palette, shadcn/ui, run 3: 90/100

command-palette
Arm: shadcn
Score: 90
Typecheck: 20/20
Lint: 10/10
Axe: 10/20
50/50
  • axe 390px light: color-contrast in initial (kbd[data-slot="kbd-group"] > .pointer-events-none.h-5.w-fit:nth-child(1), p > .pointer-events-none.h-5.w-fit:nth-child(1)); color-contrast in palette-open (kbd[data-slot="kbd-group"] > .pointer-events-none.h-5.w-fit:nth-child(1), .mt-2 > .pointer-events-none.h-5.w-fit:nth-child(1)) (-5)
  • axe 1280px light: color-contrast in initial (kbd[data-slot="kbd-group"] > .pointer-events-none.h-5.w-fit:nth-child(1), p > .pointer-events-none.h-5.w-fit:nth-child(1)); color-contrast in palette-open (kbd[data-slot="kbd-group"] > .pointer-events-none.h-5.w-fit:nth-child(1), .mt-2 > .pointer-events-none.h-5.w-fit:nth-child(1)) (-5)

Problems the app had before the agent ran, which cost nothing: 0 type errors, 0 lint errors.

"Search commands" opens a modal dialog titled "Command palette" with the search field focused
Acceptance items: 1, 2
Viewport: desktop
pass
Ctrl+K and ⌘K open the palette
Acceptance items: 1
Viewport: desktop
pass
Typing filters by label ignoring case, hides empty groups, and says when nothing matches
Acceptance items: 3
Viewport: desktop
pass
The first match is highlighted; Down then Enter runs the second, closes the palette and shows it
Acceptance items: 4, 5
Viewport: desktop
pass
Clicking a command runs it
Acceptance items: 4, 5
Viewport: desktop
pass
Escape closes the palette without running anything and focus returns to the button
Acceptance items: 6
Viewport: desktop
pass
At 390px wide the page does not scroll sideways
Acceptance items: 7
Viewport: phone
pass
390px light
Result: **fail**
390px dark
Result: pass
1280px light
Result: **fail**
1280px dark
Result: pass

Screenshots, as evidence only: 8 in scripts/agent-usability/runs/2026-10-15/shadcn/command-palette/3/score/screenshots.

command-palette, shadcn/ui with its skill, run 1: 90/100

command-palette
Arm: shadcn-skill
Score: 90
Typecheck: 20/20
Lint: 10/10
Axe: 10/20
50/50
  • axe 390px light: color-contrast in initial (.pointer-events-none.h-5.w-fit:nth-child(1)); color-contrast in palette-open (.pointer-events-none.h-5.w-fit:nth-child(1)) (-5)
  • axe 1280px light: color-contrast in initial (.pointer-events-none.h-5.w-fit:nth-child(1)); color-contrast in palette-open (.pointer-events-none.h-5.w-fit:nth-child(1)) (-5)

Problems the app had before the agent ran, which cost nothing: 0 type errors, 0 lint errors.

"Search commands" opens a modal dialog titled "Command palette" with the search field focused
Acceptance items: 1, 2
Viewport: desktop
pass
Ctrl+K and ⌘K open the palette
Acceptance items: 1
Viewport: desktop
pass
Typing filters by label ignoring case, hides empty groups, and says when nothing matches
Acceptance items: 3
Viewport: desktop
pass
The first match is highlighted; Down then Enter runs the second, closes the palette and shows it
Acceptance items: 4, 5
Viewport: desktop
pass
Clicking a command runs it
Acceptance items: 4, 5
Viewport: desktop
pass
Escape closes the palette without running anything and focus returns to the button
Acceptance items: 6
Viewport: desktop
pass
At 390px wide the page does not scroll sideways
Acceptance items: 7
Viewport: phone
pass
390px light
Result: **fail**
390px dark
Result: pass
1280px light
Result: **fail**
1280px dark
Result: pass

Screenshots, as evidence only: 8 in scripts/agent-usability/runs/2026-10-15/shadcn-skill/command-palette/1/score/screenshots.

command-palette, shadcn/ui with its skill, run 2: 100/100

command-palette
Arm: shadcn-skill
Score: 100
Typecheck: 20/20
Lint: 10/10
Axe: 20/20
50/50

Every check passed.

Problems the app had before the agent ran, which cost nothing: 0 type errors, 0 lint errors.

"Search commands" opens a modal dialog titled "Command palette" with the search field focused
Acceptance items: 1, 2
Viewport: desktop
pass
Ctrl+K and ⌘K open the palette
Acceptance items: 1
Viewport: desktop
pass
Typing filters by label ignoring case, hides empty groups, and says when nothing matches
Acceptance items: 3
Viewport: desktop
pass
The first match is highlighted; Down then Enter runs the second, closes the palette and shows it
Acceptance items: 4, 5
Viewport: desktop
pass
Clicking a command runs it
Acceptance items: 4, 5
Viewport: desktop
pass
Escape closes the palette without running anything and focus returns to the button
Acceptance items: 6
Viewport: desktop
pass
At 390px wide the page does not scroll sideways
Acceptance items: 7
Viewport: phone
pass
390px light
Result: pass
390px dark
Result: pass
1280px light
Result: pass
1280px dark
Result: pass

Screenshots, as evidence only: 8 in scripts/agent-usability/runs/2026-10-15/shadcn-skill/command-palette/2/score/screenshots.

command-palette, shadcn/ui with its skill, run 3: 100/100

command-palette
Arm: shadcn-skill
Score: 100
Typecheck: 20/20
Lint: 10/10
Axe: 20/20
50/50

Every check passed.

Problems the app had before the agent ran, which cost nothing: 0 type errors, 0 lint errors.

"Search commands" opens a modal dialog titled "Command palette" with the search field focused
Acceptance items: 1, 2
Viewport: desktop
pass
Ctrl+K and ⌘K open the palette
Acceptance items: 1
Viewport: desktop
pass
Typing filters by label ignoring case, hides empty groups, and says when nothing matches
Acceptance items: 3
Viewport: desktop
pass
The first match is highlighted; Down then Enter runs the second, closes the palette and shows it
Acceptance items: 4, 5
Viewport: desktop
pass
Clicking a command runs it
Acceptance items: 4, 5
Viewport: desktop
pass
Escape closes the palette without running anything and focus returns to the button
Acceptance items: 6
Viewport: desktop
pass
At 390px wide the page does not scroll sideways
Acceptance items: 7
Viewport: phone
pass
390px light
Result: pass
390px dark
Result: pass
1280px light
Result: pass
1280px dark
Result: pass

Screenshots, as evidence only: 8 in scripts/agent-usability/runs/2026-10-15/shadcn-skill/command-palette/3/score/screenshots.

command-palette, Ouro HX, run 1: 100/100

command-palette
Arm: ouro
Score: 100
Typecheck: 20/20
Lint: 10/10
Axe: 20/20
50/50

Every check passed.

Problems the app had before the agent ran, which cost nothing: 0 type errors, 0 lint errors.

"Search commands" opens a modal dialog titled "Command palette" with the search field focused
Acceptance items: 1, 2
Viewport: desktop
pass
Ctrl+K and ⌘K open the palette
Acceptance items: 1
Viewport: desktop
pass
Typing filters by label ignoring case, hides empty groups, and says when nothing matches
Acceptance items: 3
Viewport: desktop
pass
The first match is highlighted; Down then Enter runs the second, closes the palette and shows it
Acceptance items: 4, 5
Viewport: desktop
pass
Clicking a command runs it
Acceptance items: 4, 5
Viewport: desktop
pass
Escape closes the palette without running anything and focus returns to the button
Acceptance items: 6
Viewport: desktop
pass
At 390px wide the page does not scroll sideways
Acceptance items: 7
Viewport: phone
pass
390px light
Result: pass
390px dark
Result: pass
1280px light
Result: pass
1280px dark
Result: pass

Screenshots, as evidence only: 8 in scripts/agent-usability/runs/2026-10-15/ouro/command-palette/1/score/screenshots.

command-palette, Ouro HX, run 2: 90/100

command-palette
Arm: ouro
Score: 90
Typecheck: 20/20
Lint: 10/10
Axe: 10/20
50/50
  • axe 1280px light: scrollable-region-focusable in palette-open (.h-\[min\(22rem\,60dvh\)\]) (-5)
  • axe 1280px dark: scrollable-region-focusable in palette-open (.h-\[min\(22rem\,60dvh\)\]) (-5)

Problems the app had before the agent ran, which cost nothing: 0 type errors, 0 lint errors.

"Search commands" opens a modal dialog titled "Command palette" with the search field focused
Acceptance items: 1, 2
Viewport: desktop
pass
Ctrl+K and ⌘K open the palette
Acceptance items: 1
Viewport: desktop
pass
Typing filters by label ignoring case, hides empty groups, and says when nothing matches
Acceptance items: 3
Viewport: desktop
pass
The first match is highlighted; Down then Enter runs the second, closes the palette and shows it
Acceptance items: 4, 5
Viewport: desktop
pass
Clicking a command runs it
Acceptance items: 4, 5
Viewport: desktop
pass
Escape closes the palette without running anything and focus returns to the button
Acceptance items: 6
Viewport: desktop
pass
At 390px wide the page does not scroll sideways
Acceptance items: 7
Viewport: phone
pass
390px light
Result: pass
390px dark
Result: pass
1280px light
Result: **fail**
1280px dark
Result: **fail**

Screenshots, as evidence only: 8 in scripts/agent-usability/runs/2026-10-15/ouro/command-palette/2/score/screenshots.

command-palette, Ouro HX, run 3: 100/100

command-palette
Arm: ouro
Score: 100
Typecheck: 20/20
Lint: 10/10
Axe: 20/20
50/50

Every check passed.

Problems the app had before the agent ran, which cost nothing: 0 type errors, 0 lint errors.

"Search commands" opens a modal dialog titled "Command palette" with the search field focused
Acceptance items: 1, 2
Viewport: desktop
pass
Ctrl+K and ⌘K open the palette
Acceptance items: 1
Viewport: desktop
pass
Typing filters by label ignoring case, hides empty groups, and says when nothing matches
Acceptance items: 3
Viewport: desktop
pass
The first match is highlighted; Down then Enter runs the second, closes the palette and shows it
Acceptance items: 4, 5
Viewport: desktop
pass
Clicking a command runs it
Acceptance items: 4, 5
Viewport: desktop
pass
Escape closes the palette without running anything and focus returns to the button
Acceptance items: 6
Viewport: desktop
pass
At 390px wide the page does not scroll sideways
Acceptance items: 7
Viewport: phone
pass
390px light
Result: pass
390px dark
Result: pass
1280px light
Result: pass
1280px dark
Result: pass

Screenshots, as evidence only: 8 in scripts/agent-usability/runs/2026-10-15/ouro/command-palette/3/score/screenshots.