Findings · run 2026-11-02

What AI coding agents install, and what they skip

Short write-ups of the biggest results in the leaderboard: where one product takes every install, and where a well-known product is named but never installed. Each one links to the prompts and the raw answers.

• Supabase is mentioned, never installed: the Postgres host AI agents pick

  We asked Claude, GPT and Gemini to set up hosted Postgres 30 times. Neon was installed in 20 answers. Supabase was named 4 times and installed 0 times.

• Drizzle vs Prisma: which ORM Claude, GPT and Gemini install

  In 30 AI coding answers that needed an ORM, Drizzle was installed 16 times and Prisma 5. Claude never installed Prisma.

• Sentry and Playwright: the only tools AI agents install every time

  Across 20 devtool categories, only two products were installed in every single AI coding answer: Sentry for error monitoring and Playwright for end-to-end tests.

• Which email API do AI agents install? Resend 16, Postmark 4, Mailgun 0

  In 30 AI coding answers that send transactional email, Resend was installed 16 times. Postmark was named 9 times and installed 4. Mailgun was named 4 times and never installed.

• Radix UI is named 11 times and never installed: shadcn/ui takes the pick

  In 30 AI coding answers that needed UI components, shadcn/ui was installed 19 times. Radix UI was mentioned in 11 answers and installed directly in none.

• Datadog was named 9 times by AI coding agents and installed 0 times

  When Claude, GPT and Gemini set up logging and tracing, they installed Grafana/Prometheus (12) and OpenTelemetry (10). Datadog was named in 9 answers and never installed.

• Cloudflare R2 vs S3: AI agents name R2, then install the AWS SDK

  In 30 AI coding answers that store files, AWS S3 was the pick 17 times. Cloudflare R2 was named in 6 answers and never chosen, usually as 'the same code with a different endpoint'.

• pgvector beats Pinecone, Qdrant and Chroma in AI-written RAG code

  In 30 AI coding answers that build retrieval or semantic search, pgvector was installed 10 times, Qdrant and Chroma 5 each, Pinecone 2. Gemini never picked pgvector.

• Where AI coding agents deploy: Vercel 12, Netlify, Railway, Render and Fly.io 0

  In 30 AI coding answers that deploy an app, Vercel was used 12 times. Cloudflare, Google Cloud Run and self-hosting got 6 each. Netlify, Railway, Render and Fly.io were each named twice and never used.