←Ben’s Bites Waybackbensbites.beehiiv.com/p/bb-digest-chatgpt-vs-co…4 Feb 2025sent to 116,351opened 46.4%clicks 7,449unsubs 159← 30 Jan · 6 Feb → · random

Digest #529 → Build with 20k+ others - Become a Pro member37

Hey folks, guess who’s finally building146 with AI coding tools? Me! I think this is the actual process607 non-technical folks need to use to build with these tools (not learn to code)

Also scheduled new workshops all around building:

  • 11th Feb with bolt.new206 - Create full-stack apps and deploy them. (sign up155)

  • 14th Feb with builder.io163 - Get working code from your Figma designs. (sign up77)

  • 19th Feb with create.xyz226 - Quickly bring your AI app ideas to life. (sign up79)

more workshops for building with AI (Cursor, Replit) are coming soon.

TLDR; inside today’s newsletter

  • o3-mini arrives and a new agent in ChatGPT

  • Gemini gets smarter, jailbreaking Claude and Mistral Small

  • conversations from our community

  • 5 AI tools with a new music maestro

  • what caught my eye from OpenAI’s Reddit AMA

  • 5 interesting reads including the death of Wikipedia

  • to-dos

Alright, let’s get to it!


 🔎 Trends & news

  • OpenAI’s o3-mini is finally here83. It comes in two flavours for users: o3-mini and o3-mini-high. It’s available to everyone in ChatGPT (including free users)

    • Plus & Team users have up to 150 messages per day with o3-mini and 50 messages per week on o3-mini-high. Pro users have unlimited access.

    • On benchmarks, o3-mini’s performance39 is much stronger than o1-mini but it is still dumber than o1. o3-mini-high is supposed to be a bit (not much) smarter than o1, but it failed a real-life test103 that only o1 has passed for us.

    • These models can’t understand images (o1 can), but they can search the web (o1 can’t). ik, it’s a mess. o3-mini for devs58 has more options though.

  • OpenAI also launched Deep Research106, a new “agent” in ChatGPT that’s based on the full o3 model.

    • Similar to Gemini’s feature with the same name69, it scans through multiple websites, reasons about them and adds an intelligent POV to compile comprehensive reports (vs Google’s implementation which mostly summarizes what it found).

    • To be fair, Gemini Deep Research is $20/month with unlimited reports. ChatGPT Deep research is only for Pro users rn ($200/month) and you get 100 queries a month and it’s still a great value for money in my opinion.

    • Dan Shipper took it for a run214 and calls it a “bazooka for the curious mind”. Ethan Mollick created a 30-page report on table top games296 using Deep Research and shared his views272† on it.

    • And we already have two open-source versions trying to do the same: Open Deep Researcher206 and GPT Researcher172.

  • Gemini quietly got upgraded86 to a stable version of 2.0 Flash and Imagen 3. The 2.0 Flash model for devs is still under the “experimental” label but I assume a stable version is coming soon.

  • Anthropic has a new paper on their approach to defending Claude against universal jailbreaks127. There’s a demo too82 that you can try to break.

  • Perforator helps devs slash server costs by 20% by spotting inefficient code in real-time. Open-source, runs with zero slowdown, and works with C, Python, Rust & more. Free on GitHub—because optimizing infra shouldn’t cost billions. 🚀 Try it now111*

  • Mistral AI released a new model - Mistral Small 386. They call it small but it has 24b parameters. Pushing it, innit?
    *sponsored


💬 Inside the community this week

Become pro69 to join us building and learning together.

  • Jeff asked about voice transcription apps and SuperWhisper alternatives. (link177)

  • Amie’s accepting questions for her “tips for using bolt” office hours. (link46)

  • Several members shared their task-capturing workflows in a thread. (link107)

  • Este and Wyatt compared notes on using Gemini’s Deep Research vs ChatGPT’s Deep Research. (link117)

  • I shared Sahil’s (Gumroad’s founder) process of building with AI tools. (link166)

  • Daniel asked for help with implementing payments to his project built with Lovable. (link33)

  • Keshav shared that Grok is improving fast and he uses it for real-time queries. (link65)

  • H. Chad shared a study that claims AI explanations can change people’s minds about conspiracy theories. (link43)

Join the conversation, plus full access to courses and workshops by becoming a pro member69 today!


⚙️ Top new tools

More tools here →108
Showcase your tool at the top of this list. Book an ad here19†.


👀 What caught my eye… from OpenAI's Reddit AMA

OpenAI did an AMA on Reddit51 after o3-mini’s launch. I combined the key answers (esp. the ones about their near future plans) below. Direct statements from OpenAI members are “italicised inside quotes”.

  • GPT-4o is not done. This model will get more improvements soon and a highly anticipated feature: image generation using 4o (and not DallE-3) is coming in a few months.

  • Combining all the features of ChatGPT (file uploads, search, canvas, voice etc.) with the reasoning models (o1, o3-mini) is a high priority. “The next step is integrating all of this so you can speak to a model that reasons as it searches and produces a canvas that runs Python.”

  • o3 when? “in more than a few weeks, less than a few months.” I am expecting March end.

  • showing thinking tokens: “bunch more than what we do today - very very soon. TBD on all.”

  • Q: I wish ChatGPT could analyze images in PDFs (Claude has this). A: OpenAI recently released that in the Enterprise version29. Coming to Plus in the future.

  • Sam on Deepseek R1: “it's a very good model! we will produce better models, but we will maintain less of a lead than we did in previous years” and “R1 updated us on this [showing thinking tokens]”

  • Sam also mentioned that “they’ve been on the wrong side of history” when it comes to open source. They are considering some changes but he also said that “not everyone at OpenAI shares this view” and it’s not a priority.

  • Updates for Advanced Voice Mode, Assistants API and long context window are under work but no timeline for when these updates will land.


 📜 Interesting posts


📌 To-dos

That’s it for today. Feel free to hit reply and share your thoughts. 👋

Enjoy this newsletter? Please forward to a friend.

Want to join a community of AI-curious folks? Become a Ben’s Bites member32 and get full access to our Slack, workshops, and courses.

Want to advertise in this newsletter? Click here26.

BB Digest: ChatGPT vs Consultants
PLUS: Gemini's quiet upgrade, OpenAI's royal rumble

less more clicks · number = clicks † = site gone, link opens the Wayback Machine

Most clicked in this issue

607x.com/bentossell/status/1886700216306258196
337text-to-api.ai
296chatgpt.com/share/67a152bf-0d1c-8000-a4b1-773…
292a16z.com/ai-voice-agents-2025-update
272oneusefulthing.org/p/the-end-of-search-the-be…
268x.com/swyx/status/1886540254997569638
264elevenlabs.io/blog/how-conversational-ai-will…
255workspaceupdates.googleblog.com/2025/01/gener…
250x.com/riffusionai/status/1884984941081198954
241founderpal.ai
226Create.xyz
214every.to/chain-of-thought/we-tried-openai-s-n…

2,802 readers clicked at least once. 52 links, 52 with clicks. Heat is relative to the most clicked link in this issue.

Beehiiv · digest