←Ben’s Bites Waybackbensbites.beehiiv.com/p/bb-digest-openai-treats…3 Oct 2024sent to 112,052opened 47.0%clicks 9,122unsubs 184← 1 Oct · 8 Oct → · random

Digest #498 → Subscribe4 | Upgrade to Pro124

Hey folks, we have two workshops next week.

TLDR; inside today’s newsletter

  • OpenAI grabs $6.6B, Pika unveils reality squishing videos.

  • ICYMI: new courses and tutorials for you to learn

  • snack n skill - a bite-sized lesson on using ElevenLabs

  • 7 of the best new AI tools

  • 5 interesting posts from around the web

  • to-do’s

Alright, let’s get to it!


 🔎 Trends & news

  • OpenAI launched 4 key upgrades for developers268 at their SF chapter of Dev Day. The biggest update is a new Realtime API that allows developers to create voice interactions like Advanced Voice mode. Others include prompt caching, fine-tuning on images and model distillation. It has also officially announced raising $6.6B at a $157B valuation147 (biggest venture round ever).

  • Microsoft's giving Copilot a proper glow-up336, adding voice and vision to its consumer version. Boss-man Mustafa Suleyman says it'll be your new best mate, always there. Oh, and the new design for the app got a whiff of Pi about it—lmost like they used the same designer. Oh wait, they did!11

  • Gemini Advanced414 is now sporting the shiny new Gemini 1.5 Pro-002 model, but it’s already nerfed. Bit of a shame.

  • Pika Labs’s new video generation model is live. Pika 1.5503 can create unreal effects, cinematic shots and more moving elements.

  • Tired of repeating yourself? Guidde, a GPT-powered tool, lets you create AI-generated, step-by-step guides with visuals, voiceovers, and CTAs—11x faster than manual docs. Share or embed anywhere. Save time, make documentation engaging, and it's 100% free. Try Guidde today!373*
    *sponsored


👀 ICYMI: New stuff we’ve launched

Tutorials:

Blog:

ps: you can listen to our blogs on the Elevenlabs’ Reader app121 too.


🍽️ Snack ‘n’ skill

Learn how to add AI-generated audio to your projects

Adding realistic voice-overs can make your content more accessible and engaging. Whether it's turning blog posts into podcasts or dubbing videos into multiple languages, AI-generated audio opens up new possibilities for creators and businesses alike.

Step 1. Setup an Eleven Labs account

Eleven Labs has a suite of audio and speech features that you can use. All the features in this tutorial are available to try for free.

To begin with, you can create an mp3 file of a speaker reading out your content using the “text-to-speech” tab.

Step 2. Create more rich audio content

  • For the “Sound Effects”, you can use a descriptive prompt for the effects you need. Adjust the “Prompt Influence” slider to control the AI's creativity.

  • On clicking “Generate sound effects”, you can choose and download from the four variations provided.

  • To translate content, use the “Dubbing” tab and select your source and target languages.

  • Upload your audio or video file or provide a link to it.

  • Adjust the settings (Number of Speakers, Video Resolution, Time Range, Watermark).

  • Create, view and download your dubbed audio or video.

Tip: You can use ChatGPT to rewrite your content like a podcast before uploading it to ElevenLabs to get rid of the monotonous reading and get engaging audio (like NotebookLM’s Audio Overviews).

This walkthrough is a condensed version of this tutorial117. Check out our category for creating multimedia content104 using AI for more such tutorials.


⚙️ Top new tools

  • LeMUR by AssemblyAI186* - Leverage LLMs to extract insights from audio data.

  • JARS AI468 - Interactive TV shows generated from simple prompts.

  • Coframe331 - Forget generic UI. Generate on-brand UI code that converts.

  • Keep by Inkeep143 - Quick, high-quality support answers with your team in the loop.

  • Inbox Zero225 - Sort, reply or archive email based on your personal rules. (demo136)

  • Local File Organizer310 - Bring order to your file chaos, privately.

  • Hedy AI302 - Get next-level advice in real time during your meetings.

More tools here →189
*sponsored


 📜 Interesting posts


📌 To-dos

Let us know64† if you have any tutorials or courses you want us to create—we’re always open to ideas.

That wraps things up for today! See you again on <day>. 👋

Ben

Enjoy this newsletter? Please forward to a friend.

Want more education on AI? Become a Ben’s Bites member73 and access our courses & tutorials.

Want to advertise in this newsletter? Click here70.

BB Digest: OpenAI treats developers
PLUS: A new Copilot for everyday use

less more clicks · number = clicks † = site gone, link opens the Wayback Machine

Most clicked in this issue

503pika.art/home
468x.com/honeyimholm/status/1841187790425374899
440x.com/karpathy/status/1841594123381571863
414x.com/GeminiApp/status/1841593293173621235
373bensbites.beehiiv.com/p/microsoft-pulls-infec…
373guidde.com
336blogs.microsoft.com/blog/2024/10/01/an-ai-com…
331coframe.com/post/coframe-works-openai-to-deve…
310github.com/QiuYannnn/Local-File-Organizer
302hedy.bot
294bensbites.com/event/practical-multi-agent-aut…
268openai.com/devday

2,587 readers clicked at least once. 36 links, 36 with clicks. Heat is relative to the most clicked link in this issue.

Beehiiv · digest