S⁷⁴ubscribe⁷⁴ | Ben’s Bites Pro⁴ | Ben’s Bites News⁴⁵
Daily Digest #386

Want to get in front of 100k AI enthusiasts? Work with us here^69†

Hello folks, here’s what we have today;

PICKS

1. Meta is likely to launch 2 small-sized Llama-3 models next week.⁴²⁴ Meta's Llama family of models is up for a 3rd reboot. While the largest one (up to 140B parameters) will take a while, we might see the smaller ones next week.🍿Our Summary¹⁵ (also below)

2. Google adds Gemini Pro to Android Studio.²⁸² You can ask questions about development or use code completions. There’s a handy template as well to get started.

3. Ferret UI by Apple⁶⁵⁹ - Making multimodal models understand user interfaces. Apple’s research team has been on a roll recently. They have been actively releasing new papers around allowing LLMs to access and understand what’s on your screen. Please, give us a Siri that works this WWDC.

from our sponsor

GenAI ¹⁵¹🤝 Data Privacy: Run Models in Your Environment with OctoAI¹⁵¹

OctoAI just launched OctoStack, the GenAI serving stack you can run securely in your environment. Join their technical deep dive on April 17th and learn how to run super-efficient inference to maximize your GPUs, customize any model you choose, and achieve reliability at scale. Register for the live virtual event here.¹⁵¹

TOP TOOLS

• Morph⁵⁸² - Open-source answer engine with generative UI.

• UI Bakery⁵⁷¹ - Generate web apps over your data with AI.

• Ideatum⁴⁸⁶ - Create colour schemes and font pairings for your design ideas.

• Package Design³⁴⁷ - Turn ideas into designs for your product’s packaging.

• Private LLM⁴⁴⁸ - Local models made fast for Apple silicon.

• Instashorts⁴¹⁹ - Tiktok stories but with your voice.

• llm.c¹⁷⁷ - LLM training in simple, raw C/CUDA.

• Melodisco³⁰⁷ - Discover and play AI music.

View more →¹⁵⁴

NEWS

• OpenAI made Sam Altman famous⁶⁷⁰, his investments made him a billionaire.

• The email assistant⁵³⁰ I’ve been waiting for—with Andrew Lee of Shortwave.

• 12 scaling laws³⁴⁵ for LLM knowledge capacity by Meta.

• Microsoft is confident Arm-based Windows devices could finally beat Apple Macbooks¹⁸⁵ in AI performance.

• Building an AI coach⁶²⁶ to help tame my monkey mind.

• South Korea will invest $7B in AI¹²² by 2027 and an additional $1B into AI chip companies.

View more →⁸⁰

QUICK BITES

Meta's Llama family of models is up for a 3rd reboot.⁴²⁴ It’s been cooking up ways to make Llama 3 models larger (up to 140B), less restrictive, and better in performance. While the largest one will take a while, we might see the smaller ones next week.

What is going on here?

Smaller versions of Meta’s Llama 3 could be released next week.

What does this mean?

Open-source models come in sizes based on their parameters. Meta’s Llama models kicked off the push of open-sourcing actually large LLMs with billions of parameters (from 7B to 70B) last year. Now, even 7B parameter models are considered small.

But with Mistral and other companies launching powerful models in this weight class, Llama 2 7B is no longer the frontrunner. Meta wants to change that by giving us a preview of smaller models from the Llama 3 family.

How small these models would be is a secret. Would they follow the Llama patterns of 7B and 13B models? Or will it try to enter the new category of 2B models started by Microsoft’s Phi and Google’s Gemma?

Why should I care?

Open-source models can be run locally on your devices without any internet. The benefits of this approach are speed, privacy and lower cost as well in some cases.

Often they are not good for longer generation tasks. Don’t get me wrong, with how better these models have gotten over the past year, they steal GPT-3.5’s lunch money.

But they are primarily used after fine-tuning to fit specific tasks like making simple API calls, device assistance (like Siri, Alexa) etc.

Share this story¹⁵

Ben’s Bites Insights

We have 2 databases that are updated daily which you can access by sharing Ben’s Bites using the link below;

• All 10k+ links we’ve covered, easily filterable (1 referral)

• 6k+ AI company funding rounds from Jan 2022, including investors, amounts, stage etc (3 referrals)