🧙🏼‍♂️ Llama 3 is here

What's brewing in AI #36

Sponsored by

Reach 10k+ professionals leveraging AI. Sponsor this newsletter.

Howdy! Welcome to the 204 new wizards who joined the last week. And to all the OG subscribers reading my emails every week - I appreciate every one of you.

What’s brewing in AI #36

  • Dario’s Picks:

    1. Meta releases Llama 3

    2. Microsoft’s hyper-realistic talking face videos

    3. Multi-bot chat on Poe

    4. AI features coming to Adobe Premiere Pro in May

    5. OpenAI’s updated API dashboard and assistants API

  • GPTs: top arrivals in the GPT store and on whatplugin.ai

  • Bytes: the other important AI news this week

 Dario’s Picks 

1. Meta releases Llama 3

via ai.meta.com

Meta just dropped Llama 3, claiming that it’s the best open large language model publicly available. The two variants released are 8B and 70B parameters.

The new models are integrated into meta.ai, Meta’s answer to ChatGPT (available on web, insta, FB and WhatsApp). If you can’t access it yet due to geo restrictions, you can try it on Perplexity Labs, You.com or Poe.

Meta also has a massive 400B model in the works, which from early tests appears to be on the level of Claude Opus (3rd ranked of all models on the LMSys leaderboard).

Ps Mark Zuckerberg also appeared on two podcasts last week (Roberto Nickson and Dwarkesh Patel) covering Llama 3, Metaverse and more.

Why it matters

Meta is continuing as a leader in the open-source models space, and are now getting on par with the best proprietary models. Llama 3 beats the free versions of ChatGPT, Gemini and Claude on important benchmarks, and is giving the paid versions a run for their money, too.

Meta has also done a great job at packing a lot of juice into a small model with this release, which allows developers to build apps that run locally on machines rather than in the cloud (here’s an example of someone running Llama 3 locally on an iPhone).

This issue is brought to you by

What’s the secret to staying ahead of the curve in the world of AI? Information. Luckily, you can join early adopters reading The Rundown– the free newsletter that makes you smarter on AI with just a 5-minute read per day.

2. Microsoft’s new model: hyper-realistic talking face videos

via Microsoft

Microsoft released a research demo of VASA-1, a model that can create lifelike talking videos of people based on a still image and an audio clip of the subject’s voice. Micosoft’s goal here is real-time interaction with lifelike avatars.

We’re talking holistic facial nuances, natural motions, convincing lip sync (even singing!). I could on but a video says more than my words do anyway, so go ahead and have a look.

The new technique could improve access to education, accessibility for people with communication challenges and companionship.

Currently it’s just a research demo that’s released and there’s not any planned product or API.

Why it matters 

Imagine how strange it will be once this new tech meets the metaverse, something which I don’t think is far ahead at all. I’m equal parts excited and creeped out.

3. Multi-bot chat on Poe

Quora’s chatbot platform Poe launched the ability to chat with multiple bots in a single thread. Some of Poe’s bots are similar to GPTs (task-specific agents) but also ecompass the most popular LLMs.

For example, you can switch bots and models to utilise each one’s strengths whenever you need it, even mid-conversation:

You can do in-depth analysis with Gemini 1.5 Pro’s 1M token context window, @-mention Web Search bot into the conversation to pull in up-to-date information about the topic, and then bring a specialized writing bot in to complete a writing task, using the context from all of the previous bots

- Adam D'Angelo in The Quora Blog 

Why it matters

This is a great new feature for easily comparing different models for your use case. Since this also works with Poe’s other bots, not just the foundation models, you can combine models and bots to do complex tasks.

4. AI features coming to Adobe Premiere Pro in May

Adobe is bringing new AI features to their video editing platform, Adobe Premiere. Rolling out from May, the new features will let users use AI to add/remove objects within a scene and also extend existing clips.

The new features will be powered by Adobe’s Firefly AI models natively, but through plugins, the company will also bring on third-party models from OpenAI, Runway and Pika.

Why it matters

Gen AI for video is definitely having a moment, and Adobe is not sleeping on it. These features are far from the most reality-bending innovations in AI for video I think we’ll see this year, but they’ll likely be big time savers and potentially a part of many video editors’ workflows.

5. OpenAI’s updated API dashboard and assistants API

OpenAI announced two smaller but highly welcome updates for developers last week:

Why it matters

These updates are long-awaited by many developers. They’ll help them create and maintain advanced AI apps, build products that require accessing a large amount of information, as well as manage and control costs.

 GPTs 

Top new arrivals in the GPT store

Highly rated, new GPTs featured in OpenAI’s official GPT store (from the last week)

Top newcomers on whatplugin.ai

Highly-rated GPTs that made it into whatplugin.ai from the last week. How rankings work.

whatplugin rank

GPT

Category

Avg. rating

#112

Google Ads Virtual Assistant

Marketing and SEO

3.9 (84)

#246

YouTube ⚡️ Fast Version

Video Analysis

4.1 (106)

#423

Project Manager Buddy - Project Management 🤹

Learning

4.4 (489)

Submit your GPT to whatplugin and get featured in the newsletter.

 Bytes 

More notable AI news from the last week

  • Reka Core - a new powerful model that understands video. Demo here.

  • Google released 6 courses on how to use Gemini inside Google workspace.

  • Stanford released AI index report 2024. Takeaways: Gen AI investment has skyrocketed, workers become more productive with AI, scientific progress accelerates thanks to AI, ++.

 The wizard’s favourite AI newsletters 

what i’m reading right now

TLDR 💨 - the most important tech news daily. Read by 1.2 million people.

simple.ai 🕵🏻‍♂️ - deep-dives on AI by Hubspot’s co-founder (highly recommended)

Bagel Bots 🥯 - best hands-on tips & tricks

The Neuron 😸 - easy weekday read on AI’s latest developments

AI Minds 🧠 - semi-technical breakdown of trending AI topics

*if you sign up for these newsletters I may earn a commission at no cost to you. If you do, THANK YOU, it will make it possible for me to continue to do this.

That’s a wrap for this week!

Fellow sorcerers – join me on LinkedIn.

Until next time,

Dario Chincha 🧙🏼‍♂️

What's your verdict on this week's email?

Login or Subscribe to participate in polls.