Say hello to GPT-4o
Click me to go to the top
๐Ÿ‘ท๐Ÿป Weโ€™re experiencing technical issues. Some site functionality is temporarily down.
side
outstream

The best AI tools weโ€™ve tested sent to your inbox weekly.

โ€Subscribe to my weekly AI newsletter and get my top list of GPTs for free.

By clicking Sign Up you're confirming that you agree with our Terms and Conditions. Unsubscribe at any time.
Thank you! The World is Yours ๐Ÿค
Oops! Something went wrong while submitting the form.

What's brewing in AI #39

Say hello to GPT-4o

This is some text inside of a div block.
(
This is some text inside of a div block.
ratings)
user ratings)
Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.
_

OpenAI Spring Update special: GPT-4o, free GPT-4 for everyone, ChatGPTโ€™s new Desktop app.

Creator of whatplugin.ai & the What's Brewing in AI newsletter
May 15, 2024

โ€ฆand itโ€™ll say it back, without the lag.

113,000 people joined in on the OpenAIโ€™s Spring Update livestream yesterday. Thereโ€™s some serious upgrades to cover, so Iโ€™ll save the other AI news for later this week.

Hereโ€™s my breakdown of OpenAIโ€™s spring update:

  1. OpenAI launches a new model, GPT-4o. Itโ€™s faster, cheaper and its voice & vision capabilities is like AI from the movies.
  2. Free GPT-4 for everyone. That includes GPT-4o (with limited messages) and using custom GPTs.
  3. The voice and vision capabilities are off the hook. See OpenAIโ€™s demos.
  4. ChatGPTโ€™s new Desktop app. You can talk with it and it can see what youโ€™re doing. Coming first to macOS.
  5. Feeling confused? My summary of whatโ€™s already rolled out and whatโ€™s coming.

โ€

Darioโ€™s Picks - OpenAIโ€™s Spring Updates special

1. The new model: GPT-4o

  • GPT-4o has GPT-4 level intelligence and itโ€™s omnimodal. That is, it combines audio-text-video in the same model and processes all modalities natively.
  • This means ChatGPT can now see, hear you and respond to you almost in real-time.
  • Itโ€™s also 2x faster than GPT-4 Turbo, something already very noticeable in ChatGPT.
  • Thereโ€™s also API access for developers and itโ€™s 50% cheaper to use.

โ€

Why it matters

The best AI model in the world just got twice as fast and itโ€™s cheaper to build apps on. Also, the naming choice is pretty on-brand for OpenAI โ€“ very cryptic and hard to pronounce ๐Ÿ˜„

โ€

2. GPT-4 is now free, including using custom GPTs

โ€

via @emollick on X

โ€

Most of the features previously in ChatGPT Plus is now becoming free to all users. That includes GPT-4o (with a message limit), web browsing, advanced data analysis, file uploads and cross-chat memory.

Free users will also have access to use custom GPTs and the GPT store โ€“ which is huge for free users and for the GPTs ecosystem alike.

โ€

Why it matters

This move is not to be underestimated for the mainstream adoption of AI; free users will have a much more capable model now, with more useful features to boot, which is likely to reduce churn.

Cleverly, OpenAI isnโ€™t allowing free users to create GPTs, only use existing ones. A lot of the potential in custom GPTs lies in creating ones tailored to your specific workflow, so this could result in good conversion from free to paid.

โ€

3. GPT-4o voice and vision capabilities are now way more real-time

โ€

via @sama on X

โ€

GPT4-o brings near real-time voice interactions and image/video understanding to ChatGPT. It can do this because it is trained on text, video and audio from scratch. The previous voice and image modes were using a few different technologies stitched together, but this model is natively multimodal (thus, big latency improvements).

So, interacting with voice is now much more seamless. For example, you can interrupt ChatGPT while its speaking and it can change its speed and voice tone easily. It can also understand whatโ€™s happening from your camera or desktop view in real-time.

Check out some of OpenAIโ€™s best demos of GPT-4o:

The new omnimodal capabilities are rolling out gradually, and OpenAI emphasised the importance of safety, probably to check that their guardrails are working as expected.

โ€

Why it matters

This is huge for the user experience. If youโ€™ve seen the movie her โ€“ thatโ€™s basically what the new model is capable of (not just for romance, but for anything). Check out the demo with the translation between two languages, to see just how real-time weโ€™re talking.

โ€

4. ChatGPTโ€™s Desktop app means you have a copilot for everything you do

โ€

via @NickADobos on X

โ€

ChatGPT is getting a new desktop app which can interact with what youโ€™re doing on your computer. You launch it with Option + Space, and you can easily pass screenshots or share your screen in real-time with it. Thatโ€™s right, the desktop app has vision (you need to give it permission, itโ€™s not active all the time)! For example, you can have it look at a graph on your screen with you and analyse it.

The Desktop app will roll out over the next few weeks to Plus users, and gradually become available to everyone. Some tech-savvy folks have already hacked the system and are already running the app, though. Funnily, that โ€œhackerโ€ is Nick Dobos, creator of one of the most popular custom GPTs (heโ€™s got some nerve lol). But if youโ€™re not technical or transgressive enough to hack your way to early access, donโ€™t fret, you should get it soon enough.

โ€

Why it matters

A final goodbye to your privacy! (just kidding. I hope.) This means youโ€™ll have an AI sidekick that can be part of your tasks and communicate through voice and vision, easily available throughout your workday. Saw someone else ask this timely question: will everyone talking to AI now be the nail in the coffin to open-landscape workspaces?

โ€

5. Whatโ€™s already available and whatโ€™s yet to roll out

With all the new features launched, the gradual roll-out and the different pricing tiers, its easy to get confused.

Hereโ€™s my recap of whatโ€™s already here and whatโ€™s still to come:

  • The basic GPT-4o model in ChatGPT should already be available, both for free and paid users.
  • GPT-4oโ€™s full capabilities in ChatGPT will roll out gradually over the coming weeks.
  • The new version of Voice mode you see in the demos is coming to ChatGPT Plus in the coming weeks.
  • The GPT-4o API for developers is already available, but the upgraded audio and video capabilities are launching first to a small group of trusted partners.
  • The ChatGPT desktop app will become available to both free and paid users. Rolling out over the next few weeks, starting with Plus users. Currently macOS only, coming to Windows later this year.
  • Using Custom GPTs is still not available on the free plan, but should become so shortly.

The advantages of ChatGPT Plus vs free are still big: 5x higher message limits on GPT-4o (including Advanced Data Analysis, file uploads, vision and web browsing), ability to create custom GPTs and DALLยทE.

GPTs mentioned

No Results Found

Sorry mate, we couldn't find any such plugins.

GPTs mentioned in this article

Revolutionizes coding by enabling website creation with just a sentence. Harnesses the power of **************Prompt-gramming***************** with over 15 hotkeys for coding flows and 19 starter projects, encouraging prompt-first creativity and supporting diverse inputs like images or quests.

Coding
November 7, 2023
This is some text inside of a div block.
likes
๐Ÿคท๐Ÿปโ€โ™‚๏ธ
No Results Found

Sorry mate, we couldn't find any such plugins.

Plugins mentioned in this article

No items found.
๐Ÿคท๐Ÿปโ€โ™‚๏ธ
No Results Found

Sorry mate, we couldn't find any such plugins.

โ•Please exercise caution when using any plugins. While available on the ChatGPT plugin store, they have not been verified by the author of this site. Use is at your own risk and potential security risks may be associated. For more information, refer to this article.

GPTs by category

Most Popular GPTs
50
GPTs
Trending GPTs
30
GPTs
Say hello to GPT-4o