GPT-4 "Beats" Minecraft 🎮

Microsoft integrates GPT in Windows 11, GPT stirs up drama in Texas A&M

4 Min Read Intensity: ☕️☕️

Happy Thursday, Caffeinators ☀️

Is GPT-4 any good at playing video games? We’ll find out!

Today’s Starting Sips:

  • 🎮 GPT-4 Plays Minecraft by Itself

  • 🪟 Windows 11 Hired GPT as Sidekick

  • 🧙‍♀️ Texas A&M Professor Plays the ChatGPT Blame Game

  • 📚️ Learning of the Day: Under the Hood of Voyager

Believe it or not, Minecraft has been a strong benchmark to test how well an AI system is performing.

The newest contender? Voyager: a GPT Agent from the brilliant minds at Cornell University. But unlike its AI predecessors, Voyager isn't hitting any learning ceiling – it's constantly on the rise.

Voyager uses GPT-4, employing a distinct skill library, iterative prompting, and a craving for exploration.

The outcome is incredible:

  • 3.3x faster for scooping up unique items

  • 2.3x farther for roaming around the map

  • 15.3x faster for unlocking items

Voyager to the Moon 🚀

Is this just gaming? Not at all! It's a massive leap in AI development.

Let's not forget OpenAI's chatbot evolution started with Dota gaming bots. Just like chess and Deep Blue, Minecraft provides a controlled environment for AI breakthroughs, setting the stage for real-world applications.

Ever wish you had a better Siri? Microsoft’s got your back! Introducing CoPilot: the newest AI that is integrated into Windows 11’s OS and powered by GPT.

Ask it to "Help me get focused" and watch it set a timer, shift to dark mode, and even auto-organize your open windows.

Have a file? Drop it into CoPilot and enjoy auto-suggested actions: explaining, rewriting, summarizing.

And let's not forget app integrations. CoPilot can be your DJ, calendar manager, and messaging aid all at once!

The introduction of CoPilot marks an innovative shift by branding the entire Windows 11 as AI-driven. This represents Microsoft’s vision of marrying Operating Systems with AI.

Now we just need to wait and see how Apple will respond 🤭

Makes me want to get a Windows laptop…. 🦆

We've got an unusual case at Texas A&M University, where one professor, Jared Mumm, seems to have gone on a ChatGPT witch hunt.

His theory? Half of his students used AI to write their papers. So you know what he did? He failed them!

But it's not just about failing a course; the seniors among the accused even had their diplomas withheld without having sound evidence!

Mumm “verified” his claims by copy-pasting the suspect papers into ChatGPT and asked, "Did you write this?"

Unfortunately, Mumm clearly does not know how GPT works as the AI loves to claim credit…

Want me to prove it? I asked GPT if it penned Professor Mumm's own email, and guess what? It said yes!

Looks like the Professor's got some explaining to do himself, see Reddit

On a serious note, this event has triggered a necessary dialogue around AI tech in education among the university's officials. Despite the initial pushback, similar to what the internet faced in its early days, the integration of LLM tools like GPT in academia seems inevitable.

Want a TLDR on a 2-hour-long paper? Let's dive in!

Voyager has an impressive design! The creators first analyzed how people play Minecraft, then stitched all the processes together with GPT to create an autonomous explorer.

Minecraft isn't a linear game where there is an obvious and optimal path to the objective (think of Mario getting to Peach as fast as possible). It's more Sims-like, with continuous exploration that provides nearly infinite options to enjoy it.

Let’s see an example:

  • Situation: You're surrounded by pigs and you're starving

  • Task: GPT chooses to hunt pigs and feast

  • Action: You whip out your sword and go after them

  • Skill: In doing so, you learn to wield your sword

  • Next Stage

  • Situation: After hunting awhile, night falls, and zombies appear

  • Task: Fight zombies with skills you learned from hunting pigs!

Voyager forms an endless loop of actions and learnings:

Situation → Tasks → Action ↔️ Skill

Over time, Voyager’s skill base grows larger, so that more complex actions can be performed.

Where does GPT come in? It's the glue. Voyager relies on GPT for suggestions on tasks based on the current situation, the appropriate actions for the tasks, and even generating codes for tasks and updating skills.

Situation → Task using GPT-4, sourced from Voyager

But what makes Voyager shine? It's a two-part recipe: Minecraft (obviously!) and the automatic Reinforcement Learning phase called the Self-Verification stage. After each action, Voyager consults GPT on its performance, leading to additional actions or updates on its skill sets.

Click the title to find the whole paper

To-Go Cup 🥤

  • 🔴 Cornell University students invented Voyager which could play Minecraft without human intervention

  • 🪟 Microsoft integrated GPT into Windows 11 OS

  • 🤠 Texas A&M Professor withheld degrees because he accused students were using GPT to do homework

  • 🗺️ Voyager possesses a distinct architecture that continually explores and carries out actions and tasks, thanks to the assistance of GPT-4 and its self-verification stage

If you enjoyed this article, I think you will like this one too! It is about API calls for GPT.

Until next time,

Your friendly barista and ☕️ GPT!

Reply

or to participate.