Researcher Jim Fan presents the next grand challenge in the quest for AI: the "foundation agent," which would seamlessly operate across both the virtual and physical worlds. He explains how this technology could fundamentally change our lives — permeating everything from video games and metaverses to drones and humanoid robots — and explores how a single model could master skills across these different realities.

Jim Fan: The next grand challenge for AI

The next grand challenge for AI

AI's leap in mastering Go heralded a new era, yet its true potential lies beyond single-task mastery, dreaming of versatile agents.

Voyager, an AI in Minecraft, exemplifies the shift towards multifaceted intelligence, crafting its growth through self-reflection.

Foundation Agent envisions a future where AI adapts across countless embodiments and realities, a nexus of versatility and autonomy.