Applied AI Postdoctoral Researcher, 3D Embodied Agents and Gaming
About the role
About us
Ego is building an Infinite Game - a persistent virtual 3D world where humanlike AI agents are able to interact with players and each other to build their own relationships, communities, and games within the game. Our embodied AI agents can perceive the world in 3D, reason like a human, and write scripting code directly into the game engine.
Feel free to learn more about ego on our YC launch page:
The Role
We're seeking an exceptional AI researcher/engineer to join our team in developing the ego game agent architecture - a groundbreaking system for autonomous gameplay in 3D environments. This role combines cutting-edge research with practical engineering to create AI agents capable of human-level reaction times (300-500ms) in complex game worlds.
Working with our team and researchers from AI Singapore and NTU's Prof. Bo An's Lab, you'll help architect a hierarchical AI system that combines high-level reasoning using multimodal LLMs with fast, low-level action models. The ideal candidate brings deep expertise in computer vision, transformer architectures, and real-time AI systems, along with practical experience shipping production ML systems.
Your work will focus on developing and optimizing:
- Real-time perception systems using state-of-the-art computer vision models
- Fast vision-language-action models inspired by robotics approaches
- Efficient model architectures that achieve human-level reaction times
- End-to-end autonomous gameplay across various 3D games
This role represents a unique opportunity to push the boundaries of AI gaming, building on projects like Minecraft Voyager while working within our game development ecosystem. You'll collaborate closely with our engineering team to integrate these AI systems seamlessly into our game engine, while conducting novel research that advances the field of autonomous game AI.
