GenAI in Gaming Industry Report: Q4 2024
Explore AI co-pilots, substantial investments, and the rapidly changing landscape of AI-driven technologies
If you would like exposure to the biggest opportunities at the intersection of GenAI, XR, Gaming, and UGC -- access our Investor Deck for Hartmann Metaverse Ventures Fund II or schedule a call with our team.
Welcome to the Q4 Edition of the AI in Gaming Industry Report. Building on our Q3 coverage, which examined AI co-pilots, substantial investments, and the rapidly changing landscape of AI-driven technologies in the gaming industry, this quarter's briefing focuses on how these advances transform development processes and gaming experiences.
This report will focus on:
The latest AI Developments
High-Profile Funding and Acquisitions
Cutting-Edge Research Highlights
Whether you're a developer, publisher, investor, or simply interested in the fast-evolving opportunities, this Q4 report will be your compact guide to everything going on at the intersection of AI and gaming.
In The News
Millions of player-captured augmented reality scans from Pokémon Go and other Niantic games were used to create a new "Large Geospatial Model" (LGM), which the company unveiled. Niantic's Visual Positioning System gathers these scans, which map actual locations from a pedestrian viewpoint - often in places off-limits to cars. Integrating AI and 3D geometry, Niantic hopes to provide cutting-edge augmented reality and location-based game experiences. Players in 2016 probably didn't expect their gameplay data to power a commercial AI platform, which has raised privacy issues.
Google DeepMind showcased Genie 2, a “foundation world model” that turns a single prompt image into a fully interactive 3D scene. Demonstrations highlighted advanced physics, character animation, and continuous world consistency lasting up to a minute. The system allows rapid prototyping, allowing humans or AI agents to interact with newly generated environments in real-time. Though hardware demands remain steep, Genie 2 offers a glimpse of how AI-driven tools could soon create entire game worlds on the fly.
Microsoft and Activision unveiled plans to integrate advanced AI into future Call of Duty titles. AI features such as more intelligent NPC behaviors, procedurally generated missions, and real-time player feedback systems will enhance gameplay dynamics.
Investments
Over Q4 2024, these startups collectively raised about $315 million, with Luma AI ($90M), Moonvalley AI ($70M), Genmo ($28.4M), and Decart’s two rounds ($21M and $32M) representing the biggest fundraises. This quarter’s financing shows investor appetite in generative storytelling, AI-driven 3D creation tools, game distribution, and social gaming platforms.
The Latest Research
DeepMind's Genie 2 represents a significant leap in interactive game worlds. It features an 11B-parameter model that transforms single images into dynamic 3D environments.
The system showcases sophisticated physics simulation and character animation, maintaining coherent worlds for up to a minute. However, computational demands remain a key challenge.
Dablander's research introduces a cognitive framework that places LLMs at the core of game AI. The system's modular design - incorporating perception, memory, thinking, action, and learning components - proved highly effective in tests with 25 AI agents who demonstrated sophisticated social behaviors and adaptive interactions.
While Google DeepMind's Genie 2 successfully extended these concepts to generate interactive 3D game worlds with impressive physics and character animations, it still faces key limitations, including low frame rates (around 1 FPS) and occasional stability issues in maintaining world consistency beyond one minute.
The study "Integrating artificial intelligence into game development" highlights The Witcher 3's NPCs, which use behavior trees and emotional modeling to make realistic decisions based on simulated feelings, and Left 4 Dead's AI Director, which analyzes player performance to dynamically adjust difficulty.
The research found these AI systems significantly improved player retention and satisfaction by creating personalized experiences that maintain an optimal challenge level throughout gameplay.
DreamGarden, developed by researchers at NYU, UT Austin, and Microsoft, bridges the gap between concept and creation with its hierarchical LLM system. Its innovative node-based interface gives developers precise control throughout development, proving particularly valuable in early prototyping.
The system's strength lies in its ability to break down high-level prompts into actionable tasks through a "garden" of interconnected nodes that can be pruned or expanded based on developer needs. While studies showed users found value in the planning and visualization aspects, the system currently faces limitations in generating complex simulations and maintaining consistent performance in real-time environments. This balance between autonomous generation and user control positions DreamGarden as a promising tool for rapid prototyping and early-stage game development.
Microsoft's GamePlot revolutionizes narrative design with real-time story refinement and dynamic NPC control. However, a key study of 14 designers revealed a significant divide: developers favor automation, while writers prioritize creative control, highlighting the need for specialized AI tools.
Tencent's PlayGen achieves a breakthrough in real-time game generation, delivering 20 FPS on consumer hardware through advanced data sampling techniques. The system maintains exceptional visual quality and precise mechanics for extended periods, effectively solving the performance-accuracy trade-off.
UPenn's REGENT introduces a novel approach to agent adaptation, combining retrieval-based learning with transformer architecture. The system achieves superior results while using significantly fewer resources—3x fewer parameters and 10x less training data—challenging conventional scaling wisdom.
UCSC's ConvMesh offers a fresh perspective on 3D mesh optimization, employing convex optimization instead of neural methods. It achieves remarkable quality improvements using just 500 reference points, though the current two-hour processing time suggests room for efficiency gains.
UC Berkeley and Starward Games merge AI with DeFi in their GameFi ecosystem. They use GPT-4 and Claude to create context-aware agents that actively shape in-game economies. The system demonstrates enhanced player engagement while preserving blockchain principles despite computational challenges.
Modl.ai and Riot Games use an innovative sensor-based approach to tackle the challenge of human-like gaming AI. Their 14.9M-parameter model achieves impressive 9.59ms inference times on consumer CPUs and is remarkable in its authenticity—fooling 30% of players in human evaluation tests.
How AI Shaped Gaming in 2024
In 2024, gaming split into two camps over AI. While the PlayStation Boss says AI can "Revolutionize" gaming, Nintendo took a decisive stand against using generative AI in its titles.
Major publishers moved quickly to implement AI solutions. Electronic Arts led with over 100 AI projects, demonstrating their commitment through College Football 25's AI-generated stadiums and player models. Their innovation extended to Battlefield's development with AgentMerge for issue tracking. Meanwhile, Modl.ai achieved a technical breakthrough with its tactical shooter AI, using innovative sensor technology to achieve unprecedented processing speeds.
Research teams pushed technological boundaries even further. Google DeepMind's Genie 2 maintained consistent environment generation for up to 60 seconds, while Ubisoft's Project NEO demonstrated sophisticated NPC interactions. More importantly, these advances began reaching consumers. Retail Mage launched on Steam as one of the first AI-native games, while 1001 Nights moved into final development.
The industry underwent structural changes to embrace AI development. NCsoft established three dedicated AI studios, and Microsoft began integrating AI features into Call of Duty. Gaming AI startups secured $400 million in a single quarter. However, this AI boom coincided with industry-wide struggles, as over 30,000 developers lost their jobs since 2022.
Implementation challenges emerged as AI met reality. Palworld faced criticism over AI-generated content, while players quickly identified flaws in Call of Duty's AI-created items. The temporary shutdown of Itch.io over AI-related copyright concerns prompted Adobe to develop protective tools for artists, highlighting the need for better safeguards.
As 2024 drew to a close, the industry gained valuable perspective on AI's role. The most successful implementations focused on enhancing specific production processes rather than replacing human developers entirely.
Predictions for 2025: Breaking New Ground
1. Local Processing Takes Center Stage
In 2025, the gaming industry is witnessing a fundamental shift in AI implementation. NVIDIA's Jetson Orin Nano Super is at the forefront of this transformation, a breakthrough in local AI processing that delivers 1.7x better performance at an accessible price of $249.
NVIDIA's ACE technology has laid the groundwork for lifelike digital humans in games, providing sophisticated AI models for speech, animation, and behavior generation. This foundation is now enabling even more ambitious projects in local AI processing.
One of the most promising demonstrations of local AI's potential is GARP (Generative Agents Real-time Playground), a new technology that runs complex NPC simulations entirely on local GPU hardware. Running on a single NVIDIA 3090, GARP can simulate up to 20 unique characters, each with persistent memories, learning capabilities, and dynamic decision-making systems. These AI-driven characters engage in natural language interactions, develop distinct personalities, maintain daily routines, and even form relationships while coordinating activities with other NPCs.
2. Game Engines Embrace AI Integration
The major game engines are rapidly evolving to meet this AI-driven future. Unity and Unreal Engine are expanding their native AI capabilities, while specialized tools like Coplay, Ludus AI, and Cursor are revolutionizing development workflows.
This ecosystem of AI-powered tools is creating a more efficient and accessible development environment for studios of all sizes.
3. The Rise of AI-First Game Studios
A new breed of game studios is emerging, built from the ground up around AI-centric workflows. These studios are reimagining the entire development process, from initial concept to final playtesting. Advanced features previously requiring significant resources - such as persistent NPC memory systems, dynamic narrative generation, and real-time content adaptation - are becoming standard offerings thanks to improved consumer hardware capabilities.
4. AI Revolutionizes Esports
The competitive gaming landscape is set for transformation as AI tools become integral to professional player development. Advanced AI systems will fundamentally change how teams and players approach training, strategy development, and performance analysis.
Platforms like iTero are leading this movement, demonstrating the power of AI-driven coaching in League of Legends. These systems provide an unprecedented depth of personal performance analysis by analyzing over a billion data points through sophisticated machine-learning algorithms. Unlike traditional statistics that rely on general averages, AI coaches can process hundreds of unique stats per match, offering personalized insights and specific improvement recommendations that can significantly boost win rates.
Teams across the industry are increasingly leveraging AI for automated testing, asset optimization, and localization. Early adopters report incredible improvements in efficiency, with compressed development timelines and streamlined team structures. While adoption rates will vary between major publishers and independent studios, integrating AI tools into core development processes appears inevitable.
Success in 2025 will hinge on finding the right balance between innovation and practical implementation across all these fronts - from local AI processing and game engine integration to AI-first development and competitive gaming analysis. The winners will be those who can harness AI's potential to enhance development efficiency and game quality while maintaining the creative vision that drives memorable gaming experiences. As these technologies mature, they promise to transform not just how games are made but also how they're played and experienced by everyone, from casual players to professional competitors.
Video game industry will be 'one of the greatest beneficiaries of AI,' 60% Of Development Processes Could Be ‘Positively Impacted’ By AI
Andrew Wilson, EA CEO
Disclaimers:
This is not an offering. This is not financial advice. Always do your own research. This is not a recommendation to invest in any asset or security.
Past performance is not a guarantee of future performance. Investing in digital assets is risky and you have the potential to lose all of your investment.
Our discussion may include predictions, estimates or other information that might be considered forward-looking. While these forward-looking statements represent our current judgment on what the future holds, they are subject to risks and uncertainties that could cause actual results to differ materially. You are cautioned not to place undue reliance on these forward-looking statements, which reflect our opinions only as of the date of this presentation. Please keep in mind that we are not obligating ourselves to revise or publicly release the results of any revision to these forward-looking statements in light of new information or future events.