Introducing NVIDIA ACE For Games NPCs with Generative AI

    Introducing NVIDIA ACE For Games NPCs with Generative AI

    Introducing NVIDIA ACE For Games NPCs with Generative AI


    Posted: 29 May 2023

    Imagine a game in which you could have intelligent, unscripted and dynamic conversations with non-playable characters (NPCs) with persistent personalities that evolve over time and accurate facial animations and expressions, all in your native tongue.

    Generative AI technologies are making this a reality, and at COMPUTEX 2023 we announced the future of NPCs with the NVIDIA Avatar Cloud Engine (ACE) for Games. NVIDIA ACE for Games is a custom AI model foundry service that aims to transform games by bringing intelligence to non-playable characters (NPCs) through AI-powered natural language interactions.

    “Generative AI has the potential to revolutionize the interactivity players can have with game characters and dramatically increase immersion in games,” said John Spitzer, vice president of developer and performance technology at NVIDIA. “Building on our expertise in AI and decades of experience working with game developers, NVIDIA is spearheading the use of generative AI in games.”

    NVIDIA ACE For Games’ AI Foundation Models

    Developers of middleware, tools and games can use NVIDIA ACE for Games to build and deploy customized speech, conversation, and animation AI models in their software and games across the cloud and PC.

    Optimized AI foundation models include:

    • NVIDIA NeMo, which provides foundation language models and model customization tools so developers can further tune the models for game characters. This customizable large language model (LLM) enables specific character backstories and personalities that fit a developer’s game world. Developers can better align player interactions within the context of a scene through programmable rules for NPCs with NeMo Guardrails.
    • NVIDIA Riva, which provides automatic speech recognition (ASR) and text-to-speech (TTS) capabilities to enable live speech conversation with NVIDIA NeMo.
    • NVIDIA Omniverse Audio2Face, which instantly creates expressive facial animation for game characters from just an audio source. Audio2Face features Omniverse connectors for Unreal Engine 5, so developers can add facial animation directly to MetaHuman characters.

    How NVIDIA ACE For Games Works

    To showcase the power of NVIDIA ACE for Games, and preview how developers will build NPCs in the near future, we partnered with Convai, an NVIDIA Inception startup building a platform for creating and deploying AI characters in games and virtual worlds, to help optimize and integrate ACE modules into their platform.

    Take a first look in the NVIDIA Kairos demo:



    “With NVIDIA ACE for Games, Convai’s tools can achieve the latency and quality needed to make AI non-playable characters available to nearly every developer in a cost efficient way,” said Purnendu Mukherjee, founder and CEO at Convai.

    The Kairos demo leveraged NVIDIA Riva for speech-to-text and text-to-speech capabilities, NVIDIA NeMo to power the conversational AI, and Audio2Face for AI-powered facial animation from voice inputs. These modules were integrated seamlessly into the Convai services platform and fed into Unreal Engine 5 and MetaHuman to bring Jin to life.

    Jin and his Ramen Shop scene were created by the NVIDIA Lightspeed Studios art team and rendered entirely in Unreal Engine 5, using NVIDIA RTX Direct Illumination (RTXDI) for ray traced lighting and shadows, and DLSS for the highest possible frame rates and image quality.













    This real-time demonstration reveals what is possible using GeForce RTX graphics cards, NVIDIA RTX technologies, and NVIDIA ACE for Games. And exemplifies the possibilities for upcoming games that leverage this game-changing technology.

    NVIDIA ACE: Bringing Life To NPCs

    Game developers and startups are already using NVIDIA generative AI technologies. For instance, GSC Game World is using Audio2Face in the much-anticipated S.T.A.L.K.E.R. 2 Heart of Chornobyl. And indie developer Fallen Leaf is using Audio2Face for character facial animation in Fort Solis, their third-person sci-fi thriller set on Mars. Additionally, Charisma.ai, a company enabling virtual characters through AI, is leveraging Audio2Face to power the animation in their conversation engine.

    If you’d like additional information about the generative AI technologies, head over to our NVIDIA Developer blog. Subscribe to learn more about NVIDIA ACE for Games, future developments, and early access programs. And discover more uses of NVIDIA RTX technology and GeForce RTX GPUs in the latest games by heading to GeForce.com.

    Source: https://www.nvidia.com/en-us/geforce...ative-ai-npcs/
    Brink's Avatar Posted By: Brink
    29 May 2023


  1. Posts : 282
    Windows 10 Pro
       #1

    Imagine a game in which you could have intelligent, unscripted and dynamic conversations with non-playable characters (NPCs) with persistent personalities that evolve over time and accurate facial animations and expressions, all in your native tongue.

    Honey, come here and read this. Perhaps we can now fire that marriage counselor...


    The future's so bright I gotta wear shades...

    Edit-


      My Computer


  2. Posts : 1,338
    Windows 10
       #2

    yeah i mean the foretelling the future cannot make this shit up. "The early 21st century we marveled to the creation of AI"

    By 2101 we will be inside that AI and the desert of the real will be a real world situation because everyone left to go inside the computer because its 100 times more saturated experience filled with all sorts of dopamine filled facades.

    it even sounds scary thinking of 2101 with 101 being binary for the very mediums we are talking on now. The artificial binary intelligence that is wanting to copy the real world creation.

    Maybe god is real.
      My Computer


  3. Posts : 282
    Windows 10 Pro
       #3

    I think with AI and quantum computing things like engineering or medical science will make HUGE leaps and because of that mankind will go places and do things we can't even imagine today. Well, that is if we're all still here...
      My Computer


 

  Related Discussions
Our Sites
Site Links
About Us
Windows 10 Forums is an independent web site and has not been authorized, sponsored, or otherwise approved by Microsoft Corporation. "Windows 10" and related materials are trademarks of Microsoft Corp.

© Designer Media Ltd
All times are GMT -5. The time now is 18:08.
Find Us




Windows 10 Forums