Introducing NVIDIA Jarvis - Multimodal AI SDK

    Introducing NVIDIA Jarvis - Multimodal AI SDK

    Introducing NVIDIA Jarvis - Multimodal AI SDK

    Combining Speech, Vision and Other Sensors into One AI Platform

    Posted: 22 Oct 2019



    At Mobile World Congress Los Angeles, NVIDIA Co-founder and CEO Jensen Huang announced in his keynote NVIDIA Jarvis an SDK for building and deploying AI applications that fuse vision, speech, and other sensors into one system.

    Introducing NVIDIA Jarvis Multimodal AI SDK

    NVIDIA Jarvis offers a comprehensive workflow to build, train and deploy AI systems that uses speech and visual cues such as gestures and gaze in context. For example, lip movement can be fused with speech input to identify the active speaker. Gaze can be used to understand if the speaker is engaging the AI agent or other people in the scene. This enables simultaneous multi-user, multi-context conversations with the AI system that need a deeper understanding of the context.

    The new SDK provides several base modules for speech tasks such as such as intent and entity classification, sentiment analysis, dialog modeling, domain and fulfillment mapping.



    For vision, modules include person detection and tracking, detection of key body landmarks and body pose, gestures, lip activity and gaze.

    With Jarvis, you can also use custom modules or fine-tune to adapt for your use case.

    For edge and IoT use cases, Jarvis runs on the NVIDIA EGX stack, which is compatible with all commercially available Kubernetes infrastructure.

    Availability

    Apply now for early access to learn more about the SDK and early availability here.



    Source: Announcing NVIDIA Jarvis, Combining Speech, Vision and Other Sensors into One AI Platform - NVIDIA Developer News CenterNVIDIA Developer News Center

    Brink's Avatar Posted By: Brink
    22 Oct 2019


 

  Related Discussions
Our Sites
Site Links
About Us
Windows 10 Forums is an independent web site and has not been authorized, sponsored, or otherwise approved by Microsoft Corporation. "Windows 10" and related materials are trademarks of Microsoft Corp.

Designer Media Ltd
All times are GMT -5. The time now is 01:47.
Find Us




Windows 10 Forums