The Multi-Cloud Expedition Episode 10: AI Ready Infrastructure

In this tenth episode of the Multi-Cloud Expedition, join host Alexander Romero, Senior Director of Cross-Cloud Services at VMware, as he leads a discussion around VMware Private AI and our partnership with NVIDIA enabling IT teams to embrace generative AI with privacy, choice, cost management, performance, and compliance.

Since generative AI is an emerging technology, lack of standardization, new emerging software providers, automation, and IT skills plus privacy concerns are slowing time to value for AI infrastructure. This creates a bottleneck that slows the deployment of AI workloads and makes it difficult to manage and optimize the resources allocated to them. To help tackle these challenges, VMware announced the launch of VMware Private AI. This architectural approach for AI services balances the business gains from AI with the privacy and compliance needs of enterprises.

VMware and NVIDIA also announced our plans to collaborate to develop a fully integrated Generative AI platform called VMware Private AI Foundation with NVIDIA. This platform will enable enterprises to fine-tune LLM models and run inference workloads in their data centers, addressing privacy, choice, cost, performance, and compliance concerns.

Chapter Segments:
2:09 – Overview of this episode: VMware's Take on AI Ready Infrastructure.
4:46 – Evolution of AI going from Predictive to Generative AI. Example ChatGPT.
7:14 – Industry drivers as the catalyst for exponential interest in Generative AI - finding cancer faster or personalizing shopping experiences.
10:36 – AI and the use of GPUs is not new. VMware and NVIDIA innovation history.
14:07 – How do enterprises use HuggingFace and OpenAI model? And how NVIDIA solutions fit in the industry.
17:23 – Keeping enterprise data secure and private for regulations and competitive advantage.
20:48 – Challenges of Generative AI today, mainly privacy. Avoid intellectual property breeches while seeing benefits of LLM and AI.
26:04 – Avoiding lock in – customers want choice in AI journey like they have with multi-cloud with performance and compliance while managing costs.
25:44 – VMware Private AI Foundation with NVIDIA announced at VMware Explore Las Vegas (avail early 2024). Generative AI easy button.
40:29 – Customer example: Helping build a Generative AI model for a large format retailer.
43:16 – Demo: NVIDIA and VMware Generative AI Integration into Enterprise Clouds.
46:57 – Demo: How allocating GPUs within vSphere looks for VI Admins.
48:45 – Q&A: What other eco system partners does VMware work with beyond NVIDIA?
51:22 – Q&A: Customer examples making progress today with AI.
55:48 – Wrap up and topic review including key links to learn more around VMware AI solutions: