Production AI at Scale: Cloudera’s Journey in Building a Robust Inference Pl... Z. Thanga, P. Ableda

Production AI at Scale: Cloudera’s Journey in Building a Robust Inference Platform - Zoram Thanga & Peter Ableda, Cloudera

In this session, we talk about Cloudera AI Inference Service, a secure, large scale platform for generative AI and predictive inference workloads, built using state of the art Kubernetes, CNCF and Apache open source projects. We take the audience through our journey in building this platform and share the experiences we gained along the way. The platform is built using openness, security, scalability, performance and standards compliance as guiding principles. We demonstrate that it is possible to be open and secure at the same time, and that organizations can incorporate production grade AI inferencing into their Big Data environments. This session will cover the architecture of the platform, and explain how we handle performance, scaling, authentication, fine grained authorization and audit logging, all of which are critical considerations for production inferencing.

[tlanisailo]

Zorama i chhuanawm hle mai, i naupan laia ka hmuh bak che ka hmu leh lo a tunah ka hmuh dan che chu ava lawmawm em aw ❤

[dawngalala]

I chhuanawm a, i topic pawh tunlai kan hriat chian chak em em a ni a, a bengbarthlak e

[b.lallianpuiib.lallianpuii]

Kan inthlau ta hle mai...Zorama..kei aiin i thiam thei lutuk biklo kha a nia..😂