Lessons From A Year Building With LLMs

preview_player
Показать описание
Special double-feature closing keynote from the 6 authors of the hit O'Reilly article on Applied LLMs.

About Eugene Yan
I build ML systems to serve customers at scale, and write to learn and teach.

About Shreya Shankar
I'm Shreya Shankar. I am a machine learning (ML) engineer and computer scientist in the Bay Area.
I am completing my PhD in data management systems for ML, with a human-centered focus. I am fortunate to be advised by Dr. Aditya Parameswaran at UC Berkeley. Go Bears! 🐻
I also consult on ML engineering and production AI strategy for enterprises. Prior to my PhD, I was the first ML engineer at a startup, did research engineering at Google Brain, and engineering at Facebook. Before all of that, I did my BS and MS in computer science at Stanford. Go Trees! 🌲

About Hamel Husain
Hamel Husain started working with language models five years ago when he led the team that created CodeSearchNet, a precursor to GitHub CoPilot. Since then, he has seen many successful and unsuccessful approaches to building LLM products. Hamel is also an active open source maintainer and contributor of a wide range of ML/AI projects. Hamel is currently an independent consultant.

About Jason Liu
Jason is an independent AI consultant, advisor, writer, and educator. His main interests are structured outputs, search and retrieval for RAG as well as understanding how to leverage AI to build scalable and valuable businesses.

About Bryan Bischof
Bryan Bischof is the Head of AI at Hex, where he leads the team of engineers building Magic—the data science and analytics copilot. Bryan has worked all over the data stack leading teams in analytics, machine learning engineering, data platform engineering, and AI engineering. He started the data team at Blue Bottle Coffee, led several projects at Stitch Fix, and built the data teams at Weights and Biases. Bryan previously co-authored the book Building Production Recommendation Systems with O’Reilly, and teaches Data Science and Analytics in the graduate school at Rutgers. His Ph.D. is in pure mathematics.

About Charles Frye
AI Engineer at Modal Labs. Building useful technology with large neural networks.

00:00 Introduction
03:22 Strategic: Bryan Bischof & Charles Frye
14:47 Operational: Hamel Husain & Jason Liu
23:51 Tactical: Eugene Yan & Shreya Shankar
Рекомендации по теме
Комментарии
Автор

you had me until transition to typescript

winddude
Автор

Is it just me or anyone felt 35 min was eternity. Even though there was structure (strategy, operational and tactical), it was poorly presented, presenters felt entitled and opinionated. For example, not sure who thinks models are moat. I think it's minority. I could hardly take any takeaways apart from something that could've been covered in 5 min.

Ship products
Hire right talent
Evals are must

explorer
Автор

Can't help but think of them as the LLM Mafia (I think coined by @chiphuyen)

HerroEverynyan