Lessons from Building a Large-scale, Multi-cloud Data Platform at Databricks | Jeff Pang

preview_player
Показать описание
The cloud is becoming one of the most attractive ways for enterprises to store, analyze, and get value from their data, but building and operating a data platform in the cloud has a number of new challenges compared to traditional on-premises data systems. I will explain some of these challenges based on my experience at Databricks, a startup that provides a data analytics platform as a service on AWS, Azure, and Google Cloud. Databricks manages millions of VMs per day to run data engineering and machine learning workloads using Apache Spark, TensorFlow, Python and other software for thousands of customers.
  1. @Scale
Рекомендации по теме
How to Learn 0:02:10

How to Learn Large Scale System Design for FREE

5 Lessons from 0:41:13

5 Lessons from 5 Years of Building Databases at Scale by Sammy Steele

How to scale 0:00:57

How to scale a web application to a million users in 10 steps

Large-Scale Deep Learning 0:59:40

Large-Scale Deep Learning for Building Intelligent Computer Systems

Evolving an Actor 1:00:37

Evolving an Actor Library Based on Lessons Learned from Large-Scale Deployments - Benjamin Hindman

ITA 2016 - 1:01:37

ITA 2016 - Jeff Dean Large-Scale Deep Learning for Building Intelligent Computer Systems

Biggest Difference Between 0:05:52

Biggest Difference Between Bad Art and Great Art by UCLA Professor Richard Walter

Large Scale Machine 0:36:10

Large Scale Machine Learning

Learn Live: Containerizing 1:02:32

Learn Live: Containerizing and Deploying AI Workloads on AKS

Large Scale Deep 0:23:10

Large Scale Deep Learning with TensorFlow

'Large-Scale Deep Learning 1:05:09

'Large-Scale Deep Learning with TensorFlow,' Jeff Dean

Andrew Ng - 0:39:44

Andrew Ng - Machine Learning via Large-scale Brain Simulations - Technion lecture

How Toyota Changed 0:04:52

How Toyota Changed The Way We Make Things

Building a Multi-Million 0:26:30

Building a Multi-Million Dollar Construction Business | The Ultimate Guide for Contractors

Robust Foundation for 0:38:18

Robust Foundation for Data Pipelines at Scale - Lessons from Netflix

Brian Mann - 0:46:29

Brian Mann - The tools and patterns for building large-scale Backbone applications

Industrial-scale Web Scraping 0:06:17

Industrial-scale Web Scraping with AI & Proxy Networks

The single biggest 0:06:41

The single biggest reason why start-ups succeed | Bill Gross | TED

Big Data In 0:05:12

Big Data In 5 Minutes | What Is Big Data?| Big Data Analytics | Big Data Tutorial | Simplilearn

Webinar: Effective Large-Scale 1:01:19

Webinar: Effective Large-Scale Learning

How China LEARN 0:09:55

How China LEARN to Build High-Speed Rail (and Get REALLY Good at it)

How do large 0:07:47

How do large teams scale their Frontend applications?

Leaven: Machine Learning 0:06:48

Leaven: Machine Learning at Massive Scale to Protect Human Life

Can we create 0:07:10

Can we create the 'perfect' farm? - Brent Loken