Solving large scale operational metadata problems using stream processing - R.I. Pienaar

preview_player
Показать описание

Solving large scale operational metadata problems using stream processing by: R.I. Pienaar.

Areas covered:

basic streaming overview
design of the global network
design of a replication tool particular to the needs
building hierarchical cached views of the estate
exposing data to other systems with examples
using stream processing methodologies to perform real time analysis and remediation of the fleet

Configuration Management Camp is the event for technologists interested Open Source Infrastructure automation and related topics This includes but is not limited to top Open Source Configuration Management , Provisioning, Orchestration, Choreography, Container Operations and many more topics.

Broadcasted and recorded at location: HoGent - Campus SchoonMeersen
  1. CityTV.nl
  2. R.I. Pienaar
  3. metadata problems
  4. using stream processing
  5. Solving large scale operational metadata problems
Рекомендации по теме
Solving large scale 0:40:52

Solving large scale operational metadata problems using stream processing - R.I. Pienaar

FAST '22 - 0:15:13

FAST '22 - InfiniFS: An Efficient Metadata Service for Large-Scale Distributed Filesystems

SDC2021: CMU and 0:25:24

SDC2021: CMU and Los Alamos's Efforts in Building Large-Scale Filesystem Metadata

AWS re:Invent 2022 0:57:55

AWS re:Invent 2022 - Solving large-scale data access challenges with Amazon S3 (STG328)

Edgestore - Data@Scale 0:30:07

Edgestore - Data@Scale

Alejandro Saucedo - 0:29:27

Alejandro Saucedo - Metadata Systems for End-to-End Data & Machine Learning | PyData Global 2022

MetaOps: Metadata Operations 0:37:00

MetaOps: Metadata Operations For End-To-End Data & Machine Learning Platforms - Alejandro Sauced...

2020-01-10 - Tonglin 0:36:28

2020-01-10 - Tonglin Li - Independent metadata updating for large scale parallel I/O systems

AWS re:Invent 2022 0:58:35

AWS re:Invent 2022 - How Discovery increased operational efficiency with AWS observability (COP201)

Python Doesn’t Have 0:31:21

Python Doesn’t Have to Be Slow: Speeding Up a Large-Scale Optimization Algorithm - Dat Nguyen

Dr. Thomas Wollmann: 0:40:39

Dr. Thomas Wollmann: Squirrel - Efficient Data Loading for Large-Scale Deep Learning

Practical Data Governance 0:37:03

Practical Data Governance in a Large Scale Databricks Environment

#bbuzz: Nishith Agarwal 0:53:47

#bbuzz: Nishith Agarwal - Building large scale, transactional data lakes using Apache Hudi

Big Data In 0:05:12

Big Data In 5 Minutes | What Is Big Data?| Big Data Analytics | Big Data Tutorial | Simplilearn

Building a Large-scale 0:49:54

Building a Large-scale Transactional Data Lake Using Apache Hudi

When metadata becomes 0:48:14

When metadata becomes data

'The Evolution of 0:37:29

'The Evolution of a Planetary-scale Distributed Database' by Kevin Scaldeferri (Strange Lo...

Scaling Beyond a 0:53:51

Scaling Beyond a Billion Transactions Per Day with Sub-Second Responses

Dataflow: A Unified 0:49:36

Dataflow: A Unified Model for Batch and Streaming Data Processing

Data Movement at 0:49:02

Data Movement at Very Large Scale | QCon SF 2013

How Do You 0:01:01

How Do You Bring Operational Metadata from Airflow & dbt into Atlan?

Implementing linearizability at 0:28:28

Implementing linearizability at large scale and low latency

Large scale automation 0:41:26

Large scale automation for lazy engineers

Patterns and Operational 0:41:43

Patterns and Operational Insights from the First Users of Delta Lake