filmov
tv
GCP for Apache Kafka Users: Stream Ingestion and Processing (Cloud Next '19)
Показать описание
In private and public clouds, stream analytics commonly means stateless processing systems organized around Apache Kafka or a similar distributed log service. GCP took a somewhat different tack, with Cloud Pub/Sub, Dataflow, and BigQuery, distributing the responsibility for processing among ingestion, processing and database technologies.
We compare the two approaches to data integration and show how Dataflow allows you to join and transform and deliver data streams among on-prem and cloud Kafka clusters, Cloud Pub/Sub topics and a variety of databases. The session will have a mix of architectural discussions and practical code reviews of Dataflow-based pipelines.
Watch more:
Speaker(s): Ricardo Ferreira, Karthi Thyagarajan
Session ID: DA305
event: Google Cloud Next 2019; re_ty: Publish; product: Cloud - Data Analytics - BigQuery; fullname: Ricardo Ferreira, Karthi Thyagarajan;
We compare the two approaches to data integration and show how Dataflow allows you to join and transform and deliver data streams among on-prem and cloud Kafka clusters, Cloud Pub/Sub topics and a variety of databases. The session will have a mix of architectural discussions and practical code reviews of Dataflow-based pipelines.
Watch more:
Speaker(s): Ricardo Ferreira, Karthi Thyagarajan
Session ID: DA305
event: Google Cloud Next 2019; re_ty: Publish; product: Cloud - Data Analytics - BigQuery; fullname: Ricardo Ferreira, Karthi Thyagarajan;
GCP for Apache Kafka Users: Stream Ingestion and Processing (Cloud Next '19)
Kafka in 100 Seconds
Creating a Streaming Data Pipeline With Apache Kafka #arcade #gcp #googlecloudplatform #qwiklabs
Cloud OnAir: CE TV: First Steps with Apache Kafka on Google Cloud Platform
Apache Kafka Ecosystem “As-a-Service” on GCP with Confluent Cloud (Cloud Next '18)
GCP Kafka Example of writing to GCS from Kafka Part 1
Apache Kafka - Installing Kafka in Cloud
Install Kafka on Google Cloud
Apache Kafka in 6 minutes
Building a hybrid data pipeline using Kafka and Confluent
Configuring Zookeeper Ensemble and Kafka Cluster on GCP VM Instance 22
Installing Zookeeper and Kafka on GCP VM Instance Standalone 18
Set your data in motion: Data streaming with Confluent and Google Cloud
GCP Kafka Example Read from GCS to Kafka Part 2
#14 Kafka Live Stream | Backup & Restore Kafka Topics to Google Cloud Storage (GCS)
Practical streaming at scale with Spark on GCP and Confluent Kafka
Confluent and Kafka with Viktor Gamov: GCPPodcast Episode 155
Confluent: Running Apache Kafka on GKE
ETL Pipeline with Confluent Kafka and MapboxGL for Geospatial Realtime Visualization on Google Cloud
Learn Data Streaming on Confluent with Apache Kafka for Beginners
PDE-4 Quick, GCP Professional Data Engineer - Dataflow, streaming, Kafka, Pub/Sub, Session, Windows
Streaming IoT Kafka to PubSub - GoogleCloud
From Kafka to BigQuery – Ofir Sharony, Kafka Summit London 2018
HOW TO INSTALL APACHE KAFKA IN GOOGLE CLOUD
Комментарии