kafka connect api

preview_player
Показать описание
Kafka Connect API using a local file as a source and an existing 'MySecondTopic' topic to stream this data to.

Any changes in the file are committed to the topic (*MySecondTopic")

change these:
file=text2
topic=MySecondTopic

and create a file called 'text2' in the kafka directory
and enter some text and save (use nano or similar)
Then execute the following

Now check using a console consumer as before and the file contents should be added:

Next we look at using Postman to play with the REST API starting with:
Change IP address to match your server. No authentication needed for this demo.
  1. Mon Goose
  2. kafka
  3. connect api
  4. connect-file-source.properties
  5. rest api
  6. 8083
Рекомендации по теме
Kafka Connect’s REST 0:05:07

Kafka Connect’s REST API | Kafka Connect 101 (2023)

kafka connect api 0:11:16

kafka connect api

Apache Kafka 101: 0:08:17

Apache Kafka 101: Kafka Connect (2023)

Exploring the Kafka 0:20:56

Exploring the Kafka Connect REST API

What are Kafka 0:02:27

What are Kafka Extended APIs? Kafka Connect, Kafka Streams, ksqlDB and Schema Registry introduction

Connectors, Configuration, Converters, 0:08:28

Connectors, Configuration, Converters, and Transforms | Kafka Connect 101 (2023)

Learn Apache Kafka 0:11:54

Learn Apache Kafka and Kafka Connect in 10 Minutes || Apache Kafka and Kafka Connect for Beginners

Difference Between Kafka 0:12:04

Difference Between Kafka APIs - Stream,Connector,Producer,Consumer APIs - Kafka Interview Questions

Introduction to Kafka 0:10:09

Introduction to Kafka Connect | Kafka Connect 101 (2023)

Berlin Buzzwords 2019: 0:41:31

Berlin Buzzwords 2019: Robin Moffatt – From zero to hero with Apache Kafka's connect API #bbuzz...

Data Pipelines: Integrate 0:05:06

Data Pipelines: Integrate Kafka with External Systems

Introduction to Kafka 0:17:28

Introduction to Kafka Connect

Monitoring Kafka Connect 0:05:38

Monitoring Kafka Connect | Kafka Connect 101 (2023)

Data Pipelines: Create 0:03:12

Data Pipelines: Create a Data Generator with Kafka Connect (Hands On)

What is Kafka 0:04:44

What is Kafka Connect?

Apache Kafka in 0:06:48

Apache Kafka in 6 minutes

Kafka in 100 0:02:35

Kafka in 100 Seconds

From Zero to 0:33:59

From Zero to Hero with Kafka Connect

Apache Kafka 101: 0:08:20

Apache Kafka 101: Kafka Streams (2023)

Kafka Connect Tutorial 0:15:21

Kafka Connect Tutorial For Beginners | Zero to Hero

What is Kafka 0:05:37

What is Kafka Connect and how does it work ?

Using Kafka for 0:10:45

Using Kafka for REST API Inputs | Kafka REST | Kafka with React Apps

KsqlDB + Kafka 0:26:29

KsqlDB + Kafka Connect: Move data IN/OUT of Kafka with just SQL! Tutorial with MySQL and REDIS

Simple REST API 0:03:57

Simple REST API Golang MongoDB And Connect to Confluent Kafka (Create Read Delete)

Комментарии
Автор

Very helpful contents - thanks for sharing

soumyamukherjee
Автор

I have a general question regarding Kafka-Connect. I went through documentation, blogs but couldn't find a straight answer.
If there are two workers, running single Connector(instance) then
How does a Connector(instance) decide when to spawn a new task, if eg. tasks.max = 10? Also, how does a Connector(instance) decide how many tasks to spawn, if eg. tasks.max = 10?
Does it depend upon underlying hardware configuration? eg. number of cores or memory or cpu utilization?

My kafka-connector is always creating only one task even though my tasks.max=10

hamidjawaid
Автор

Hi
How can I update kafka connect config properties via api

manojsadhu