Spring Cloud Data Flow | Microservice Stream Processing |JavaTechie

This tutorial will guide you to understand how to perform Stream Processing in Microservice Architecture using Spring Cloud data Flow

Spring Cloud Data Flow is a toolkit to build Microservice based Streaming and Batch data processing pipelines and data pipelines consist of Spring Boot apps, built using the Spring Cloud Stream or Spring Cloud Task microservice frameworks

#javatechie #SpringBoot #SPringCloud #DataFlow

GitHub:

Blogs:

Facebook:

guys if you like this video please do subscribe now and press the bell icon to not miss any update from Java Techie

Disclaimer/Policy:
--------------------------------
Note : All uploaded content in this channel is mine and its not copied from any community , you are free to use source code from above mentioned GitHub account

[desi]

Very good one. Very crisp. The restart of the data flow server should not have been done

[deepakr.l.]

nice one !!!! thanks a tonne for this .. !!!

[oviyan]

Nice stuff!
I followed your instruction, once registered app using "add register" command, i can see the app in dashboard. However, it failed with ArtifcatNotFound exception. So i have couple of questions
1. Should we keep app JAR in the same location where cloud-data-flow JAR?
2. How do we form Maven URI for our JARs?

[doantruong]

Hi fiend, Techie. Thank you for sharing knowledges. Watched this video I don't see you mention to how to Spring cloud dataflow binding with a Message Broker (in here you are using Apache Kafka). If possible please explain this point.

[qwertasdfg]

Q. Here we are not mentioning any topic name in any of the properties file how it is able to communicate without topic name and if we want to mention perticular topic name how can we do that? can you please answer this ❤?

Thank you sir.
for viseos like this ❤❤

[shaktidarankr]

In case of REST API how response is received after processing all the individual MS. Since data flow is an one way communication.

[raghuvardhansaripalli]

Hi Basant, If you have any idea on CDC (Change Data Capture), can you create a simple video for data migration in real time by using spring boot, kafka, kafka connect and debezium with a simple my-sql data base. There is no proper example given in GOOGLE with this approach. Hence i recollected your name and thought you are the right person to make this video. I have full confidence on you that you can make it. God bless you Basant. I know this is not easy.. This is the important question coming in all interviews ..

[grrlgd]

so, if I want to change the Book dto to add a new field, I need to change in all three services. isnt this kind of coupling I should avoid ? great presentation. thanks

[aniketchavan]

Thank u so much, please upload more video with real time project

[vijayredkar]

Thanks for this detailed explanation. I did not understand the real purpose of the Cloud Data Flow server.
Without this server, if I start the 3 microservices individually then also the product stream created by the 1st would be consumed by the 2nd microservice because it is subscribed to that topic.
Same way, the discount stream from the 2nd would be consumed by the 3rd microservice.
So, what is the real use of this Cloud Data Server. Could you please elaborate?

[shirish]

in this example where you have specified KAFKA server details ?

[MaheshKumar-gttd]

Its an awesome tutorial, very nice explanation. how do we implement microservice data orchestration based / choreography based saga design pattern. can you please throw some light will be highly appreciated. Thanks in advance

[javasoccernut]

good stuff!
use lombok for the logger :)

[daniellaerachannel]

excellent, more video please, create a social developer network project with the stack, Spring, JPA, postgres, docker etc thanks a lot

[shanmukhaPonnada]

Hi, I would like to say thanks for your video, this is very clear & helpful to me.

Is this flow olap supported, and fast enough to handle million records? Please advise.

[vishnumurali]

Hi

It is great and working nice..

But how can we configure different Topic names

I tried in Source it is throwing error..

Do you know how to handle this ?

[msraju]

Thanks sir. So this is for one-way communication right???

[YashvardhanJoshi]

Thanks Sir, Can it be like source to source and then processor. Or source to processor and one more processor?

[ArunKumar-kleb]

Good Work. Can we have multiple Transformers?

[srdpt]

I am getting am error when I start spring cloud server