Large Dataset processing with Spring Data JPA Stream | Advanced Java

preview_player
Показать описание
In this video, I am demonstrating, processing of a large dataset that contains over 42+ million rows and 18GB in size. The dataset contains the records of Parking Violation tickets issued in NYC in the time period around 2013 ~ 2017.

Video Topics
1. Demonstration
2. Downloading Dataset ( 01:15 )
3. Populating data to DB ( 02:50 )
4. Creating spring-boot project with Spring Data ( 03:24 )
5. Processing data ( 06:25 )
6. Final demonstration ( 09:56 )

If you are interested in the code, please download project files from:

  1. UPPERCASE • DEV
  2. stramapi
  3. java
  4. java-command-line
  5. large-dataset
Рекомендации по теме
Large Dataset processing 0:12:21

Large Dataset processing with Spring Data JPA Stream | Advanced Java

IQ | Spring 0:48:36

IQ | Spring Batch for Beginners | Process Million of Record Faster Using Spring Batch | JavaTechie

Spring Batch | 0:24:37

Spring Batch | read records from Database and process

Read millions of 0:09:44

Read millions of records from database using Java/Jdbc

Spring Batch - 0:25:46

Spring Batch - Database to CSV File

Parameter Setting for 0:02:37

Parameter Setting for Large Dataset

What is Database 0:09:05

What is Database Sharding?

Configuration Driven Reporting 0:26:34

Configuration Driven Reporting On Large Dataset Using Apache Spark

Mastering JWT Token 0:58:44

Mastering JWT Token Integration in Spring Security 6 and Spring Boot 3

Load CSV to 0:37:02

Load CSV to Database Using Spring Batch | Spring Batch in Spring Boot 3 | kbtutorials

Spring Data JPA 0:06:19

Spring Data JPA - saveAll() Method - Save Multiple Entities to the Database Table

7. Spring boot 0:07:15

7. Spring boot for Beginners - Data Access Layer MySql Database Connection

How do software 0:07:06

How do software projects achieve zero downtime database migrations?

What is Data 0:10:34

What is Data Pipeline | How to design Data Pipeline ? - ETL vs Data pipeline (2024)

71.Spring Boot-Initialize a 0:12:44

71.Spring Boot-Initialize a Spring Batch database

H2 In-Memory Database 0:42:22

H2 In-Memory Database with Spring(Complete Tutorial 2019)

Spring Boot Tutorial 1:02:02

Spring Boot Tutorial | Spring Data JPA | 2021

How do SQL 0:12:12

How do SQL Indexes Work

Batch Processing vs 0:13:37

Batch Processing vs Stream Processing | System Design Primer | Tech Primers

Spring Batch - 0:19:43

Spring Batch - Database To XML File Step By Step

Spring Batch processing 0:29:20

Spring Batch processing Example | CSV to DataBase write SpringBoot Batch Application #2

Spring Batch in 0:41:31

Spring Batch in Spring Boot | CSV to Database | Tech Primers

Spring Boot | 0:23:25

Spring Boot | Spring Data Redis | Database | CRUD Example | JavaTechie

Troubleshooting Spring H2 0:12:02

Troubleshooting Spring H2 Database Hanging

Комментарии
Автор

Informative, thanks a lot. Please do more videos on advance JPA

cryptochamp
Автор

This is informative .thanks alot .please more on advance jpa

rockdynamics
Автор

Interesting, encourage you to add voice

osaidsayyid
Автор

Very helpful video, Can you suggest if this can be use for non-Read only data (stream and update data). Thanks

yeshwanthreddykota
Автор

This is nice but can you show us how to do something similar with WHERE clause to select records. Let's say selecting records based on date range and stream them.

pshar