SQL Server 2019 querying 1 trillion rows in 100 seconds

preview_player
Показать описание
We recently performed a performance test on a SQL Server 2019 instance running on a Windows Server 2016 running on an 8-Socket (224 cores, 12TB RAM and 200TB+ SSD storage) Lenovo Server (ThinkSystem SR950) using Intel Cascade Lake processors. We generated data and loaded a single table (LINEITEM, TPCH database schema with 145TB+ raw data). This table had 54TB compressed data with 1 Trillion+ rows. Q1 query (as defined by TPCH) which scans the whole table and selects nearly all the rows for computation was run in both cold (all data read from storage) and warm (data in memory) scenario. SQL Server 2019 was able to provide unparalleled performance processing over a trillion rows with the query completing in under 2 mins (107 secs) in warm cache and under 4 mins (238 secs) with all data read from storage. For the warm cache, this translates to processing over 6 billion rows/sec and read throughput of around 50GB/sec. You can find the Azure Data Studio Notebooks that showcase both scenarios on GitHub.
  1. SQL Server Team
  2. SQL Server
  3. SQL Server 2019
  4. Datawarehousing
  5. One Trillion Rows
Рекомендации по теме
SQL Server 2019 0:00:57

SQL Server 2019 querying 1 trillion rows in 100 seconds

Writing your first 0:04:13

Writing your first SQL queries in SQL Server

SQL Tutorial - 4:20:39

SQL Tutorial - Full Database Course for Beginners

Secret To Optimizing 0:05:57

Secret To Optimizing SQL Queries - Understand The SQL Execution Order

SQL Tutorial for 3:10:19

SQL Tutorial for Beginners [Full Course]

SQL Tutorial for 0:44:57

SQL Tutorial for Beginners

SQL Server Performance 4:03:27

SQL Server Performance Essentials – Full Course

Finding expensive queries 0:13:36

Finding expensive queries in SQL Server and performance optimization part 1

MSSQL Server Installation 0:12:01

MSSQL Server Installation on Windows Server Core

Kick Start! SQL 0:41:30

Kick Start! SQL Server 2019 Performance Tips and Tricks

SQL Server 2019 0:12:54

SQL Server 2019 | Query faster from any database. (Microsoft Ignite)

Querying Multiple Tables 0:10:40

Querying Multiple Tables with SQL

How to Create 0:15:38

How to Create Database in SQL Server

How To Backup 0:02:03

How To Backup A Database in Microsoft SQL Server (MSSQL) Management Studio [English 2020]

SQL Server Management 1:22:44

SQL Server Management Studio (SSMS) | Full Course

5 Basic SELECT 0:06:43

5 Basic SELECT Statement Queries in SQL

SQL Training | 3:08:06

SQL Training | SQL Tutorial | Intellipaat

SOLVE 5 SQL 0:05:02

SOLVE 5 SQL QUERIES IN 5 MINUTES (PART 1) | MASTER IN SQL | SQL INTERVIEW QUESTIONS

Learn SQL in 1:02:23

Learn SQL in 1 Hour - SQL Basics for Beginners

How to create 0:07:42

How to create Table,Insert,Update,Delete in SQL Server very easy steps

[[ 8.5 HOURS 8:29:20

[[ 8.5 HOURS ]] Complete SQL End to End - SQL Server Tutorial { End to End } Full Course Beginners

SQL Server 2019 0:01:43

SQL Server 2019 | SSMS 2018 | Backup and Restore Databases From One Server To Another server

SQL Server Tutorial 0:09:51

SQL Server Tutorial - One-to-many and many-to-many table relationships

Create SQL User 0:01:18

Create SQL User in SQL Server 2022 Database using SSMS

Комментарии
Автор

8 CPU Sockets? Thats Insane! I love it!

johnsa
Автор

how to maximize processor performance so that it can be used 100%
on my query running slow but usage can't reach 100%

blackak
Автор

Me reading memory: 12gb only??? Wtf how. Jump back and realized the t (tb). I Got the best laugh flash in a long time.

a_red_panda
Автор

Hi i have one question . How to so select query for 100 million recordset from mssql with rapidly. It's possible?

Common_man_views
Автор

Cool, right about 0.00001% of the world's businesses will afford the licensing costs so if this is supposed to be a flex I am not impressed.

DanielWillen