How to design API that display and filter through millions of products.REST API Filters & Pagination

We are very glad to start the REST APIs made easy course with the very first video on fundamentals of REST APIs, HTTP Methods, taxonomy around REST APIs etc. We hope that you get some value out of this course and these concepts help you thrive in your jobs, interviews and help you become better software engineers every day. Here are few links that you might want to refer before or during the course:

We hope that you get some value out of this course and these concepts help you thrive in your jobs, interviews and help you become better software engineers every day.

More on the topic:

Previous videos to catch up on:

------------------------------------------------------------------
Recommendations
------------------------------------------------------------------
Our full courses on youtube:

Some paid courses that we recommend:

------------------------------------------------------------------
About Us
------------------------------------------------------------------
Created and Instructed by:
Yogita Sharma

Post-production(editing, thumbnail etc) managed by:
CiKi

Colors and design by:
Naini Todi

Both Arpit and Yogita are software engineers and want to help other software engineers become better by providing high quality and well researched content by adding their creativity and teaching twist.

------------------------------------------------------------------
Join Us
------------------------------------------------------------------
Hangout with sudoCode:

For business:

[karfin.trader]

Some information on how the backend queries will manage limit and offset would have been helpful to tie in the solution end to end.

[UtkarshSinghPaliwal]

Please also make a few videos on Low Level Design and CDNs.

[sidhanshuraghuvanshi]

Expecting implementations of concepts as well in all videos

[vengateshan]

This video was very helpful and got more info . Thanks

[Shreenidhi]

thanks alot!I was struggling to anwer these questions in interview .I must say it's a easy way to understand these concepts.

[utkarshconscious]

This is really wonderful explanation. I know its not in scope of this series but out of curiosity would you mind throwing some light on how backing code for pagination can be implemented? Will it use some sort of sorted cache from where it returns results based on offset and max limit or is there a better way to get this done?

[mm]

In backend for offset and limit pagination we can use db limit and offset parameter while creating a query to fetch that many rows and this quite inefficient in certain scenarios.

Keyset pagination which is quite efficient but can’t directly query a particular page. Either go forward or backward in rows with a particular limit.

[rjcdz]

Great and clear explanation 👏👏 Thanks a lot

[hakieye]

Wow terrific to the point with clear and clean message.

[halconElectrico]

Your explainations are the best, right to the point, well illustrated, real world examples. Thank you.

[UtkarshSinghPaliwal]

Thanks a lot for these wonderful videos. I've become a better Engineer with the help of your videos. Keep up the awesome work 👏

[keaganferrao]

Using an OFFSET for huge data will still be inefficient for MILLIONS of rows as the database still needs to skip all the rows specified by offset. I expected you to give a solution to this problem in this video as the title specified "millions".

[nihal]

Love this video.
Can you please create a video dedicated to API Security? How do you secure an API?

[naveensharma]

Clear and crisp explanation but I've one question. Do we need to hit db for every request, Is it a good idea ? If not then what are the other ways we fetch x amount to data in once(certain threshold) and serve in 20-20 chunks ?

[jinalpatel]

This is nice topic. Sometime I feel that pure REST approach is not suitable for business need. It mainly revolve around single entity but business application has complex need like to filter. Let's say for example Employee Belong to specific company and organization and there are multiple attribute associated with that and we have to pass multiple filter attribute. I feel that sometime pragmatic approach will make more sense and expose end-point like /search / filters etc will make more sense.

[iyakkaprivatelimited]

This explanation is so valuable thank you for that, also I would like to suggest if possible to do a video demo with a limited paging server response for example : API like Zoho, or deluge code based API's, how to use the explained methods on a study case like this

[buckybarnes]

by your presentation we easily got the concepts, thanks to your editor😅😅

[rahulsen]

Found 2 channels useful so far .. Ur channel and another.. kudos

[kw]

Explaination is excellent please provide practical video if possible

[LoayAl-Said-jp]

Thank you so much for the effort.
appreciate it

Loay from Egypt