What is in a Lucene index? Adrien Grand, Software Engineer, Elasticsearch

Presented by Adrien Grand, Software Engineer, Elasticsearch

Although people usually come to Lucene and related solutions in order to make data searchable, they often realize that it can do much more for them. Indeed, its ability to handle high loads of complex queries make Lucene a perfect fit for analytics applications and, for some use-cases, even a credible replacement for a primary data-store. It is important to understand the design decisions behind Lucene in order to better understand the problems it can solve and the problems it cannot solve. This talk will explain the design decisions behind Lucene, give insights into how Lucene stores data on disk and how it differs from traditional databases. Finally, there will be highlights of recent and future changes in Lucene index file formats.

[elberkam]

Best Lucene internals explanation I have seen/read. No other books/video contain anything mentioned here. I wish I watched it earlier. 

Thanks

[fgngejw]

cool presentation. it is amazing how little approachable info is there on this topic, even 9 years later...

[vinayakmishra]

Best video you would ever see. You may waste your time searching web as I did you can directly watch this.

[selvashoba]

He is a genius... Though it was a little hard to follow. I'm able to connect what goes in our solr indexes. This guy is too valuable a resource he should invest a little effort in his pronunciation

[zazafull]

Merci pour la belle présentation Adrien.

[anibaldk]

Brilliant lecture! The bloke really knows his stuff!!

[JasonZhang]

Really hard to follow without a subtitle

[ShivangiSingh-wcgk]

So the insertions are like SS tables. Make new sorted and then when the problem gets too big merge n sorted list

[mikolak-ja]

Is the point about using doc values when not every field is needed in memory still valid, due to compression which is now enabled by default, for example in Solr? You have to decompress whole document before reading the fields. Adrien is talking about it at 28:00.

[llothar]

Too strong accent to follow this for an hour. Now i'm doing the Jedi thing instead: Read the source Luke.

[shivamanand]

my head hurts trying to listen to this... please add subtitles anyone..

[NoelMoldvai]

very useful, but the accent... how much more french can you get

[salkdjfasldkfjsdlk]

Great info but hard to follow. Next time, slow down and enunciate for non-French speaking viewers. For instance, at 24:26...unique value for what? Jumps?

[nikhilv]

Accent and pronounciation is hard to follow, good content though

[patricek.]

Faut vraiment que tu bosses ton Anglais....

[twistymail]

Please find an English native speaker to redo this video. Your French accent is often manifested as swallowing important parts of words. I could not follow the discussion and left the video.