Introduction to Apache Lucene & Elasticsearch

Подписаться 901

Просмотров 31 тыс.

50% 1

In this presentation I go over Apache Lucene, being the cornerstone technology behind Elasticsearch. The tutorial is a high level overview, with some intermediate level of details when it comes to both systems' internal mechanics.
Link to the presentation: www.ivaylopavlov.com/lucene-e...
Chapters
00:00 - Introduction to Apache Lucene
01:20 - Lucene Indexing Mechanics
05:05 - Lucene Analyzers and Data Types
09:12 - What is Elasticsearch
10:49 - Elasticsearch Request Mechanics
18:08 - Elasticsearch's Caching and Query Language
20:20 - Elasticsearch Performance Tips & Tricks, Plugins
28:40 - Kibana
29:20 - FAQ & Sources
32:34 - Conclusion

Наука

Опубликовано:

1 июн 2024

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист

Посмотреть позже

Комментарии : 30

@nareshbollikonda6342 8 месяцев назад

Best short video for internal understanding of ealsticsearch

@dani.dimitrov Год назад

Good job! The video is explained in a simple and understandable language.

@richardokonicha Год назад

wonderful presentation Ivaylo thank you

@ivailop Год назад

Many thanks!

@RAVTechz 2 года назад

Great introduction! Thanks a lot :)

@ivailop 2 года назад

Thank you for the feedback!

@erenbilaloglu8959 2 года назад

Great explanation, thank you!

@ivailop 2 года назад

Glad you enjoyed it!

@self-development9649 3 года назад

Best short video for elastic searcg

@yuanzhibao9816 2 года назад

great explanation! geek for geeks!

@SomewhoUA 2 года назад

Useful information, thank you.

@ivailop 2 года назад

Great to hear! Thank you for the feedback!

@motarski 2 года назад

This is gold information, thank you for such great explanation.

@ivailop 2 года назад

Thank you for the positive feedback!

@danidraganov7213 3 года назад

Браво!

@ighsight 2 года назад

Excellent explainer for noobs like me. Experimenting now with Mongo Atlas Search that uses Lucene but seriously considering adopting Elasticsearch as I learn more about it.

@ivailop 2 года назад

Great to hear you've enjoyed it!

@venkatduvvuru8369 Год назад

@@ivailop Could you please confirm, whether we can filter data using some keywords? Say I have field called NAME, now I am trying to give search query string as "VENKAT". My search should return all the names which does not contain name as "VENKAT" irrespective of case. This can be done using Apache Lucene with hiberante search field analyzer? Please clarify.

@reachinganwesha123 2 года назад

Great explaination.... Don't know y u hve less subscribers... Ur channel must grow. Please explain elk in AWS.

@ivailop 2 года назад

Thank you for the kind words!

@j.elevated7576 2 года назад

Excellent info Ivaylo

@ivailop 2 года назад

Thank you! Appreciate the feedback!

@venkatduvvuru8369 Год назад

Hi @Ivaylo Pavlov, Thanks for nice tutorial. Could you please confirm, whether we can filter data using some keywords? Say I have field called NAME, now I am trying to give search query string as "VENKAT". My search should return all the names which does not contain name as "VENKAT" irrespective of case. This can be done using Apache Lucene with hiberante search field analyzer? Please clarify.

@ivailop Год назад

I think if you are using Elastic, it's a different syntax when searching, but if you are doing Lucene-level configuration, you need to use a LowerCaseFilter so when doing a search the tokens are lowercased and then the search query is applied.

@pricesmith1793 2 года назад

Did you have a video where you made something in HBase / Cassandra?

@ivailop 2 года назад

Hi, I don't have one as of yet, hoping to find time to do one, most likely Cassandra (and maybe ScyllaDB), since I'm a bit more familiar with it than HBase's internals.

@lucasgarcez9809 3 года назад

I would like to develop a project to detect fake news, in text formats, could apache lucene help me?

@ivailop 3 года назад

Hi Lucas, to train a model to detect fake news, you would need the entire text for each article, once Lucene ingests the text, it only stores the tokens in the reversed index and discards the original sent text. Unless you have an extra field that is stored as "keyword", ie. save the sent string as is and skip tokenizing. Lucene by architecture (Elasticsearch and Solr respectively) is geared towards search. In short, it's possible, but most likely won't be suitable. Cassandra or Redis might be better options for storing full-text to be used for Machine Learning. Hope this helps!