Тёмный

Build A Custom Search Engine In Python With Filtering 

Dataquest
Подписаться 59 тыс.
Просмотров 24 тыс.
50% 1

In this project, we'll build a custom search engine that uses filtering to rank results. The engine will get results from the Google Custom Search API, store them, then rank them based on filters we define.
We'll filter based on the number of trackers on the page, and the length of the content. The framework will be extensible, so you can add your own filters, including ones that use machine learning.
We'll also use Flask to render a basic search page and results list so you can use the engine.
You can see the full code and a README for this project here - github.com/dataquestio/projec... . This includes links to any files you'll need to download or things you need to setup.
Chapters
00:00 Introduction
02:38 Getting a Custom Search Engine API key
05:46 Initializing our project with PyCharm
09:57 Storing our results with sqlite3
17:36 Querying the search API
30:16 Creating a flask web application
41:48 Filtering results by page content
48:20 Filtering by trackers and ads
55:30 Adding in relevance scores
1:03:21 Next steps with this project
---------------------------------
Join 1M+ Dataquest learners today!
Master data skills and change your life.
Sign up for free: bit.ly/3O8MDef

Опубликовано:

 

11 июл 2024

Поделиться:

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист
Посмотреть позже
Комментарии : 18   
@dataprofessor_
@dataprofessor_ Год назад
Amazing tutorial, still not finished but already super excited for all the upcoming ones. Please keep doing amazing work.
@MangoBee093
@MangoBee093 Год назад
Amazing content. Very intuitive and straight forward, so great that even non-programmer like me can enjoy it to the end without any extra google search. Good works!!
@Quantumvp
@Quantumvp Год назад
I have fallen in love the is was what I was asking for without asking 😍
@lightyagami-rk2my
@lightyagami-rk2my Год назад
Thank you so much sir!!
@unstablecoding
@unstablecoding 10 месяцев назад
I didn't finish it but that was cause I already have my own search engine but just needed to know how to get the api to work. Thanks!
@MV-sy9bz
@MV-sy9bz 11 месяцев назад
I used this project to structure my script to query google and use the resultant link to parse the specific website in order to get product information for the website we are trying to build for small business.
@gregorpanteleyevicmelehov9584
How can we show the codes we have drawn by designing them in the layout?
@utkarshkumar3560
@utkarshkumar3560 6 месяцев назад
Getting a syntax error (Invalid syntax) whilst running "flask --debug run --port 5001". Any idea why it could be happening ?
@AaronStierCohen1
@AaronStierCohen1 Год назад
Hey there. I do not want to search the entire web. I want to search specific news sites and possibly social media pages. Do you know where I can learn how/why to index different websites, domains, etc. so I'm searching only those sources at whatever depth? Thanks for the videos!
@MV-sy9bz
@MV-sy9bz 11 месяцев назад
i am just newbie to this but while setting up google API, I noticed that you can filter your api to specific websites. Try that ! It will also improve security of your Api !
@tejaswikarthik3681
@tejaswikarthik3681 5 месяцев назад
I liked this very much and i followed so Can anyone say where we can deploy this project
@TheChrisSoria
@TheChrisSoria 5 месяцев назад
my search results are not so good! any idea how to improve them?
@ashusharmacseaspirantsstud9211
Hi In above depolyment I am getting error as Keyerrors "items" how to resolve please guide into it
@ashusharmacseaspirantsstud9211
please acknowledge me looking forward
@lightyagami-rk2my
@lightyagami-rk2my Год назад
@@ashusharmacseaspirantsstud9211 check your settings.py file you didn't put search key and search id
@RAVishnuE
@RAVishnuE Год назад
@@ashusharmacseaspirantsstud9211 import pprint & use pprint.pprint(response) to print the response from the custom search API, if you are not getting the search results form the API u will probably won't get this items list parameter in the response. also cross check with cx= as @light yagami mentioned
@SOCMMOB
@SOCMMOB 7 месяцев назад
I keep getting a JSONDecode error 🤔
Далее
I Made a FAST Search Engine
8:17
Просмотров 145 тыс.
Cat Plays with Window Washer
00:22
Просмотров 2,1 млн
🎙ПЕСНИ ВЖИВУЮ от КВАШЕНОЙ🌹
3:09:38
Can I Make A Search Engine From Scratch?
11:13
Просмотров 105 тыс.
Python RAG Tutorial (with Local LLMs): AI For Your PDFs
21:33
Python AI Choose Your Own Adventure Game - Tutorial
31:09
Cat Plays with Window Washer
00:22
Просмотров 2,1 млн