Hello everyone I have built a bot that crawls several

Question

Hello everyone I have built a bot that crawls several

sites. I want him to send me an update when there is a new one I have a hard time comparing String Is there any example? How do I know what the new string is?

0

20.02.2022

6 ответов

16 просмотров

🚀 Автор вопроса

Mehdi
What is the data that u crawl ? Email, articles ? ...

Hello I want to build a new job tracking bot with node.js I know how to do crawling I have trouble saving data as little as possible using memory. How should you do it to keep a job database and compare? Save string or the html for comparisons? If I see that String is not found how do I know which check to take?

0

20.02.2022

Mehdi

🚀
Hello I want to build a new job tracking bot with ...

It depends if url of the job post that u crawl has id of the job posting or unique url so u can save it and compare base of that

0

20.02.2022

🚀 Автор вопроса

Mehdi
It depends if url of the job post that u crawl has...

Save the id in the database? And if the job is deleted delete the id?

0

20.02.2022