with python. For let's say in every 1 hour. For that do I need to send get request every 1 hour or is there any other way ?
Стикер
Is there a possibility that I may get blocked for sending too many requests?
Yes. But one request every hour is hardly too many.
The best you can do is a HEAD request per hour and look at the Date or Etag response headers if the website supports either of those
What can I do with Data header? It just gives the date of the head request
Can I do the same with Content-Length? My question is, does content-length automatically gives the size of webpage or it is manually set. Like if an element is added in the webpage can I know that with Content-Length?
No, it gives the date of the last time the page was edited usually?
I tried, it gave the time on which response was sent (or maybe something is different with that site)
An element could be replaced with another element of the same size, then the total length would be the same
Yup but that's highly unlikely in that site (it's a college website where lecture notes are uploaded)
Обсуждают сегодня