oh thanks- but what if some websites dont have robots.txt ? Also what does user-agent signify?
I was trying to using custom domain for https://kutt.it - Added the A record and now my website is down - I use firebase to serve my site - So I guess both are conflicting - h...
<param-name>allowedOrigins</param-name> <param-value>https://coila.in</param-value> How do i add another domain name to the alllowed list for CROS? Do i have to create...
Typescript complies emojis to ?? why is this happening and how do I solve this?
Can I do all the stuff that i do with Aurdunio on a PI?
Now this is confusing - can u explain?
Is web scraping legal?
are you using any frameworks?