to follow multiple links?
I have created two different spiders for two different tasks :
The first one searches good reads for the specific title and extracts the first result.
The second one :
After landing on the URL obtained by the first spider, I need to extract the genres.
I have been able to do this by providing static urls , I would like the second program to inherit the URL obtained by the first program.
i guess that's the job of one spider, 2 spiders for same url is kind of an overkill
Обсуждают сегодня