Questions tagged [urlfrontier]
The urlfrontier tag has no usage guidance.
urlfrontier
1
question
1
vote
0
answers
11
views
Issue with setting a simple crawler with URLFrontier
I am trying to integrate the URLFrontier to a simple crawler but I am running into issues
I have started URLFrontier which listens on port 9100
My client in Python is
client.py
import requests
class ...