Ask a Question

Crawler blocked

My crawlers are blocked for days and not start, how can I solve the problem?

crawl delete

Why can't create EightyApp and get status code 422 ?


I have crawl but app is delete so I get this type of error "Your account does not have a URL List by that name.,Your account does not have an EightyApp by that name." how can I solve this?

Question about # of URL's crawled

I set up a crawl of Max 10,000 URL's but only loaded a list of 1000 URL's, Depth of 1 and only internal links. Why does it show # of URL's crawled 8340 and crawl is still going?? Thanks

Crawls are not working!

Hello, I've been trying to crawl several websites, including ones I have already succeeded before, but nothing is happening. The crawl just stays on the status "STARTED" for days. Is there a problem that should be fixed soon ?

Crawls are failing to start

Since the weekend, my crawls are failing to start (stuck on 0) Is anyone else experiencing this?

simple issue: entire basic html website but behind a password page - how?

How can i login the site with 80 legs and let it crawl after it authenticated?

Inconsistent crawling for same set of data

Hi, We were scraping one of the websites by making our own app and URL list. Now, some weird behavior we are observing i.e. for the same set of URLs we are getting different outputs. It is inconsistent. Is it because all the 80legs IPs are blacklisted by that particular website? Kindly reply to the above issue. Thanks!

Crawl limit is lower than my plan

Trying to start a new crawl this morning, but for some reason I am being limited to 10,000 URLs instead of the 100,000 URLs per my pricing plan. (crawls were working normally yesterday)

HELP !!!

Hi, I'm trying the product and created a crawl with the following link: http://www.bing.es/search?q=Agile+Coach+en+Madrid&count=100&first=600 I also placed to extract emails and go 10 levels inside, but nothing happens (returns 0 and says completed). What am I doing wrong? You can check all the craws in my account and you'll see that none of them work.