Discussions

Ask a Question
Back to All

How many crawls per month is actually possible?

What are the top users actually able to crawl? Billions of urls? Is the structure of 80legs able to facilitate such feats?