Jump to Content
80legs APIGuidesAPI DocumentationDiscussions
HomeGuidesAPI DocumentationChangelogDiscussions
v2

GuidesAPI DocumentationDiscussionsLog In80legs API
Log In
v2

Welcome to 80legs

  • Getting Started
  • FAQ

Web Crawls

  • Running crawls with Postman
  • Running crawls with cURL
  • Running crawls with PHP
  • Running crawls with Node.js
  • Running crawls with Python

80apps

  • Introduction to 80apps
  • Making your own 80app

URL Lists

  • URL Lists FAQ

Result Files

  • Result Files FAQ
Powered by 

URL Lists FAQ

Suggest Edits

What should I do if I can't my URL list through the Portal?

We recommend using the API to upload a URL list in these cases.

Can I provide a blacklist of URLs for the crawler to avoid?

We do not provide the ability to “blacklist” URLs, you would simply not include them on your URL list.

Updated about 4 years ago


  • Table of Contents
    • What should I do if I can't my URL list through the Portal?
    • Can I provide a blacklist of URLs for the crawler to avoid?