URL Lists FAQ

What should I do if I can't my URL list through the Portal?

We recommend using the API to upload a URL list in these cases.

Can I provide a blacklist of URLs for the crawler to avoid?

We do not provide the ability to “blacklist” URLs, you would simply not include them on your URL list.