LinkAider web crawler

Note: This page is under development, please contact us for more info.

What is LinkAider web crawler?

LinkAider web crawler is a program that scans websites and indexes their content, such as page titles, documents, images, and links, for LinkAider services.

How can I block LinkAider web crawler?

LinkAider always checks robots.txt rules before crawling any site and it will not visit restricted areas of any website. It also uses default crawl delay of 2 seconds to avoid slowing down crawled websites.
If you want to block specifically LinkAider web crawler, please add this to your robots.txt:

User-agent: LinkAider
Disallow: /

How can I slow down LinkAider?

LinkAider uses crawl delay of 2 seconds to avoid slowing down crawled websites. But you can easily override this by setting your own crawl delay in robots.txt file, for example:

User-Agent: LinkAider
Crawl-Delay: 5