AmazingBot — the Amazing.ge crawler
AmazingBot is the web crawler of Amazing.ge, an online marketplace in Georgia. If you see “AmazingBot/1.0 (+https://amazing.ge/bot)” in your server logs, this page explains what it does and how to stop it.
Why it visits your site
Our team uses AmazingBot to look at public shop pages — products, prices, categories and publicly listed business contact details — when we consider inviting a shop or its sellers to sell on Amazing.ge. Each visit is started by a person on our team for one specific site; the crawler does not wander the web on its own.
How it behaves
- It reads robots.txt first and never opens pages that robots.txt closes to it or to all crawlers.
- It follows Crawl-delay and in any case sends a site no more than one request every 2 seconds.
- It opens at most 40 pages per visit and stops after 10 minutes.
- It does not log in, fill in forms, place orders or try to get past captchas or other bot checks. If a site shows such a check, the crawler leaves.
- It collects only public information about the shop: its name, products (names, prices, photos), categories and publicly listed business contacts. For an invitation we may prepare a private draft storefront from your public products — only the seller sees it, through a personal link; if the invitation is not accepted, the draft and the collected data are deleted within 30 days. We do not copy or keep whole pages of your site.
How to block it
Add these lines to the robots.txt file at the root of your site:
User-agent: AmazingBot
Disallow: /
The crawler reads robots.txt at the start of every visit, so the change applies from the next visit.
Questions
Write to us — for example, if you do not want us to contact your business or want the information we collected removed: [email protected]