SinoAIBot — crawler information

How to identify it

Every request the crawler makes sends this User-Agent header:

SinoAIBot/0.1 (+https://app.lingxu168.com/crawler)

What it collects

Business contact details a company publishes on its own public website — company name, business email address, business phone number, postal address and links to official social profiles, typically from pages such as /contact, /about or the site footer. These are used to build B2B prospect lists for our customers.

It does not read anything a signed-out visitor could not read. It does not create accounts, submit forms, or collect personal data from private or logged-in areas.

robots.txt

The crawler fetches /robots.txt before crawling a host and obeys it. Disallowed paths are not requested. A Crawl-delay directive is honoured, and takes precedence over our own minimum delay whenever it is longer.

Rate limits

• At most one request in flight to a host at any moment, across the entire service.
• At least 500 ms between two requests to the same host, or longer if robots.txt says so.
• At most 60 pages from any one host per day, across all customers combined.
• At most 5 requests per second in total across the whole service — not per customer.

What it will not do

• It does not solve CAPTCHAs or Cloudflare challenges.
• It does not impersonate a browser. No fake User-Agent, no TLS or JA3 fingerprint spoofing on this path.
• It does not use residential or datacenter proxy networks. Requests come from our own servers, from an address you can block.
• It does not log in, and does not bypass paywalls or registration walls.
• If a host answers 401, 403, 429 or a bot challenge, it stops after 1 attempt and that host is not retried — for any customer, not just the one who triggered it.

Blocking it yourself

You can stop the crawler immediately, without contacting us, by adding this to your robots.txt:

User-agent: SinoAIBot
Disallow: /

This takes effect on our next crawl of your host — robots.txt is re-read each time, never cached between crawls.

Exclusion requests and abuse reports

To have a hostname excluded permanently, or to report a problem caused by this crawler, email [email protected]

Excluded hostnames go on a service-wide list that applies to every customer. Our application can add hosts to that list but has no permission to remove them, so an exclusion cannot be undone by an account holder or by support.