HeadlineCheckBot
The crawler that reads news for HeadlineCheck.
It identifies itself as HeadlineCheckBot/1.0 (+https://headlinecheck.com/bot).
- It reads publishers’ public RSS feeds every few minutes.
- When an article is checked, it downloads that one page, once. The text is used only for the check and is never republished; we show a headline, a short summary and a link to the original.
- It always respects robots.txt. To block it, add:
User-agent: HeadlineCheckBot
Disallow: /
Questions or problems: contact@headlinecheck.com.