GatherlineBot
GatherlineBot is an automated reader operated by Gatherline LLC, St. Petersburg, Florida. It is how our platform measures whether real estate agents are visible to AI assistants.
User agent string: GatherlineBot/1.0 (+https://gatherline.com/bot)
What it does
GatherlineBot requests public web pages and reads the HTML. For each page it records the title, headings, structured data, whether the page is reachable, and any business names or professional claims published on the page. It does not submit forms, log in, click buttons, run JavaScript, or collect personal information. It does not store full page content.
It visits two kinds of pages: the websites of agents who are our customers, with their permission, and public pages that AI assistants cite when answering questions about local real estate.
How often it visits
A customer's own website is checked at most a few times per week. Any other page is requested at most once every seven days, and usually far less often. GatherlineBot requests one page at a time and does not crawl entire sites.
Robots.txt
GatherlineBot reads and obeys robots.txt. It responds to rules addressed to gatherlinebot and to rules addressed to all crawlers, including Allow rules and rules that apply to specific paths.
One exception: when an agent is our customer, we check their own website at their request. Because they have asked us to look at their own site, that check runs whether or not robots.txt would otherwise exclude us. Any agent can stop it by emailing info@gatherline.com.
How to allow it
If your firewall or hosting platform is blocking GatherlineBot and you would like to allow it, add gatherlinebot to your allowed user agents, or allow it in robots.txt:
User-agent: gatherlinebot Allow: /
How to block it
To block GatherlineBot entirely, add this to your robots.txt:
User-agent: gatherlinebot Disallow: /
We will stop requesting your pages. If you are a Gatherline customer, robots.txt will not stop us from checking your own website, because that check is something you asked us to perform — email info@gatherline.com and we will stop that too. Blocking GatherlineBot does not affect whether AI assistants read your site. They use their own crawlers, which are separate from ours.
Questions
Email info@gatherline.com.