New: ChatGPT, Meta, Pinterest and TikTok feeds from the same verified data. Free audit →
Our bot

FeedloveBot

FeedloveBot is the crawler of feedlove. It reads the public product pages of the online stores that are our clients, so we can fill the attributes missing from their Merchant Center feed with data from their own pages.

How to identify it

The User-Agent header of its requests:

FeedloveBot/1.0 (+https://feedlove.app/bot)

What it does and doesn't do

  • It only requests the product pages listed in the feed and the store's public product API (e.g. the WooCommerce Store API).
  • It is polite: at most two requests to a store at a time, with a pause between requests, and it backs off on errors.
  • It visits a store at most once a day (at night) and only processes products that changed.
  • It never logs in, fills in forms or adds anything to a cart.
  • It respects robots.txt by default.

How to allow it

If your robots.txt blocks your product pages (for example, it excludes all bots), these two lines allow FeedloveBot only. The rules for other bots stay the same.

User-agent: FeedloveBot
Allow: /

Questions?

If the bot causes any trouble for your server, or you'd rather it didn't visit, write to us and we'll stop it right away. Contact details are on the privacy page.