OleaMarketsBot
OleaMarketsBot is the crawler Olea Markets uses to collect price publications from official and semi-official sources (price bulletins, observatories, statistical series) to compute the Olea Price indices. It does not index general web content: it only visits market data pages.
Identification & behaviour
- User-Agent
OleaMarketsBot/1.0 (+https://oleamarkets.com/bot)- Pace
- At most 1 request per second per domain (minimum 1 s between requests), usually one or two visits per source per week.
- robots.txt
- Always respected. If you exclude OleaMarketsBot, we stop visiting you.
- Contact
- [email protected] — we answer and adjust the crawl if anything bothers you.
Why you want to be included
- Every source that enters the index is cited in the public methodology and on the status page, with a link: traffic and attribution for the original publisher.
- Your data gains reach: analysts, cooperatives and press consult the index daily and follow through to the primary source.
- We do not republish your content: we only aggregate numeric values with attribution. The original data keeps living on your site.