Crawler & writer relations

PemberleyBot

How Pemberley reads the open web, and how to tell it to stop.

What it is

Pemberley is positioning intelligence for people who trade on what they know. PemberleyBot is the crawler it uses to read publicly available RSS and Atom feeds, so it can follow the conversation in a field and point members to the writing worth their time.

How to identify it

Every request carries this User-Agent:

PemberleyBot/1.0 (+https://trypemberley.com/bot)

What it does, and doesn’t

  • Reads public feeds only. It does not bypass paywalls, logins, or anti-bot measures.
  • Honors robots.txt. If your site disallows PemberleyBot, it will not crawl you.
  • Uses your writing to build private, per-reader taste profiles and to write capsule intros that point readers back to your work by name. It does not republish your full text on a public feed.

Opt out

Two ways, whichever is easier:

1. robots.txt. Add this to your site:

User-agent: PemberleyBot
Disallow: /

2. Email, if you can’t edit robots.txt:

Write to jamie@born2be.io and Pemberley will remove your work and stop crawling you. No questions asked.

Why Pemberley exists

Pemberley exists to send readers to writers, not to replace them.

Every recommendation links back to the original, by name. If anything here doesn’t sit right, write to jamie@born2be.io.

Pemberley · turn what you know into what you’re known for