- crawl4ai direct first (detect if article actually needs paywall bypass)
- Only hit archive.ph when paywall detected (saves rate-limit budget)
- New 📰 icon for free articles enriched with full text
- 📖 reserved for actual paywall bypass via archive.ph
Final state set:
- 🔓 OA via Unpaywall
- 📰 Free article enriched
- 📖 Paywall bypassed via archive.ph
- ⏳ Paywalled, retrying
- 🚫 Paywalled, gave up after 3h
- ❌ Fetch error
fkrebs
48f7c2588a