Retail prices, bank rates and energy plans, refreshed every night. And a monthly index of the web's link graph: 133 million domains and 2.15 billion links for SEO work and AI agents. Every record is validated and kept with its history, served in seconds, and you pay only per result.
Two families, one factory: nightly retail, finance and energy data, and a monthly index of the web's links. Every Actor works the same way. Pick one to see live numbers, sample output and pricing.
Send the site and the fields you need. Demand decides what we plant next.
Nothing matches yet. Tell us what you need and we'll plant it.
One index of the Common Crawl web graph, rebuilt every month: 133 million domains and 2.15 billion domain-to-domain links, with a year of rank history. Ask it from your code, a spreadsheet or your AI agent.
| Open Authority | domains | share |
|---|---|---|
| OA 90–100 | 22 | 0.6% |
| OA 60–89 | 575 | 16.2% |
| OA 20–59 | 2,118 | 59.6% |
| OA 0–19 | 841 | 23.6% |
| Total | 3,556 | 100% |
Each dot is one domain that links to apify.com. The stronger the domain, the closer it sits to the centre.
Open Authority, rank, referring domains and their quality, with 3- and 12-month trends. firecrawl.dev gained 5 OA in 3 months.
Every referring domain, strongest first, each with its OA. apify.com has 3,556; facebook.com has 17.35 million.
scrapy.org against apify.com, zyte.com and scrapingbee.com: zapier.com, techradar.com and n8n.io link to all three competitors, not to scrapy.org.
Found from the sites that link to both. The three closest to ahrefs.com: semrush.com, g2.com and backlinko.com.
Open Authority (OA) is a domain's rank in the web graph on a 0–100 log scale. OA 60+ is roughly the top 150,000 domains of the web; OA 80+ roughly the top 5,000.
These are promises of the factory, not features of one scraper. Every Actor we publish keeps them.
Your run reads from the latest snapshot (last night's for prices, rates and plans, this month's for the link index), not from a live site under load. If a page can't be reached, you still get every other record, each marked with when it was collected.
partial results, never an empty failed run
Every change between snapshots is kept: nightly for prices and rates, monthly for authority and rank. Chart any value over time, or ask only for what changed.
field old new at value 12.40 → 11.90 02:14 status on → off 02:14
Consistent names, units and types. Stable ids, so the same record keeps the same key forever.
{ "id": "stable",
"collected_at": "ISO 8601",
"source_url": "https://…" }
The crawl already happened. A run only reads and filters the harvest: link lookups answer in milliseconds and a typical run takes 2 to 13 seconds.
Canary runs check every Actor every 3 hours and alert us before you notice anything.
All 8 Actors work as tools in any MCP client through the Apify MCP server. Your agent gets typed records with timestamps and history, so it can say what changed and how fresh each number is.
https://mcp.apify.com?tools=crawlplant/<actor>
{
"mcpServers": {
"crawlplant": {
"url": "https://mcp.apify.com?tools=crawlplant/commoncrawl-domain-metrics,crawlplant/link-gap-finder,crawlplant/au-bank-rates",
"headers": { "Authorization": "Bearer <APIFY_TOKEN>" }
}
}
}
Which sites are most like apify.com? I need five to benchmark against.
These five share the most linking sites with apify.com in the latest release:
| # | similar site |
|---|---|
| 1 | brightdata.com |
| 2 | zyte.com |
| 3 | scrapingbee.com |
| 4 | scraperapi.com |
| 5 | octoparse.com |
Every Actor charges per 1,000 results, at the rates below and on its card. Try any of them on Apify's free plan before you spend anything.
Compare rates in the catalogYou're billed for the records you receive. A smaller run costs less.
No seats, no minimums, no contract. Run it once or every hour.
The free Apify plan is enough to test any Actor on real data.
| Actor | you pay for | per 1,000 | good to know |
|---|---|---|---|
| Retail, finance & energyrefreshed every night · Australia | |||
| Woolworths Australia | products | $0.30 | $0.50 on Apify's Free plan |
| Coles Australia | products (store rows included) | $0.50 | $0.80 on Apify's Free plan |
| Australian Bank Rates | rates | $1.00 | $1.50 on Free · rate-change events priced separately |
| Australian Energy Plans | plans | $1.25 | $2.00 on Free · plan-change events priced separately |
| SEO & link datamonthly web-graph index · global | |||
| Bulk Domain Authority & Referring Domains | domain profiles | $1.00 | down to $0.70 on Apify's Gold plan |
| rank history rows | $1.50 | rank history since 2018 | |
| link rows | $2.00 | referrers, link gap, similar sites and outgoing-links modes | |
| Referring Domains Checker | referring domains | $2.00 | strongest first, each with its OA |
| Link Gap Finder | prospects | $4.00 | hubs and infrastructure left out by default |
| Similar Sites Finder | similar sites | $5.00 | works for any domain |
Retail, finance and energy sources are crawled every night. The link-graph Actors read an index of the Common Crawl web graph that we rebuild every month, with 12 monthly releases of rank history. Every record carries a timestamp or release name, so you always know how fresh a value is.
Your run is served from the latest snapshot, so it keeps working. Canary checks every 3 hours tell us about a change long before it reaches you, and we fix it before the next refresh. You get partial results, never an empty failed run.
A domain's rank in the web's link graph, on a 0–100 log scale. It is computed from the Common Crawl web graph every month, so it is open and repeatable. OA 60+ is roughly the top 150,000 domains; OA 80+ roughly the top 5,000.
Each monthly crawl samples a different set of pages, so around 17% of referring domains change between releases even when nothing happened. We label those rows "newly seen" and "no longer seen", and use the 3- and 12-month trends for real direction.
Each Actor runs on the Apify platform. Results come as JSON, CSV or Excel from the Console, through the Apify API or client libraries, on a schedule, or as a tool for AI agents via MCP.
We collect publicly available data only: no personal data, nothing behind a login. Crawls are paced and run at night to keep load on each site low. How you use the data is up to you, under the source's terms and your local law.
Yes. Email us the site and the fields you need. We prioritise by demand and let you know when it's live.