Session — AutomaticBarrier

Crawl path

2xx OK 3xx Redirect 4xx Error 5xx Server error — edge = referer · dashed = no referer ? what do these mean

2xx OK

Page was successfully fetched. Bot read the content and may have followed links from it.

200 Standard success — full content returned.

304 Not Modified — bot already has this page cached, server skipped sending content. Saves bandwidth but counts as a crawl hit.

Graph edges & nodes

— solid edge — URL was reached via a referer link from another page in this session.

- - dashed edge — No referer. Bot fetched this URL from its own crawl queue, not via a link.

dashed border node — Entry point. No other page in this session linked to it.

grey node — External referer. Not part of this session — it's the page that triggered the crawl.

3xx Redirect

Bot was redirected to another URL. Each redirect costs one crawl budget hit.

301 Permanent — passes link equity to destination. Use for page moves.

302 Temporary — does not reliably pass link equity. Avoid for permanent moves.

307 Temporary (method-safe) — same SEO implications as 302.

308 Permanent (method-safe) — like 301 but preserves POST method.

4xx Error

Bot hit a dead end — no content returned, no links followed. Wastes crawl budget.

400 Bad Request — malformed URL or request.

401 Unauthorised — login required, bot can't access.

403 Forbidden — server blocked the bot (firewall, IP, robots).

404 Not Found — page doesn't exist. High volume = broken internal links.

410 Gone — page permanently removed. Tells Google to deindex faster than 404.

429 Too Many Requests — bot rate-limited. May reduce crawl frequency.

5xx Server error

Server failed to respond. Bot may retry but will deprioritise the site if errors persist.

500 Internal Server Error — unhandled exception on the server.

502 Bad Gateway — upstream server (e.g. PHP-FPM) returned an invalid response.

503 Service Unavailable — server overloaded or in maintenance mode.

504 Gateway Timeout — upstream server took too long to respond.

Crawl Sequence

[500] /wp-cron.php?doing_wp_cron=1776307287.1492710113525390625000

+0s

[500] /wp-cron.php?doing_wp_cron=1776308086.3292169570922851562500

+799s

[500] /wp-cron.php?doing_wp_cron=1776309617.7117259502410888671875

+2330s

[500] /wp-cron.php?doing_wp_cron=1776310286.2844939231872558593750

+2999s

[500] /wp-cron.php?doing_wp_cron=1776310349.3798220157623291015625

+3062s

[500] /wp-cron.php?doing_wp_cron=1776311806.1282920837402343750000

+4519s

[500] /wp-cron.php?doing_wp_cron=1776311912.8366050720214843750000

+4625s

[500] /wp-cron.php?doing_wp_cron=1776312375.3414111137390136718750

+5088s

[200] /?wordfence_syncAttackData=1776313460.3349

+6173s

[500] /wp-cron.php?doing_wp_cron=1776313461.8019039630889892578125

+6174s

[500] /wp-cron.php?doing_wp_cron=1776313658.6333858966827392578125

+6371s

[500] /wp-cron.php?doing_wp_cron=1776313886.2418899536132812500000

+6599s

[500] /wp-cron.php?doing_wp_cron=1776315086.2865540981292724609375

+7799s

[500] /wp-cron.php?doing_wp_cron=1776315947.9302289485931396484375

+8660s

[500] /wp-cron.php?doing_wp_cron=1776316105.4726710319519042968750

+8818s

[500] /wp-cron.php?doing_wp_cron=1776317564.8837039470672607421875

+10277s

[500] /wp-cron.php?doing_wp_cron=1776318479.6977539062500000000000

+11192s

[500] /wp-cron.php?doing_wp_cron=1776318576.9798610210418701171875

+11290s

[500] /wp-cron.php?doing_wp_cron=1776318637.5911800861358642578125

+11350s

[500] /wp-cron.php?doing_wp_cron=1776318828.9551439285278320312500

+11541s

[500] /wp-cron.php?doing_wp_cron=1776319296.0987238883972167968750

+12009s

[500] /wp-cron.php?doing_wp_cron=1776319886.8876829147338867187500

+12599s

[500] /wp-cron.php?doing_wp_cron=1776320536.9674119949340820312500

+13250s

[500] /wp-cron.php?doing_wp_cron=1776320664.5565900802612304687500

+13377s

[500] /wp-cron.php?doing_wp_cron=1776320665.5308361053466796875000

+13378s

[500] /wp-cron.php?doing_wp_cron=1776321218.3483970165252685546875

+13931s

[500] /wp-cron.php?doing_wp_cron=1776321461.1609790325164794921875

+14174s

[500] /wp-cron.php?doing_wp_cron=1776321986.8964459896087646484375

+14699s

[500] /wp-cron.php?doing_wp_cron=1776322586.2875430583953857421875

+15299s

[500] /wp-cron.php?doing_wp_cron=1776323186.9608759880065917968750

+15899s

[500] /wp-cron.php?doing_wp_cron=1776323786.9392011165618896484375

+16500s

[500] /wp-cron.php?doing_wp_cron=1776323892.7080199718475341796875

+16605s

[500] /wp-cron.php?doing_wp_cron=1776323998.0130360126495361328125

+16711s

[500] /wp-cron.php?doing_wp_cron=1776324189.2329390048980712890625

+16902s

[500] /wp-cron.php?doing_wp_cron=1776324386.8934459686279296875000

+17099s

[500] /wp-cron.php?doing_wp_cron=1776324820.8783559799194335937500

+17533s

[500] /wp-cron.php?doing_wp_cron=1776324986.2818510532379150390625

+17699s

[500] /wp-cron.php?doing_wp_cron=1776325167.4371919631958007812500

+17880s

[500] /wp-cron.php?doing_wp_cron=1776325594.1967890262603759765625

+18307s

[500] /wp-cron.php?doing_wp_cron=1776326186.9168510437011718750000

+18899s

[500] /wp-cron.php?doing_wp_cron=1776326927.8342630863189697265625

+19641s

[500] /wp-cron.php?doing_wp_cron=1776327397.1862230300903320312500

+20110s

[500] /wp-cron.php?doing_wp_cron=1776327630.9865250587463378906250

+20344s

0s20344s

Link attributes

Click a node in the graph to see its outgoing links