Crawl Analyzer
Paths
URLs
Dead-ends
Frequency
Orphans
Budget
Verify
Tools
Session
WordPress-Pingback · AutomaticBarrier · Apr 15 18:41 · 43 hits
Scrape pages
Crawl path
⊕ Fit
2xx OK
3xx Redirect
4xx Error
5xx Server error
— edge = referer · dashed = no referer
? what do these mean
2xx OK
Page was successfully fetched. Bot read the content and may have followed links from it.
200
Standard success — full content returned.
304
Not Modified — bot already has this page cached, server skipped sending content. Saves bandwidth but counts as a crawl hit.
Graph edges & nodes
— solid edge
— URL was reached via a referer link from another page in this session.
- - dashed edge
— No referer. Bot fetched this URL from its own crawl queue, not via a link.
dashed border node
— Entry point. No other page in this session linked to it.
grey node
— External referer. Not part of this session — it's the page that triggered the crawl.
3xx Redirect
Bot was redirected to another URL. Each redirect costs one crawl budget hit.
301
Permanent — passes link equity to destination. Use for page moves.
302
Temporary — does not reliably pass link equity. Avoid for permanent moves.
307
Temporary (method-safe) — same SEO implications as 302.
308
Permanent (method-safe) — like 301 but preserves POST method.
4xx Error
Bot hit a dead end — no content returned, no links followed. Wastes crawl budget.
400
Bad Request — malformed URL or request.
401
Unauthorised — login required, bot can't access.
403
Forbidden — server blocked the bot (firewall, IP, robots).
404
Not Found — page doesn't exist. High volume = broken internal links.
410
Gone — page permanently removed. Tells Google to deindex faster than 404.
429
Too Many Requests — bot rate-limited. May reduce crawl frequency.
5xx Server error
Server failed to respond. Bot may retry but will deprioritise the site if errors persist.
500
Internal Server Error — unhandled exception on the server.
502
Bad Gateway — upstream server (e.g. PHP-FPM) returned an invalid response.
503
Service Unavailable — server overloaded or in maintenance mode.
504
Gateway Timeout — upstream server took too long to respond.
Crawl Sequence
[500]
/wp-cron.php?doing_wp_cron=1776307287.1492710113525390625000
+0s
[500]
/wp-cron.php?doing_wp_cron=1776308086.3292169570922851562500
+799s
[500]
/wp-cron.php?doing_wp_cron=1776309617.7117259502410888671875
+2330s
[500]
/wp-cron.php?doing_wp_cron=1776310286.2844939231872558593750
+2999s
[500]
/wp-cron.php?doing_wp_cron=1776310349.3798220157623291015625
+3062s
[500]
/wp-cron.php?doing_wp_cron=1776311806.1282920837402343750000
+4519s
[500]
/wp-cron.php?doing_wp_cron=1776311912.8366050720214843750000
+4625s
[500]
/wp-cron.php?doing_wp_cron=1776312375.3414111137390136718750
+5088s
[200]
/?wordfence_syncAttackData=1776313460.3349
+6173s
[500]
/wp-cron.php?doing_wp_cron=1776313461.8019039630889892578125
+6174s
[500]
/wp-cron.php?doing_wp_cron=1776313658.6333858966827392578125
+6371s
[500]
/wp-cron.php?doing_wp_cron=1776313886.2418899536132812500000
+6599s
[500]
/wp-cron.php?doing_wp_cron=1776315086.2865540981292724609375
+7799s
[500]
/wp-cron.php?doing_wp_cron=1776315947.9302289485931396484375
+8660s
[500]
/wp-cron.php?doing_wp_cron=1776316105.4726710319519042968750
+8818s
[500]
/wp-cron.php?doing_wp_cron=1776317564.8837039470672607421875
+10277s
[500]
/wp-cron.php?doing_wp_cron=1776318479.6977539062500000000000
+11192s
[500]
/wp-cron.php?doing_wp_cron=1776318576.9798610210418701171875
+11290s
[500]
/wp-cron.php?doing_wp_cron=1776318637.5911800861358642578125
+11350s
[500]
/wp-cron.php?doing_wp_cron=1776318828.9551439285278320312500
+11541s
[500]
/wp-cron.php?doing_wp_cron=1776319296.0987238883972167968750
+12009s
[500]
/wp-cron.php?doing_wp_cron=1776319886.8876829147338867187500
+12599s
[500]
/wp-cron.php?doing_wp_cron=1776320536.9674119949340820312500
+13250s
[500]
/wp-cron.php?doing_wp_cron=1776320664.5565900802612304687500
+13377s
[500]
/wp-cron.php?doing_wp_cron=1776320665.5308361053466796875000
+13378s
[500]
/wp-cron.php?doing_wp_cron=1776321218.3483970165252685546875
+13931s
[500]
/wp-cron.php?doing_wp_cron=1776321461.1609790325164794921875
+14174s
[500]
/wp-cron.php?doing_wp_cron=1776321986.8964459896087646484375
+14699s
[500]
/wp-cron.php?doing_wp_cron=1776322586.2875430583953857421875
+15299s
[500]
/wp-cron.php?doing_wp_cron=1776323186.9608759880065917968750
+15899s
[500]
/wp-cron.php?doing_wp_cron=1776323786.9392011165618896484375
+16500s
[500]
/wp-cron.php?doing_wp_cron=1776323892.7080199718475341796875
+16605s
[500]
/wp-cron.php?doing_wp_cron=1776323998.0130360126495361328125
+16711s
[500]
/wp-cron.php?doing_wp_cron=1776324189.2329390048980712890625
+16902s
[500]
/wp-cron.php?doing_wp_cron=1776324386.8934459686279296875000
+17099s
[500]
/wp-cron.php?doing_wp_cron=1776324820.8783559799194335937500
+17533s
[500]
/wp-cron.php?doing_wp_cron=1776324986.2818510532379150390625
+17699s
[500]
/wp-cron.php?doing_wp_cron=1776325167.4371919631958007812500
+17880s
[500]
/wp-cron.php?doing_wp_cron=1776325594.1967890262603759765625
+18307s
[500]
/wp-cron.php?doing_wp_cron=1776326186.9168510437011718750000
+18899s
[500]
/wp-cron.php?doing_wp_cron=1776326927.8342630863189697265625
+19641s
[500]
/wp-cron.php?doing_wp_cron=1776327397.1862230300903320312500
+20110s
[500]
/wp-cron.php?doing_wp_cron=1776327630.9865250587463378906250
+20344s
0s
20344s
Link attributes
Click a node in the graph to see its outgoing links
This page hasn't been scraped yet — no link data available.
Run scraper →
▶ show
#
Target URL
Text
Role
Placement
Rel
↗