robots.txt & Sitemap Tester
Ngetik URL situs mana wae. Kami nyandak robots.txt sareng sitemap.xml ti server kami, nunjukkeun anjeun kaputusan crawl sareng sitemap anu dinyatakeun, sareng ngabéjaan URL sitemap string query anu nyababkeun demotions konten duplikat.
Carane nyoba robots.txt lan sitemap.xml
Papat léngkah, tanpa ngadaptar. Saben pariksaan dilaksanakeun dina sisi panyedhiya.
_Petik URL situs
Enter any site's homepage URL. You don't need the full path to robots.txt, because we derive it from the host.
Kita njupuk saka server kita
Server urang requests robots.txt sarta unggal sitemap.xml dinyatakeun, jadi tes teu diblokir ku browser anjeun atawa cache sorangan.
Waca pedoman lan sitemaps
Ngawaca grup user-agent anu dianalisis, henteu ngamungkinkeun aturan sareng daftar sitemap anu dinyatakeun, sareng conto URL ti masing-masing.
Nyahpasang apa sing ditanda
Ngalereskeun URL sitemap string query atanapi konflik anu diblokir-tapi diindeks sateuacan mesin pencari ngaleupaskeun duplikat.
Apa sing dites dening tester iki
Sacara umum, panulis bisa nulis dina basa anu béda-béda.
Instruksi Crawl
Ngawaskeun unggal grup user-agent sarta aturanna Allow / Disallow supados anjeun tiasa ningali persis naon anu diblokir.
Sitemaps dinyatakake
Robots.txt minangka file sing ngandung informasi babagan cara robots.txt digunakaké kanggo ngakses situs web.
Текстовая запись
Digunakeun pikeun ngagambarkeun URL anu dipikabutuh pikeun ngajalankeun halaman wéb anu dipikabutuh.
Njupuk kesehatan
Catches sitemaps declared in robots.txt that error, redirect, or return non-XML. These are silent crawl killers.
Takon-takon kang kerep diajukake
Ngjalanake ing pipa sampeyan
This tester runs entirely server-side. You submit a URL, our backend fetches and parses robots.txt and the declared sitemaps, then re-renders this page with the results. A programmatic REST API for CI/CD and bulk auditing is available on the paid managed plans. Lihat rencana →
Nggunakake kanthi program
Every tool is available through one authenticated REST API on the Pro and API plans. Wire it into your CI, CMS, or dashboards.