robots. txt & Umvavanyi Wendawo Yovavanyo
Ngenisa nayiphi na indawo URL. Sifumana i robots.txt kunye sitemap.xml ukusuka kwiseva yethu, sikubonisa i crawl imiyalelo kunye ne sitemaps ezixhonywe, kwaye iphawule i-query-string sitemap URLs ezibangela ukudubula-imixholo demotions.
Indlela yovavanyo robots.txt kunye sitemap.xml
Iindlela ezine, akukho ubhaliso. Uvavanyo olupheleleyo luyasebenza kwicala lomncedisi.
Cola i URL yenxuwa
Ngenisa i-URL yephepha lokungena lendawo. Awufuni indlela epheleleyo ye-robots.txt, kuba siyifumana kwinginginya.
Sifumana kwiseva yethu
Umncedisi wethu ucela i robots.txt kunye nesitemap.xml nganye ekhankanywe, ngoko uvavanyo aluthintelwanga ngumkhangeli wakho okanye i-cache yakho.
Funda izikhokelo ne-sitemaps
Ikhangela iqela eliguqulwe kancinane lomsebenzisi- umququzeleli, ivumelanise imithetho noluhlu lwee-sitemap ezixhonywe, nge URL yomz. ukusuka nganye.
Ilungisa into ephawulwe
Resolve any query-string sitemap URLs or blocked-but-indexed conflicts before a search engine demotes the duplicates.
Izinto eziluncedo
Iindawo zokhuselo ezifanayo siziqhuba ngaphakathi phambi kokuba sipapashe iphepha elinye.
Imiyalelo yokukhangela
Ichaza ngokuzenzekelayo iqela ngalinye lomsebenzisi-ummeli kunye ne Vumela / Sukuvumela imithetho yayo ukuze ubone ngokucacileyo into ethintelwe.
Ii-sitemaps ezikhankanyiweyo
Ibonisa iimaphu zonke zendawo ezibhekiswe kuzo kwi robots. txt, ifumana nganye, kwaye ixela uhlobo lwayo kunye nobalo lwe URL.
Umbuzo-umtya okhawulezayo
Iiflegi zombuzo-umtya we-URL ye-sitemap eziqhakaza iphepha elifutshane eliphindaphindwayo kwaye ziqhube ukuphindaphindwa-umxholo wokuhla.
Fumana ukhuseleko
Ithatha iimaphu zesixeko ezichazwe kwi robots.txt ukuba iimpazamo, ikhokelela, okanye ibuyisela i-XML engasebenziyo. Ezi zii-crawl zombini ezizinyamalalayo.
Imibuzo ebuza rhoqo
Sebenzisa kwi-pipeline yakho
Le tester iqhuba ngokupheleleyo i-server-side. Uthumela i-URL, i-backend yethu ifumana kwaye ichaza i-robots.txt kunye ne-sitemaps ekhankanywe, emva koko iphinde ibonise eli phepha ngeempumelelo. I-REST API ye-programmic ye-CI / CD kunye novavanyo olukhulu lufumaneka kwi-paid managed plans. Iinkqubo →
Sebenzisa ngokuzenzekelayo
Isixhobo ngasinye sifumaneka ngenye i-REST API eqinisekisiweyo kwi-Pro kunye ne-API iinzame. Intambo ikwi-CI yakho, i-CMS, okanye i-dashboards.