Hi! You can try to log in to your WordPress dashboard and navigate to Rank Math > General Settings. Go to Edit Robots.txt (usually found under General Settings or Titles & Meta in Rank Math). If the file is completely empty, you might see an option to create or edit the robots.txt file directly within Rank Math. Here is a simple template you can add, which works well for most websites: User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php User-agent: * means these rules apply to all web crawlers. Disallow: /wp-admin/ prevents crawlers from accessing the WordPress admin area. Allow: /wp-admin/admin-ajax.php permits access to the admin-ajax.php file, which is often needed for site functionality.
Thank you for the detailed video. I wish I watched that yesterday Would save me so much time. I have a question. Would you personally leave Disallow: area blank or will add /wp-admin/? my website is 3 months old
Hello! The "/" in a robots.txt file indicates the root directory of your website. It tells web crawlers whether they are allowed to access and crawl all content from the root level down 🙌
Build your website with Hostinger web hosting today 👉bit.ly/3wG4vFK
💥 Use the discount code WP10 to get 10% OFF!
The level of your content is really outstanding 👏
very good you explained well about the robot.
Thanks!
Very nice 👍▶️
I have a rank math plugin, but the Robots.txt file is empty and I don't know how to create it from scratch
Hi! You can try to log in to your WordPress dashboard and navigate to Rank Math > General Settings. Go to Edit Robots.txt (usually found under General Settings or Titles & Meta in Rank Math). If the file is completely empty, you might see an option to create or edit the robots.txt file directly within Rank Math.
Here is a simple template you can add, which works well for most websites:
User-agent: *
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php
User-agent: * means these rules apply to all web crawlers.
Disallow: /wp-admin/ prevents crawlers from accessing the WordPress admin area.
Allow: /wp-admin/admin-ajax.php permits access to the admin-ajax.php file, which is often needed for site functionality.
Thank you for explaining!
how to do it on Hostinger website builder ؟ i dont use wordpress
please help me
Hi! Hostinger's Website Builder doesn't have the robots.txt file. Please send us a message at hstn.gr/LiveChat and we'll help you!
Hello, I changed the robots.txt file in yoast seo. but it is not reflected in robots.txt file
Hey there!
Make sure to clear cache of your web browser, as well your websites cache. If it continues, drop us a message at support@hostinger.com 😊
Thank you for the detailed video. I wish I watched that yesterday Would save me so much time. I have a question. Would you personally leave Disallow: area blank or will add /wp-admin/? my website is 3 months old
better to keep disallow
Nice video 👍👍👍
Thanks for helpful videos
It's my pleasure 💜
file editor not showing up in my tool
What is the use of "/" in robots.txt file
Hello! The "/" in a robots.txt file indicates the root directory of your website. It tells web crawlers whether they are allowed to access and crawl all content from the root level down 🙌
Awesome
Unfortunatelly yoast SEO removed this option in the last updats