Set Robot txt File For Blogger Blog For More Search Traffic | Easymadeblog


Set Robot txt File For Blogger Blog For More Search Traffic

Did you know you can improve your search traffic (organic traffic) by setting a simple, but the best robot txt file for your blog by increasing the number of posts being indexed and blocking some irrelevant pages to appear on Google search engine?

That is, you can change the number of posts you want Google to index, and also stop some certain pages from being indexed by Google.


Robot.txt file is used to inform robots (spiders, crawlers, etc. sent by search engines) about your blog, its structure and to tell whether or not to crawl your blog posts or pages on your blog.

You as a blogger would like individual posts or pages of your site to be indexed and crawled by search engines, while you may prefer other irrelevant pages not to be crawled.

My robot.txt file may be different from your own, depending on choice.

However, for the sake of being a newbie, I don't want you to lay your hands on editing many codes because incorrect use of this code below may result in your blog being ignored by search engines.

So, I have made it easy for you by giving you a simple file you can easily edit with your blog link ONLY.

Below is the method to set up the best robot.txt file you should use:

==> On your blogger dashboard, go to “Settings” >> “Search preference” >> “Crawlers and Indexing

==> Click the “Edit” button near the “Custom robot.txt” and check the “Yes” checkbox

==> Paste the code below:

User-agent: Mediapartners-GoogleUser-agent: *
Disallow: /search
Allow: /

==> Change the “” in red ink to your blog address. Then save

The sitemap I used above will let Google search engines index up to 1000 posts on your blog, unlike the default which is just 25 posts.

But in case you don't want a particular post or page to be indexed,

Simply change the "search" in line 3 of the code to the post or page permalink. It should look like this:

User-agent: Mediapartners-GoogleUser-agent: * 
Disallow: /year/month/post-permalink 
Allow: / 


User-agent: Mediapartners-GoogleUser-agent: *
Disallow: /p/page-url.html
Allow: /

This is an example of one of my posts below:

And a page on my blog:
Let's assume I don't want either of the above to be indexed by Google search engine, I will just copy the highlighted text above and replace with the "search" as it was explained above.

And this way, you're done!


Use the robot txt file with caution in order not to make your blog being ignored by Google search engines.

Let me know if you would like me to help you set the robot txt file for your blogger blog.

Be Kind,Share this with your friends using the share buttons below:


  1. Nice one here, I've just applied it on meanwhile I'm still having difficulty in verifying my BLOG To google search console. Can you help?

    1. Yes. I can. Contact me using the contact page.

  2. Nice post bro.. I just added this to my blog. My blog is not indexed by Google I don't know if you can help. Thank you

    Commenting from


Have you got anything to say about this post? Let's hear your thoughts in the comment box. Sign in as "Anonymous" to bypass verification.

You can also use the Facebook comment box above to reply to this post with your Facebook ID.

Make sure you check the "NOTIFY ME" checkbox to get updates when your comments are replied to.