What is the Robots.txt file or why and how to add robot.txt file in the blogger?

robots.txt plays a very important role in search engine optimization, Add robot.txt file.

What is the Robots.txt file or why and how to add it to the blogger?

how to add robot.txt file in the blogge
Robot.txt

There are many bloggers who don't understand the Robots.txt option or never bother with this option. They think that this option is not a work, it simply leaves it empty. In fact, this option plays a very important role in search engine optimization. And if you continue blogging without search engine optimization, your chances of getting enough visitors to your blog will be reduced. However, by activating this option, if you do not understand the Robots.txt file copy option, you can turn it off if it is not good. For this, you need to know the details before activating it.

Robots.txt file key:

Every search engine has its own web robot. You might be wondering what it is like in Rajini Kant's Hindi movie robot. In fact, it is not something of the sort. This is a type of web function, called a robot, to test the type of website that a search engine has. And the Robots.txt file indicates to those robots whether they will crawl and index your blog/website. You can also allow the robot to crawl and index using this Robot.txt file if you wish. If you wish, you can allow Crawl and Index to post anything you need, and you may not allow Crawl and Index to posting anything.

Click here to learn how to increase the crawl rate

How does this Robots.txt file work?

The Robots.txt file is like an airport flight announcer. Just like the way he tells passengers to get on the plane when it's time to fly, the Robots.txt file also tells search engines to index their blog posts when it's time to crawl. As a result, your newly posted new article will be easily returned to the search engine.
User-agent: *
Disallow: /search
Allow: /
Sitemap: http://freelancingbangla.info/sitemap.xml
Most blogs have this type of Robots.txt file. Maybe you never even understood or used your blog yet. I want you to understand this completely and then add it to the blog. I will try to explain it separately in two parts. First, I will discuss these parts and then shoot the corresponding symbols.
  • User-agent: Media partners-Google: First of all, user-agent refers to robots. Here is Media partners-Google, a Google Adsense robot. If you are using Google Adsense on your blog then it should be added. If you disable this option, Adsense Robot will not have any idea about the ads on your blog. If you have not used Google Adsense, then delete the red color line two.
  • User-agent:* All types of robots are interpreted using User-agent: *. When you use the * sign after the user-agent, it means that you are directing all types of robots.
  • Disallow: / search This prompts you to Disallow keywords. That is, your blog's search links are being asked to not crawl and index. For example, when you look at the Label links on your blog, you will see that every Label link has this search term. This is why the robot is instructed not to crawl Label links. Because Label links do not need to be indexed in search engines.
  • Allow: / It is instructed to allow the keyword. This '/' sign means that the robot will crawl and index your blog's home page. As you can see after submitting the Google Webmaster Tools site, Google Webmaster Tools is always indexing more posts than you do. In fact, it's not even counting your Home Page.
  • Sitemap: When you post a new post it will tell the robots to index the new posts. Every default Blogger has a Sitemap. But by default, no more than 20 posts are indexed. This requires adding this Sitemap link to the Robots.txt file as well as submitting it to Google Webmaster Tools.

How to add Robot.txt file in a blog?

  • From the Blogger dashboard, click Settings> Search Preference.
  • Then click the Edit button of Custom Robots.txt. In the figure below -
User-agent: *
Disallow: /search
Allow: /
Sitemap: http://freelancingbangla.info/sitemap.xml
  • Then click on Yes of Enable custom robots.txt content and you will see a box. Copy and paste the code above into this box.
  • Then click on Save and exit.

COMMENTS

Name

Adsense info,4,Banglalink sim offer 2020,1,blogger 2020,2,business idea,1,download,1,email marking,1,graphic design,2,Hindi movie download best 5 site,1,hindi movie download site,1,HSC routine 2020,1,JSC result 2019,1,logo design,1,make money online,1,result,1,Review,1,routine,2,SEO,13,Sim offer,1,SSC routine 2020,1,windows 10,1,youtube downloader,1,
ltr
item
Freelancing Bangla- Make money ideas for students.: What is the Robots.txt file or why and how to add robot.txt file in the blogger?
What is the Robots.txt file or why and how to add robot.txt file in the blogger?
robots.txt plays a very important role in search engine optimization, Add robot.txt file.
https://1.bp.blogspot.com/-mlnPp1a2O4w/XW6g_ZLsKdI/AAAAAAAAAjI/HpeEBCe7B6UmZ7Ny0gOEiJ8nbFq8H2XEgCLcBGAs/s640/robot%2Btxt.png
https://1.bp.blogspot.com/-mlnPp1a2O4w/XW6g_ZLsKdI/AAAAAAAAAjI/HpeEBCe7B6UmZ7Ny0gOEiJ8nbFq8H2XEgCLcBGAs/s72-c/robot%2Btxt.png
Freelancing Bangla- Make money ideas for students.
http://www.freelancingbangla.info/2019/09/Add-robot.txt-file-in-blogger.html
http://www.freelancingbangla.info/
http://www.freelancingbangla.info/
http://www.freelancingbangla.info/2019/09/Add-robot.txt-file-in-blogger.html
true
894244828904692107
UTF-8
Loaded All Posts Not found any posts VIEW ALL Readmore Reply Cancel reply Delete By Home PAGES POSTS View All RECOMMENDED FOR YOU LABEL ARCHIVE SEARCH ALL POSTS Not found any post match with your request Back Home Sunday Monday Tuesday Wednesday Thursday Friday Saturday Sun Mon Tue Wed Thu Fri Sat January February March April May June July August September October November December Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec just now 1 minute ago $$1$$ minutes ago 1 hour ago $$1$$ hours ago Yesterday $$1$$ days ago $$1$$ weeks ago more than 5 weeks ago Followers Follow THIS PREMIUM CONTENT IS LOCKED STEP 1: Share. STEP 2: Click the link you shared to unlock Copy All Code Select All Code All codes were copied to your clipboard Can not copy the codes / texts, please press [CTRL]+[C] (or CMD+C with Mac) to copy