Register

Robots.txt file and 301 redirect issue

Basic discussions about SEO
Posts: 71
Joined: Thu Sep 07, 2017 3:40 am

Robots.txt file and 301 redirect issue

Postby brad21 » Thu Oct 18, 2018 3:41 am

Here is an issue. The www version of the site is blocked through robots.txt file for the search engines. Now, if any actual user end up landing in the www versions then they are 301 redirected to the non-www version of the site.

Now the site has gained some good links but they are on the www version. So, here is my query, will the search engines be able to index those backlinks?

User avatar
Posts: 821
Joined: Wed Sep 18, 2013 3:24 am

Re: Robots.txt file and 301 redirect issue

Postby frank » Thu Oct 18, 2018 3:44 am

Change your robots.txt file that will be the first thing for you to do. Search engines can't crawl and index if they can't see the 301 redirects.

Posts: 251
Joined: Tue Nov 08, 2016 3:13 am

Re: Robots.txt file and 301 redirect issue

Postby danni » Sat Oct 20, 2018 4:22 am

Make them non-index but crawable.

Return to SEO General

Who is online

Users browsing this forum: Google Adsense [Bot], jonathan brown and 1 guest