Jump to content


Photo

Duplicate Urls

.htaccess

  • Please log in to reply
No replies to this topic

#1 ubique

ubique

    RAGE Newbie

  • RAGE Members
  • Pip
  • 3 posts

Posted 04 June 2013 - 12:27 PM

I've noticed that SA is ignoring the robots.txt file when scanning my site. I have code in the .htaccess file that removes any URL with a trailing hash - but SA still includes the non and slash versions as two separate URLs?






0 user(s) are reading this topic

0 members, 0 guests, 0 anonymous users