Menu Content

Support

> Forums, FAQs & Paid Support
Welcome, Guest
Username Password: Remember me

robots.txt
(1 viewing) (1) Guest
SEO component and search engine friendly URLs manager for Joomla!

If your topic falls within one of the subcategories, then please post it directly there. Post to this parent category only if your question does not match any subcategory topic.
  • Page:
  • 1

TOPIC: robots.txt

robots.txt 12 years, 9 months ago #23305

  • Mbit
  • OFFLINE
  • Posts: 35
All my pages are automatically being created as SEF URLs.. meaning they are being redirected from
index.php?option=com_virtuemart&category_id=75&flypage=vmj_genx.tpl&manufacturer_id=9&page=shop.product_details&product_id=13
to something like
/category1/product1

i got some pages in webmasters that are not being creating as a new sef url.. :/
if i disallow from robots.txt the crawling of pages that have in the url a parameters like index.php..

will this cause any issues? meaning, the crawling will stop at the first url before the redirection and wont crawl either the sef url or i ll crawl the new sef created???
The topic has been locked.

Re: robots.txt 12 years, 8 months ago #23841

  • jaku
Hello,

if the record created in robots.txt is correct, then it should not cause any troubles.
The topic has been locked.

Re: robots.txt 12 years, 7 months ago #23862

  • Mbit
  • OFFLINE
  • Posts: 35
but if the "index.php?option=com_virtuemart&category_id=75&flypage=vmj_genx.tpl&manufacturer_id=9&page=shop.product_details&product_id=13" got disallowed , then the redirections of these pages will be crawled? The spider wont stop when see a disallow?
The topic has been locked.

Re: robots.txt 12 years, 7 months ago #24102

  • Habbakuk
If the url it redirects to doesn't have "index.php" within the URL, it will still be crawled. So, there isn't a problem. Replica Watches Swiss Replica Watches Fake Watches Rolex Replica Watches
Last Edit: 12 years, 7 months ago by .
The topic has been locked.
  • Page:
  • 1
User Login Empty