This page will update robots.txt to prevent indexing of problematic parameter URLs.

SUCCESS: Robots.txt updated successfully!

‘;
echo ‘

Added the following rules to prevent indexing of problematic URLs:

‘;
echo ‘

    ‘;
    echo ‘

  • Disallow: /*?amp=* (AMP parameter URLs)
  • ‘;
    echo ‘

  • Disallow: /*&amp=* (AMP parameter URLs)
  • ‘;
    echo ‘

  • Disallow: /*?noamp=* (noamp parameter URLs)
  • ‘;
    echo ‘

  • Disallow: /*&noamp=* (noamp parameter URLs)
  • ‘;
    echo ‘

  • Disallow: /product/*-copy/ (duplicate product URLs)
  • ‘;
    echo ‘

  • Disallow: /shop/oskars-surstromming-475/ (old shop URLs)
  • ‘;
    echo ‘

‘;
echo ‘

This will help prevent Google from crawling problematic URLs that cause redirect errors.

‘;
} else {
echo ‘

ERROR: Could not update robots.txt file.

‘;
}
}
else {
echo ‘

Update Robots.txt

‘;
echo ‘

This will add rules to robots.txt to prevent crawling of:

‘;
echo ‘

    ‘;
    echo ‘

  • AMP parameter URLs (?amp=1, &amp=1)
  • ‘;
    echo ‘

  • NoAMP parameter URLs (?noamp=mobile, &noamp=mobile)
  • ‘;
    echo ‘

  • Duplicate product URLs (product/*-copy/)
  • ‘;
    echo ‘

  • Old shop URLs that redirect incorrectly
  • ‘;
    echo ‘

‘;
}
?>