Got massive duplicate content issues

[nationalcycles]

I use oscommerce to as a shopping cart base and have used an seo product to change my links. The problem i have is that all my pages have been indexed in supplimental in both php and html extensions. It changes the url completely.
I have searched everywhere including this forum on how i can fix this and what i am looking for is the following.

In .htaccess a way to send a 404 to all .php extensions.
or
In .htaccess a way to send a 404 to all non html extensions

If someone can direct me to the right place and also confirm if this will affect my index page - http://www.nationalcycles.co.uk.

Please - I need help.

[richardk]

For a 404, try

Code: Select all

Options +FollowSymLinks

RewriteEngine On

RewriteCond %{ENV:REDIRECT_STATUS} ^$
RewriteRule ^.+\.php$ /a_path_that_doesnt_exist [L]

Or for a 410 (Gone) status replace

Code: Select all

RewriteRule ^.+\.php$ /a_path_that_doesn't_exist [L]

with

Code: Select all

RewriteRule ^.+\.php$ - [G,L]

Or you could redirect to the .html URL by replacing

Code: Select all

RewriteRule ^.+\.php$ /a_path_that_doesn't_exist [L]

with

Code: Select all

RewriteRule ^(.+\.)php$ /$1html [R=301,L]

[nationalcycles]

Wow, that was quick and thanks for the advice.
I tried what you suggested but it conflicts with my php images but not sure how and other links.
To avoid this I think there might be another way to resolve my issue. As the duplicate links (3000+) are all in two formats;

www.nationalcycles.co.uk/product_info.p ... s_id=30037
and
www.nationalcycles.co.uk/index.php?cNam ... kes-4-bmxs

So my idea is can we send a 410 to all urls that include "products_id=" and "cName=" within the url.

I'm not sure if this is possible but i'll be happy if you could let me know.

P.S - I value your time and would like to donate to the continuation of this website, is this possible?

[richardk]

So my idea is can we send a 410 to all urls that include "products_id=" and "cName=" within the url.

Try

Code: Select all

Options +FollowSymLinks

RewriteEngine On

RewriteCond %{QUERY_STRING} ^(.*&)?(products_id|cname)= [NC]
RewriteRule ^.+\.php$ - [G,L]

If it doesn't work, post your current mod_rewrite.

[nationalcycles]

Excellent, it works!
I've added some others to the code:
RewriteCond %{QUERY_STRING} ^(.*&)?(products_id|cname|pName|cPath)= [NC]
RewriteRule ^.+\.php$ - [G,L]
However, i tried to add "-c-" without success. - Your a genius!

[richardk]

However, i tried to add "-c-" without success.

Where did you try to add it? Could you give an example of a URL with "-c-" in it?

Also try

Code: Select all

^(.*&)?([^=]*-c-[^=]*|products_id|cname|pName|cPath)=

[nationalcycles]

Examples to add (-p- | -c-)
www.nationalcycles.co.uk/-c-1498_1501.html
www.nationalcycles.co.uk/diamondback-lucky-p-30414.html

I tried to add it to:
RewriteCond %{QUERY_STRING} ^(.*&)?(products_id|cname|pName|cPath|-c-|-p-)= [NC]

Cheers
William

[richardk]

It's not part of the query string.

Code: Select all

Options +FollowSymLinks

RewriteEngine On

RewriteRule ^.*-(p|c)-.*\.html$ - [G,L]

RewriteCond %{QUERY_STRING} ^(.*&)?(products_id|cname|pName|cPath)= [NC]
RewriteRule ^.+\.php$ - [G,L]

You could also use a robots.txt file.