Rewrite and search engines

Discuss practical ways rearrange URLs using mod_rewrite.

Postby alex » Wed May 15, 2002 2:22 pm

Hi
have anyone experience with rewrite and search engines?
the problem is
we have just rewrited all dynamic urls
like www.......?ID=123
with www......./productName/index123.html
with main idea to be indexed better and to allow search for dyanmic content

but - that links are NOT indexed
not rewrited link www.......?ID=123 submitted manually - indexed, but rewrited ones - not
Any experience why?
seems nothing wrong with technigue itself - it just helps spider to determine proper content to index from dyanmical pages
alex
 
Posts: 2
Joined: Tue May 14, 2002 4:00 pm

Postby Brett » Wed May 15, 2002 9:39 pm

Try using a tool like web-sniffer to see what headers are being generated for various files, and see what the difference is between the documents that get indexed and those that do not get indexed.
Brett
 
Posts: 82
Joined: Tue Jul 10, 2001 4:00 pm
Location: yohost.com

Postby alex » Thu May 16, 2002 6:03 am

Thanks for help.
problem is - they looks identical

googlebot is visiting our pages, but never gows inside. Statical links like ....learningcenter.php are indexed.
But catalog is not. he even do not wish to go inside. Manual submission of catalog parts (any leaf inside it ) - no results. it does not visit it. See www_rus-sell_com - maybe it will give you some ideas?
thanks again,
Alex
alex
 
Posts: 2
Joined: Tue May 14, 2002 4:00 pm

Postby Brett » Thu May 16, 2002 11:46 am

It wouldn't surprise me if the "set-cookie" header scares off Googlebot, but I don't actually know what Google's cookie policy is.
Brett
 
Posts: 82
Joined: Tue Jul 10, 2001 4:00 pm
Location: yohost.com


Return to Friendly URLs with Mod_Rewrite

Who is online

Users browsing this forum: No registered users and 7 guests

cron