GIJOE,

I kept seeing all these "DETAIL OF CLIPPING" listings in Google and couldn't find where they were coming from. Turns out, they are expired clippings that are building up in search engines because when the search engine comes back to check the (previously searched and listed) document, it's presented with a blank template with a page title of DETAIL OF CLIPPING.

The suggestion is to have expired documents (clippings) to provide a 404 or 410 redirect to the home page and thus search engines won't have hundreds of duplicate "DETAIL OF CLIPPING" (blank template) listings AND users can see that that particular clipping/listing has expired.

Thanks.

n

I know you've got a lot of modules to work on, so I'm trying to fix this myself...I've been looking for the php file that would allow me to tweak the "expired" listing problem, but can't find the right one.

Can you point me to the file that I can play with to get this working? IE, the file/script (or section of a file/script) that determines if a listing exists or not (and then can/should redirect via 410)?

I've found a xoops_redirect, but it doesn't seem to be it. (clipping.php)

You can see for yourself what happens on your own site - go to the following URL:

http://xoops.peak.ne.jp/md/d3pipes/index.php?page=clipping&clipping_id=258876

You'll see a "blank" template. This will happen for deleted (expired) listings as well as any clip ID that doesn't yet exist.

It provides the following server header/status of 200:

#1 Server Response: http://xoops.peak.ne.jp/md/d3pipes/index.php?page=clipping&clipping_id=258876
HTTP Status Code: HTTP/1.1 200 OK
Date: Fri, 09 Nov 2007 19:29:06 GMT
Server: Apache

Which search engines will think is a real document.

Thanks.

n

hi Nobelium.

It's certainly a bug.

Thank you for the reporting.

I've just fixed it in d3pipes-0.58
Try it.

Thank you very much GIJOE - I'll try it this weekend!

n

GIJOE,

Thanks for the bug fix on d3pipes and the expired clippings.

I've installed it on a test site and see that the fixed redirect does not give a 404 or 410 status code when an invalid clipping is accessed.

#1 Server Response: http://anydomain.com/x/modules/58/index.php?page=clipping&clipping_id=508
HTTP Status Code: HTTP/1.1 200 OK
Date: Mon, 12 Nov 2007 16:11:13 GMT
Server: Apache/1.3.33 (Unix)

This will (does) result in numerous expired clippings being indexed by search engines and results in identical pages with multiple URLs (duplicate content). With enough duplicate content pages, the search engines penalize ALL of the site.

Is there any way to make this a 410 redirect?

Thanks.

n

It is just a standard redirection page.
Perhaps, googlebot can recognize such redirection pages by meta tag rightly.

If you want a status other than 200 anyway, try this.

http://xoops.peak.ne.jp/md/news/index.php?page=article&storyid=70

Though it's 302 redirection instead of 410 gone.

Thanks for the alternative.

Maybe I'll just wait and see what googlebot does with this fix first before I hack those files. Could work out fine.

best,

n