Why check URLs?

Next topic

Author	Message
James Packham	Tuesday 23 March 2004 2:09:43 am This isn't really related to any particular problem that I have, but why does the runcronjobs script check the validity of URLs in the database? It doesn't seem to do anything with the information and it makes the script take a lot longer to run. Regards, James
Bruce Morrison	Tuesday 23 March 2004 6:58:54 pm Hi James Links are marked invalid if they cannont be retrieved by the cron job. In the admin site go to "Setup" -> "URL management" and you will see a list of urls that appear in the content of the site (XML text and URL data types). You can click on the "invalid" tab to see links that the cron job had trouble accessing. I agree that if you are running runcronjobs.php on a regular basis then the checking of the links is overkill especially if there are a lot of them. It would be ideal if you could have the runcronjobs.php script run every 15 minutes but be able to define that the individual scripts are run say one a day or once a week. At the moment it an all or nothing proposition. Cheers Bruce My Blog: http://www.stuffandcontent.com/ Follow me on twitter: http://twitter.com/brucemorrison Consolidated eZ Publish Feed : http://friendfeed.com/rooms/ez-publish
James Packham	Monday 05 April 2004 5:27:30 am Sorry I took so long to get back. Yes it is definately overkill to check urls every 15 minutes!! It's ok at the moment, but what happens when I get a really huge database of links? I think I might have to investigate a bit, to see if I can get rid of this feature and put it in a different cron job (One that runs once a day perhaps). Thanks, James
Antoine W.	Tuesday 30 August 2005 2:37:13 am Hi, Do you think it's really needed to run runcronjobs.php every 15 minutes ? It takes more than 20 minutes to check every urls, so I cant run it so frequently... What can be wrong if I run the script only once a day ? Thanks