pubsvn troubles today

Author Message

Paul Borgermans

Tuesday 14 September 2004 6:08:19 am

sorry for those who suffered difficulties on pubsvn today, search robots and websvn access caused an extra load of ~60GB on /tmp

that in turn made updates from the master repository impossible

-paul

eZ Publish, eZ Find, Solr expert consulting and training
http://twitter.com/paulborgermans

Björn [email protected]

Thursday 16 September 2004 10:24:15 am

What do you mean my load? Traffic, Diskspace or else?

I am just curious...

Looking for a new job? http://www.xrow.com/xrow-GmbH/Jobs
Looking for hosting? http://hostingezpublish.com
-----------------------------------------------------------------------------
GMT +01:00 Hannover, Germany
Web: http://www.xrow.com/

Paul Borgermans

Thursday 16 September 2004 11:35:39 am

You are so curious ;-)

It was mainly a disk space problem: when updating from zev.ez.no, the update script needs temporarily around 2.6 GB for sanity checking and correction ... websvn had generated a cache by the action of search robots and left a few hundred MB on the volume holding pubsvn. That means a complete directory with all ezp files for every revision + tar balls for all directories. Hence the 60GB :-) Furtunately, bandwidth is not a problem here.

Cheers

-paul

eZ Publish, eZ Find, Solr expert consulting and training
http://twitter.com/paulborgermans

Björn [email protected]

Thursday 16 September 2004 2:04:48 pm

I just had this idea about the robots.txt

I noticed you have it already :-) <thumb up>

http://pubsvn.ez.no/robots.txt

Did you created it just lately?

Looking for a new job? http://www.xrow.com/xrow-GmbH/Jobs
Looking for hosting? http://hostingezpublish.com
-----------------------------------------------------------------------------
GMT +01:00 Hannover, Germany
Web: http://www.xrow.com/

Paul Borgermans

Thursday 16 September 2004 3:01:07 pm

No, it was there a long time, but the rule for websvn was missing
I first thought is was a good idea to let the spiders fill the cache, now I don't think that anymore :-)
cya

-paul

eZ Publish, eZ Find, Solr expert consulting and training
http://twitter.com/paulborgermans

Powered by eZ Publish™ CMS Open Source Web Content Management. Copyright © 1999-2014 eZ Systems AS (except where otherwise noted). All rights reserved.