Forums / Developer / .txt file upload takes extremely long time

.txt file upload takes extremely long time

Author Message

Paul Kinzett

Sunday 28 October 2007 8:43:37 pm

Hi all

I have a form available to users which is the edit view of a custom class. One of the input fields on the form is file field.

When I test uploading a .txt file which contains about 5000 rows of basic data (name, email address, address, etc...) it takes almost 2 minutes to upload this file.

The file size is only 300kb.

I think it has something to do with eZCharTransform, does anyone know why this is taking so long and anyway to reduce the upload time?

Cheers,
Paul

Paul Kinzett

Tuesday 30 October 2007 3:22:21 pm

Does anyway know about this?

Let me know if I need to provide more information, im really interested in to find what is happening.

I noticed this is only an issue with .txt files, if i uploaded a .csv file with the same data is uploads in a few seconds.

Cheers,
Paul

Kåre Køhler Høvik

Wednesday 31 October 2007 12:58:32 am

Hi

I think this may be caused by the search in eZ Publish. When data is published, it'll automatically be indexed. This is probably causing the delay you're experiencing.

You can avoid this by either enabling delayed indexing ( http://ez.no/doc/ez_publish/technical_manual/3_10/reference/configuration_files/site_ini/searchsettings/delayedindexing + http://ez.no/doc/ez_publish/technical_manual/3_10/features/cronjobs/the_cronjob_scripts#indexcontent ), or try the eZ Find search extension ( http://ez.no/ezfind ). eZ Find may also be used with delayed indexing.

Kåre Høvik

Massimiliano Bariola

Wednesday 31 October 2007 9:19:15 am

+1 for Kare, yes we had the same problem when indexing pdf files. disabling the "searchable" property for the attribute solved the problem for us (it wasn't really needed and more of a slip)

Paul Kinzett

Wednesday 31 October 2007 1:40:06 pm

Thanks Kare and Massimiliano, the searchable attribute was exactly what was causing the delay.

Appreciate your help.

Cheers,
Paul

Bartek Modzelewski

Monday 11 February 2008 5:09:27 am

Hello,

This thread saved my life, client was trying to upload 1,7M txt file and we didn't know why 120 sec is not enough for really fast server to publish document :)
Because I prefer to leave "is searchable" flag marked on, it's possible to disable indexing of plain/txt files by adding into <i>settings/override </i> file <i>binaryfile.ini.append.php</i> with:

[HandlerSettings]
MetaDataExtractor[text/plain]=

Bartek

Baobaz
http://www.baobaz.com