Forums / Install & configuration / PDF indexing
Michael Hall
Wednesday 05 March 2008 4:15:08 am
Does EZ4's search indexing capability include indexing PDF files?
Tony Wood
Wednesday 05 March 2008 5:06:47 am
For this I would recommend using eZ Find. It is based on Lucene so does a very good job.
Tony Wood : twitter.com/tonywood Vision with Technology Experts in eZ Publish consulting & development Power to the Editor! Free eZ Training : http://www.VisionWT.com/training eZ Future Podcast : http://www.VisionWT.com/eZ-Future
Wednesday 05 March 2008 4:40:35 pm
OK, well I got the old PDF indexing working using pdftotext ... much the same mechanism as good old htdig.
eZ Find seems to be the way to go, even though it means adding a JRE to the server to run it.
We'll be indexing quite large PDF files (historical newspaper collection).
I'm yet to run a trial, but I'm wondering how eZFind works at the database end and whether potentially very large chunks of data will cause problems, as seemed to happen with the old system?
Also, does anyone know if eZ Find uses some kind of stop list (list of common functional words with little semantic content like "the, a, and, it" etc)?At a glance, the older system doesn't seem to filter these out. These words are among the most commonly used, and filtering them out of results can significantly reduce the amount of data needing processing without having much impact on the effectiveness of a search.
Andy Caiger
Tuesday 18 May 2010 1:28:41 am
Although using eZ Find has been recommended, it's quite a bit of work to get it working. It does seem that Exponential 4 does not index PDFs. Can anyone explain how to get it working without installing eZ Find? I'm using Exponential 4.2.
EAB - Integrated Internet Success Offices in England, France & China. http://www.eab.co.uk http://www.eab-china.com http://www.eab-france.com
Gaetano Giunta
Tuesday 18 May 2010 9:51:58 am
All you need to do is to edit the
[PDFHandlerSettings] TextExtractionTool=pstotext
block in binaryfile.ini.
I'd recommend to substitute pstotext with the name of a cli script you have written. That script can simply echo to a log file the current date and the parameters it receives (1st one is the path to the pdf file to be converted to plain text).
This will get you started with debugging
Principal Consultant International Business Member of the Community Project Board
Tuesday 18 May 2010 6:55:21 pm
Thanks! This is a great idea and helped me solve the problem quickly, together with advice given at http://ez.no/Exponential/documentation/configuration/optimization/speeding_up_acrobat_pdf_document_indexing_
:-)