PDF indexing

Author Message

Michael Hall

Wednesday 05 March 2008 4:15:08 am

Does EZ4's search indexing capability include indexing PDF files?

Tony Wood

Wednesday 05 March 2008 5:06:47 am

For this I would recommend using eZ Find. It is based on Lucene so does a very good job.

Tony Wood : twitter.com/tonywood
Vision with Technology
Experts in eZ Publish consulting & development

Power to the Editor!

Free eZ Training : http://www.VisionWT.com/training
eZ Future Podcast : http://www.VisionWT.com/eZ-Future

Michael Hall

Wednesday 05 March 2008 4:40:35 pm

OK, well I got the old PDF indexing working using pdftotext ... much the same mechanism as good old htdig.

eZ Find seems to be the way to go, even though it means adding a JRE to the server to run it.

We'll be indexing quite large PDF files (historical newspaper collection).

I'm yet to run a trial, but I'm wondering how eZFind works at the database end and whether potentially very large chunks of data will cause problems, as seemed to happen with the old system?

Also, does anyone know if eZ Find uses some kind of stop list (list of common functional words with little semantic content like "the, a, and, it" etc)?
At a glance, the older system doesn't seem to filter these out. These words are among the most commonly used, and filtering them out of results can significantly reduce the amount of data needing processing without having much impact on the effectiveness of a search.

Andy Caiger

Tuesday 18 May 2010 1:28:41 am

Although using eZ Find has been recommended, it's quite a bit of work to get it working. It does seem that eZ Publish 4 does not index PDFs. Can anyone explain how to get it working without installing eZ Find? I'm using eZ Publish 4.2.

EAB - Integrated Internet Success
Offices in England, France & China.
http://www.eab.co.uk http://www.eab-china.com http://www.eab-france.com

Gaetano Giunta

Tuesday 18 May 2010 9:51:58 am

All you need to do is to edit the

 [PDFHandlerSettings]

TextExtractionTool=pstotext

block in binaryfile.ini.

I'd recommend to substitute pstotext with the name of a cli script you have written. That script can simply echo to a log file the current date and the parameters it receives (1st one is the path to the pdf file to be converted to plain text).

This will get you started with debugging

Principal Consultant International Business
Member of the Community Project Board

Andy Caiger

Tuesday 18 May 2010 6:55:21 pm

Thanks! This is a great idea and helped me solve the problem quickly, together with advice given at http://ez.no/ezpublish/documentation/configuration/optimization/speeding_up_acrobat_pdf_document_indexing_

:-)

EAB - Integrated Internet Success
Offices in England, France & China.
http://www.eab.co.uk http://www.eab-china.com http://www.eab-france.com

Powered by eZ Publish™ CMS Open Source Web Content Management. Copyright © 1999-2014 eZ Systems AS (except where otherwise noted). All rights reserved.