cat.lump.ir.lucene.engine

Class WTAnalyzer

java.lang.Object

Analyzer

cat.lump.ir.lucene.engine.WTAnalyzer

public class WTAnalyzer
extends Analyzer

Modification of the standard Lucene Analyzer to mimic the preprocess and term extraction used in the Wikiparable experiment

Since:

June 16, 2015

Author:

cristina

Constructor Summary

Constructors

Constructor and Description
WTAnalyzer(Version LUCENE_VERSION, java.util.Locale lan)

Method Summary

Methods

Modifier and Type	Method and Description
java.lang.String	readFully(java.io.Reader reader)
TokenStream	tokenStream(java.lang.String fieldName, java.io.Reader reader) Pipeline for the analyser.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

WTAnalyzer

public WTAnalyzer(Version LUCENE_VERSION,
          java.util.Locale lan)

Method Detail

tokenStream

public TokenStream tokenStream(java.lang.String fieldName,
                      java.io.Reader reader)

Pipeline for the analyser. The text is retrieved and the preprocess and term extraction is done using the TermExtractor class used within Wikiparable. No extra work by Lucene is allowed other than indexing.

Parameters:

fieldName -

reader -

Returns:

stream

readFully

public java.lang.String readFully(java.io.Reader reader)
                           throws java.io.IOException

Throws:

java.io.IOException