cat.lump.aq.textextraction.wikipedia.prepro

Class PlainTextPreprocess

java.lang.Object

java.lang.Thread

cat.lump.aq.textextraction.wikipedia.prepro.AbstractPreprocess

cat.lump.aq.textextraction.wikipedia.prepro.PlainTextPreprocess

All Implemented Interfaces:

java.lang.Runnable

public class PlainTextPreprocess
extends AbstractPreprocess

Preprocess a Wikipedia page using JWPL API.
Extracts the text of the page except the tables and some special sections. That text is split into sentences.

Author:

jboldoba

Nested Class Summary

Nested classes/interfaces inherited from class java.lang.Thread

java.lang.Thread.State, java.lang.Thread.UncaughtExceptionHandler

Field Summary

Fields inherited from class cat.lump.aq.textextraction.wikipedia.prepro.AbstractPreprocess

locale, rootDirectory, wiki

Fields inherited from class java.lang.Thread

MAX_PRIORITY, MIN_PRIORITY, NORM_PRIORITY

Constructor Summary

Constructors

Constructor and Description
PlainTextPreprocess(TypePreprocess type, java.lang.String name, java.util.Locale language, int year, java.io.File rootDirectory)

Method Summary

Methods

Modifier and Type	Method and Description
java.util.ArrayList<java.lang.String>	preprocess(int id) Function which implements the preprocessing procedure.

Methods inherited from class cat.lump.aq.textextraction.wikipedia.prepro.AbstractPreprocess

addPage, addPages, getInstance, getType, removePage, run, skipPage, writePreprocessing

Methods inherited from class java.lang.Thread

activeCount, checkAccess, clone, countStackFrames, currentThread, destroy, dumpStack, enumerate, getAllStackTraces, getContextClassLoader, getDefaultUncaughtExceptionHandler, getId, getName, getPriority, getStackTrace, getState, getThreadGroup, getUncaughtExceptionHandler, holdsLock, interrupt, interrupted, isAlive, isDaemon, isInterrupted, join, join, join, resume, setContextClassLoader, setDaemon, setDefaultUncaughtExceptionHandler, setName, setPriority, setUncaughtExceptionHandler, sleep, sleep, start, stop, stop, suspend, toString, yield

Methods inherited from class java.lang.Object

equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

PlainTextPreprocess

public PlainTextPreprocess(TypePreprocess type,
                   java.lang.String name,
                   java.util.Locale language,
                   int year,
                   java.io.File rootDirectory)
                    throws WikiApiException

Throws:

WikiApiException

Method Detail

preprocess

public java.util.ArrayList<java.lang.String> preprocess(int id)
                                                 throws WikiApiException

Description copied from class: AbstractPreprocess

Function which implements the preprocessing procedure.

Specified by:

preprocess in class AbstractPreprocess

Returns:

A list of text fragments which are the result of the preprocessing.

Throws:

WikiApiException