cat.lump.ir.sim.cl.clesa

Class SimilarityCLESAdocs

java.lang.Object

cat.lump.ir.sim.ml.esa.Esa

cat.lump.ir.sim.ml.esa.SimilarityESA

cat.lump.ir.sim.cl.clesa.SimilarityCLESA

cat.lump.ir.sim.cl.clesa.SimilarityCLESAdocs

All Implemented Interfaces:

Similarity

public class SimilarityCLESAdocs
extends SimilarityCLESA

Implementation of Explicit Semantic Analysis as described in:
Gabrilovich, Evgeniy, and Shaul Markovitch. "Computing Semantic Relatedness Using Wikipedia-based Explicit Semantic Analysis". 1606–1611. Hyderabad, India, 2007.

For this version the inverted index is based on Lucene.
In brief, the process is as follows. Given two documents d₁ and d₂:

• query d₁ (d₂) to the previously generated index (generated with LuceneIndexer)
• retrieve and normalise the resulting relevance vectors for d₁ (d₂)
• compute the cosine similarity between the vector representations d₁ and d₂

Process in the main method could be considered an example.

Since:

April 18 2012

Version:

0.2.1

Author:

albarron

See Also:

cat.basset.ir.index.LuceneIndexer#

Field Summary

Fields inherited from class cat.lump.ir.sim.ml.esa.SimilarityESA

esaGen, objectA, objectB, overrideObjects, textsA, textsB

Fields inherited from class cat.lump.ir.sim.ml.esa.Esa

esaVectorsA, esaVectorsB, log

Constructor Summary

Constructors

Constructor and Description
SimilarityCLESAdocs(java.lang.String indexApath, java.lang.String indexBpath, java.io.File documentsApath, java.io.File documentsBpath, java.lang.String lanA, java.lang.String lanB, boolean overrideObjects)

Method Summary

Methods

Modifier and Type	Method and Description
protected EsaVectors	computeVectors(java.io.File documentsPath, java.lang.String object, java.lang.String set) Computes the vectors for the texts in the given set.
protected void	setDocumentsPath(java.io.File documentsApath, java.io.File documentsBpath) A method that loads the texts in collections A and B.

Methods inherited from class cat.lump.ir.sim.ml.esa.SimilarityESA

computeVectorsA, computeVectorsB, objectExists, saveObject, setObjects

Methods inherited from class cat.lump.ir.sim.ml.esa.Esa

computePairwiseSimilarities, computeSimilarities, computeSimilarity, displaySimilarities, documentsExist, exitError, getPairwiseSimilarities, getSimilarities, getSimilaritiesMatrix, getSimilarity, getSimilarity

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SimilarityCLESAdocs

public SimilarityCLESAdocs(java.lang.String indexApath,
                   java.lang.String indexBpath,
                   java.io.File documentsApath,
                   java.io.File documentsBpath,
                   java.lang.String lanA,
                   java.lang.String lanB,
                   boolean overrideObjects)

Method Detail

setDocumentsPath

protected void setDocumentsPath(java.io.File documentsApath,
                    java.io.File documentsBpath)

Description copied from class: SimilarityESA

A method that loads the texts in collections A and B.

Specified by:

setDocumentsPath in class SimilarityESA

computeVectors

protected EsaVectors computeVectors(java.io.File documentsPath,
                        java.lang.String object,
                        java.lang.String set)
                             throws java.lang.ClassNotFoundException,
                                    java.io.IOException

Description copied from class: SimilarityESA

Computes the vectors for the texts in the given set. If a previously computed object exists (and overrideObjects==False), it just loads the previously computed vectors.

Overrides:

computeVectors in class SimilarityCLESA

Parameters:

documentsPath - path to the documents

object - name of the (previously generated object)

set - whether we are processing A or B

Returns:

Throws:

java.lang.ClassNotFoundException

java.io.IOException