de.lmu.ifi.dbs.elki.datasource.parser

Class TermFrequencyParser<V extends SparseNumberVector<?>>

java.lang.Object

de.lmu.ifi.dbs.elki.datasource.parser.AbstractParser

de.lmu.ifi.dbs.elki.datasource.parser.AbstractStreamingParser

de.lmu.ifi.dbs.elki.datasource.parser.NumberVectorLabelParser<V>

de.lmu.ifi.dbs.elki.datasource.parser.TermFrequencyParser<V>

All Implemented Interfaces:

BundleStreamSource, Parser, StreamingParser, Parameterizable

@Title(value="Term frequency parser")
@Description(value="Parse a file containing term frequencies. The expected format is \'label term1  term2  ...\'. Terms must not contain the separator character!")
public class TermFrequencyParser<V extends SparseNumberVector<?>>
extends NumberVectorLabelParser<V>

A parser to load term frequency data, which essentially are sparse vectors with text keys.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	TermFrequencyParser.Parameterizer<V extends SparseNumberVector<?>> Parameterization class.

Nested classes/interfaces inherited from interface de.lmu.ifi.dbs.elki.datasource.bundle.BundleStreamSource

BundleStreamSource.Event

Field Summary

Fields

Modifier and Type	Field and Description
(package private) gnu.trove.map.TObjectIntMap<String>	keymap Map.
private static Logging	LOG Class logger.
(package private) int	maxdim Maximum dimension used.
(package private) boolean	normalize Normalize.
private SparseNumberVector.Factory<V,?>	sparsefactory Same as NumberVectorLabelParser.factory, but subtype.

Fields inherited from class de.lmu.ifi.dbs.elki.datasource.parser.NumberVectorLabelParser

columnnames, curlbl, curvec, dimensionality, DIMENSIONALITY_UNKNOWN, DIMENSIONALITY_VARIABLE, factory, LABEL_INDICES_ID, labelcolumns, labelIndices, lineNumber, meta, nextevent, VECTOR_TYPE_ID

Fields inherited from class de.lmu.ifi.dbs.elki.datasource.parser.AbstractParser

ATTRIBUTE_CONCATENATION, comment, COMMENT_PATTERN, DEFAULT_SEPARATOR, NUMBER_PATTERN, QUOTE_CHAR, quoteChar

Constructor Summary

Constructors

Constructor and Description
TermFrequencyParser(boolean normalize, Pattern colSep, char quoteChar, Pattern comment, BitSet labelIndices, SparseNumberVector.Factory<V,?> factory) Constructor.

Method Summary

Methods

Modifier and Type	Method and Description
protected Logging	getLogger() Get the logger for this class.
protected SimpleTypeInformation<V>	getTypeInformation(int dimensionality) Get a prototype object for the given dimensionality.
protected void	parseLineInternal(String line) Internal method for parsing a single line.

Methods inherited from class de.lmu.ifi.dbs.elki.datasource.parser.NumberVectorLabelParser

buildMeta, createDBObject, data, getMeta, initStream, nextEvent

Methods inherited from class de.lmu.ifi.dbs.elki.datasource.parser.AbstractStreamingParser

parse

Methods inherited from class de.lmu.ifi.dbs.elki.datasource.parser.AbstractParser

tokenize, toString

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Detail

LOG

private static final Logging LOG

Class logger.

maxdim

int maxdim

Maximum dimension used.

keymap

gnu.trove.map.TObjectIntMap<String> keymap

Map.

normalize

boolean normalize

Normalize.

sparsefactory

private SparseNumberVector.Factory<V extends SparseNumberVector<?>,?> sparsefactory

Same as NumberVectorLabelParser.factory, but subtype.

Constructor Detail

TermFrequencyParser

public TermFrequencyParser(boolean normalize,
                   Pattern colSep,
                   char quoteChar,
                   Pattern comment,
                   BitSet labelIndices,
                   SparseNumberVector.Factory<V,?> factory)

Constructor.

Parameters:

normalize - Normalize

colSep - Column separator

quoteChar - Quotation character

comment - Comment pattern

labelIndices - Indices to use as labels

Method Detail

parseLineInternal

protected void parseLineInternal(String line)

Description copied from class: NumberVectorLabelParser

Internal method for parsing a single line. Used by both line based parsing as well as block parsing. This saves the building of meta data for each line.

Overrides:

parseLineInternal in class NumberVectorLabelParser<V extends SparseNumberVector<?>>

Parameters:

line - Line to process

getTypeInformation

protected SimpleTypeInformation<V> getTypeInformation(int dimensionality)

Description copied from class: NumberVectorLabelParser

Get a prototype object for the given dimensionality.

Overrides:

getTypeInformation in class NumberVectorLabelParser<V extends SparseNumberVector<?>>

Parameters:

dimensionality - Dimensionality

Returns:

Prototype object

getLogger

protected Logging getLogger()

Description copied from class: AbstractParser

Get the logger for this class.

Overrides:

getLogger in class NumberVectorLabelParser<V extends SparseNumberVector<?>>

Returns:

Logger.