de.lmu.ifi.dbs.elki.datasource.parser

Class TermFrequencyParser

java.lang.Object

de.lmu.ifi.dbs.elki.datasource.parser.AbstractParser

de.lmu.ifi.dbs.elki.datasource.parser.AbstractStreamingParser

de.lmu.ifi.dbs.elki.datasource.parser.NumberVectorLabelParser<SparseFloatVector>

de.lmu.ifi.dbs.elki.datasource.parser.TermFrequencyParser

All Implemented Interfaces:

BundleStreamSource, Parser, StreamingParser, InspectionUtilFrequentlyScanned, Parameterizable

@Title(value="Term frequency parser")
@Description(value="Parse a file containing term frequencies. The expected format is \'label term1  term2  ...\'. Terms must not contain the separator character!")
public class TermFrequencyParser
extends NumberVectorLabelParser<SparseFloatVector>

A parser to load term frequency data, which essentially are sparse vectors with text keys.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	TermFrequencyParser.Parameterizer Parameterization class.

Nested classes/interfaces inherited from interface de.lmu.ifi.dbs.elki.datasource.bundle.BundleStreamSource

BundleStreamSource.Event

Field Summary

Fields

Modifier and Type	Field and Description
(package private) HashMap<String,Integer>	keymap Map
private static Logging	logger Class logger
(package private) int	maxdim Maximum dimension used
(package private) boolean	normalize Normalize

Fields inherited from class de.lmu.ifi.dbs.elki.datasource.parser.NumberVectorLabelParser

curlbl, curvec, dimensionality, DIMENSIONALITY_UNKNOWN, DIMENSIONALITY_VARIABLE, factory, LABEL_INDICES_ID, labelIndices, lineNumber, meta, nextevent, VECTOR_TYPE_ID

Fields inherited from class de.lmu.ifi.dbs.elki.datasource.parser.AbstractParser

ATTRIBUTE_CONCATENATION, COLUMN_SEPARATOR_ID, COMMENT, NUMBER_PATTERN, QUOTE_CHAR, QUOTE_ID, quoteChar, WHITESPACE_PATTERN

Constructor Summary

Constructors

Constructor and Description
TermFrequencyParser(boolean normalize, Pattern colSep, char quoteChar, BitSet labelIndices) Constructor.

Method Summary

Methods

Modifier and Type	Method and Description
protected Logging	getLogger() Get the logger for this class.
protected SimpleTypeInformation<SparseFloatVector>	getTypeInformation(int dimensionality) Get a prototype object for the given dimensionality.
protected void	parseLineInternal(String line) Internal method for parsing a single line.

Methods inherited from class de.lmu.ifi.dbs.elki.datasource.parser.NumberVectorLabelParser

buildMeta, createDBObject, data, getMeta, initStream, nextEvent

Methods inherited from class de.lmu.ifi.dbs.elki.datasource.parser.AbstractStreamingParser

parse

Methods inherited from class de.lmu.ifi.dbs.elki.datasource.parser.AbstractParser

tokenize, toString

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Detail

logger

private static final Logging logger

Class logger

maxdim

int maxdim

Maximum dimension used

keymap

HashMap<String,Integer> keymap

Map

normalize

boolean normalize

Normalize

Constructor Detail

TermFrequencyParser

public TermFrequencyParser(boolean normalize,
                   Pattern colSep,
                   char quoteChar,
                   BitSet labelIndices)

Constructor.

Parameters:

normalize - Normalize

colSep -

quoteChar -

labelIndices -

Method Detail

parseLineInternal

protected void parseLineInternal(String line)

Description copied from class: NumberVectorLabelParser

Internal method for parsing a single line. Used by both line based parsing as well as block parsing. This saves the building of meta data for each line.

Overrides:

parseLineInternal in class NumberVectorLabelParser<SparseFloatVector>

Parameters:

line - Line to process

getTypeInformation

protected SimpleTypeInformation<SparseFloatVector> getTypeInformation(int dimensionality)

Description copied from class: NumberVectorLabelParser

Get a prototype object for the given dimensionality.

Overrides:

getTypeInformation in class NumberVectorLabelParser<SparseFloatVector>

Parameters:

dimensionality - Dimensionality

Returns:

Prototype object

getLogger

protected Logging getLogger()

Description copied from class: AbstractParser

Get the logger for this class.

Overrides:

getLogger in class NumberVectorLabelParser<SparseFloatVector>

Returns:

Logger.