de.lmu.ifi.dbs.elki.datasource.parser

Class SparseFloatVectorLabelParser

java.lang.Object

de.lmu.ifi.dbs.elki.datasource.parser.AbstractParser

de.lmu.ifi.dbs.elki.datasource.parser.AbstractStreamingParser

de.lmu.ifi.dbs.elki.datasource.parser.NumberVectorLabelParser<SparseFloatVector>

de.lmu.ifi.dbs.elki.datasource.parser.SparseFloatVectorLabelParser

All Implemented Interfaces:

BundleStreamSource, Parser, StreamingParser, InspectionUtilFrequentlyScanned, Parameterizable

@Title(value="Sparse Float Vector Label Parser")
@Description(value="Parser for the following line format:\nA single line provides a single point. Entries are separated by whitespace. The values will be parsed as floats (resulting in a set of SparseFloatVectors). A line is expected in the following format: The first entry of each line is the number of attributes with coordinate value not zero. Subsequent entries are of the form (index, value), where index is the number of the corresponding dimension, and value is the value of the corresponding attribute.Any pair of two subsequent substrings not containing whitespace is tried to be read as int and float. If this fails for the first of the pair (interpreted ans index), it will be appended to a label. (Thus, any label must not be parseable as Integer.) If the float component is not parseable, an exception will be thrown. Empty lines and lines beginning with \"#\" will be ignored. Having the file parsed completely, the maximum occuring dimensionality is set as dimensionality to all created SparseFloatvectors.")
public class SparseFloatVectorLabelParser
extends NumberVectorLabelParser<SparseFloatVector>

Provides a parser for parsing one point per line, attributes separated by whitespace.

Several labels may be given per point. A label must not be parseable as double. Lines starting with "#" will be ignored.

A line is expected in the following format: The first entry of each line is the number of attributes with coordinate value not zero. Subsequent entries are of the form (index, value), where index is the number of the corresponding dimension, and value is the value of the corresponding attribute.

An index can be specified to identify an entry to be treated as class label. This index counts all entries (numeric and labels as well) starting with 0.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	SparseFloatVectorLabelParser.Parameterizer Parameterization class.

Nested classes/interfaces inherited from interface de.lmu.ifi.dbs.elki.datasource.bundle.BundleStreamSource

BundleStreamSource.Event

Field Summary

Fields

Modifier and Type	Field and Description
private static Logging	logger Class logger
private int	maxdim Holds the dimensionality of the parsed data which is the maximum occurring index of any attribute.

Fields inherited from class de.lmu.ifi.dbs.elki.datasource.parser.NumberVectorLabelParser

curlbl, curvec, dimensionality, DIMENSIONALITY_UNKNOWN, DIMENSIONALITY_VARIABLE, factory, LABEL_INDICES_ID, labelIndices, lineNumber, meta, nextevent, VECTOR_TYPE_ID

Fields inherited from class de.lmu.ifi.dbs.elki.datasource.parser.AbstractParser

ATTRIBUTE_CONCATENATION, COLUMN_SEPARATOR_ID, COMMENT, NUMBER_PATTERN, QUOTE_CHAR, QUOTE_ID, quoteChar, WHITESPACE_PATTERN

Constructor Summary

Constructors

Constructor and Description
SparseFloatVectorLabelParser(Pattern colSep, char quoteChar, BitSet labelIndices) Constructor.

Method Summary

Methods

Modifier and Type	Method and Description
protected Logging	getLogger() Get the logger for this class.
protected SimpleTypeInformation<SparseFloatVector>	getTypeInformation(int dimensionality) Get a prototype object for the given dimensionality.
protected void	parseLineInternal(String line) Internal method for parsing a single line.

Methods inherited from class de.lmu.ifi.dbs.elki.datasource.parser.NumberVectorLabelParser

buildMeta, createDBObject, data, getMeta, initStream, nextEvent

Methods inherited from class de.lmu.ifi.dbs.elki.datasource.parser.AbstractStreamingParser

parse

Methods inherited from class de.lmu.ifi.dbs.elki.datasource.parser.AbstractParser

tokenize, toString

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Detail

logger

private static final Logging logger

Class logger

maxdim

private int maxdim

Holds the dimensionality of the parsed data which is the maximum occurring index of any attribute.

Constructor Detail

SparseFloatVectorLabelParser

public SparseFloatVectorLabelParser(Pattern colSep,
                            char quoteChar,
                            BitSet labelIndices)

Constructor.

Parameters:

colSep -

quoteChar -

labelIndices -

Method Detail

parseLineInternal

protected void parseLineInternal(String line)

Description copied from class: NumberVectorLabelParser

Internal method for parsing a single line. Used by both line based parsing as well as block parsing. This saves the building of meta data for each line.

Overrides:

parseLineInternal in class NumberVectorLabelParser<SparseFloatVector>

Parameters:

line - Line to process

getTypeInformation

protected SimpleTypeInformation<SparseFloatVector> getTypeInformation(int dimensionality)

Description copied from class: NumberVectorLabelParser

Get a prototype object for the given dimensionality.

Overrides:

getTypeInformation in class NumberVectorLabelParser<SparseFloatVector>

Parameters:

dimensionality - Dimensionality

Returns:

Prototype object

getLogger

protected Logging getLogger()

Description copied from class: AbstractParser

Get the logger for this class.

Overrides:

getLogger in class NumberVectorLabelParser<SparseFloatVector>

Returns:

Logger.