jsat.io

Class DataWriter

java.lang.Object

jsat.io.DataWriter

All Implemented Interfaces:

java.io.Closeable, java.lang.AutoCloseable

public abstract class DataWriter
extends java.lang.Object
implements java.io.Closeable

This interface defines a contract by which datapoints may be written out to a dataset file (such as a CSV) in an incremental fashion. This object is thread safe for all methods.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	DataWriter.DataSetType

Field Summary

Fields

Modifier and Type	Field and Description
CategoricalData[]	catInfo the categorical feature information for the whole corpus
int	dim the number of numeric features for the whole corpus
DataWriter.DataSetType	type The type of dataset to be written out

Constructor Summary

Constructors

Constructor and Description
DataWriter(java.io.OutputStream out, CategoricalData[] catInfo, int dim, DataWriter.DataSetType type)

Method Summary

Modifier and Type	Method and Description
void	close()
void	finish() To be called after all threads are done calling writePoint(jsat.classifiers.DataPoint, double).
void	writePoint(DataPoint dp, double label) Write out the given data point to the output stream

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

type

public final DataWriter.DataSetType type

The type of dataset to be written out

catInfo

public final CategoricalData[] catInfo

the categorical feature information for the whole corpus

dim

public final int dim

the number of numeric features for the whole corpus

Constructor Detail

DataWriter

public DataWriter(java.io.OutputStream out,
                  CategoricalData[] catInfo,
                  int dim,
                  DataWriter.DataSetType type)
           throws java.io.IOException

Throws:

java.io.IOException

Method Detail

writePoint

public void writePoint(DataPoint dp,
                       double label)
                throws java.io.IOException

Write out the given data point to the output stream

Parameters:

dp - the data point to write to the file

label - The associated label for this dataum. If type is a DataWriter.DataSetType.SIMPLE set, this value will be ignored. If DataWriter.DataSetType.CLASSIFICATION, the value will be assumed to be an integer class label.

Throws:

java.io.IOException

finish

public void finish()
            throws java.io.IOException

To be called after all threads are done calling writePoint(jsat.classifiers.DataPoint, double).

Throws:

java.io.IOException

close

public void close()
           throws java.io.IOException

Specified by:

close in interface java.io.Closeable

Specified by:

close in interface java.lang.AutoCloseable

Throws:

java.io.IOException