NAME
pkfsann - feature selection for nn classifier
SYNOPSIS
FCpkfsannF[0] FC-tF[0] training FC-nF[0] number [options] [advanced options]
DESCRIPTION
Classification problems dealing with high dimensional input data can be challenging due to the Hughes phenomenon. Hyperspectral data, for instance, can have hundreds of spectral bands and require special attention when being classified. In particular when limited training data are available, the classification of such data can be problematic without reducing the dimension.
pkfsann implements a number of feature selection techniques, among which a sequential floating forward search (SFFS). Also consider the SVM classifier implemented in pksvm(1), which has been shown to be more robust to this type of problem than others.
OPTIONS
- FC-tF[0] filename, FC--trainingF[0] filename
-
training vector file. A single vector file contains all training features (must be set as: B0, B1, B2,...) for all classes (class numbers identified by label option). Use multiple training files for bootstrap aggregation (alternative to the bag and bsize options, where a random subset is taken from a single training file)
- FC-nF[0] number, FC--nfF[0] number
-
number of features to select (0 to select optimal number, see also FC--ecostF[0] option)
- FC-iF[0] filename, FC--inputF[0] filename
-
input test set (leave empty to perform a cross validation based on training only)
- FC-vF[0] level, FC--verboseF[0] level
-
set to: 0 (results only), 1 (confusion matrix), 2 (debug)
Advanced options
- FC-tlnF[0] layer, FC--tlnF[0] layer
-
training layer name(s)
- FC-labelF[0] attribute, FC--labelF[0] attribute
-
identifier for class label in training vector file. (default: label)
- FC--balanceF[0] size
-
balance the input data to this number of samples for each class (default: 0)
- FC-randomF[0], FC--randomF[0]
-
in case of balance, randomize input data
- FC-minF[0] number, FC--minF[0] number
-
if number of training pixels is less then min, do not take this class into account
- FC-bF[0] band, FC--bandF[0] band
-
band index (starting from 0, either use band option or use start to end)
- FC-sbandF[0] band, FC--startbandF[0] band
-
start band sequence number
- FC-ebandF[0] band, FC--endbandF[0] band
-
end band sequence number
- FC-offsetF[0] value, FC--offsetF[0] value
-
offset value for each spectral band input features: FCrefl[band]=(DN[band]-offset[band])/scale[band]F[0]
- FC-scaleF[0] value, FC--scaleF[0] value
-
scale value for each spectral band input features: FCrefl=(DN[band]-offset[band])/scale[band]F[0] (use FC0F[0] if scale min and max in each band to FC-1.0F[0] and FC1.0F[0])
- FC-aF[0] 0|1|2, FC--aggregF[0] 0|1|2
-
how to combine aggregated classifiers, see also FC--rcF[0] option (0: no aggregation, 1: sum rule, 2: max rule).
- FC-smF[0] method, FC--smF[0] method
-
feature selection method (sffs=sequential floating forward search, sfs=sequential forward search, sbs, sequential backward search, bfs=brute force search)
- FC-ecostF[0] value, FC--ecostF[0] value
-
epsilon for stopping criterion in cost function to determine optimal number of features
- FC-cvF[0] value, FC--cvF[0] value
-
n-fold cross validation mode (default: 0)
- FC-cF[0] name, FC--classF[0] name
-
list of class names.
- FC-rF[0] value, FC--reclassF[0] value
-
list of class values (use same order as in FC--classF[0] option).
- FC-nF[0] number, FC--nneuronF[0] number
-
number of neurons in hidden layers in neural network (multiple hidden layers are set by defining multiple number of neurons: FC-nnF[0] 15 FC-nnF[0] 1, default is one hidden layer with 5 neurons)
- FC--connectionF[0] 0|1
-
connection rate (default: 1.0 for a fully connected network)
- FC-wF[0] weights, FC--weightsF[0] weights
-
weights for neural network. Apply to fully connected network only, starting from first input neuron to last output neuron, including the bias neurons (last neuron in each but last layer)
- FC-lF[0] rate, FC--learningF[0] rate
-
learning rate (default: 0.7)
- FC--maxitF[0] number
-
number of maximum iterations (epoch) (default: 500)