CLI aggregate

The help documentation is available in the terminal from:

peerannot aggregate --help

peerannot aggregate

Aggregate crowdsourced labels stored in the provided directory

peerannot aggregate [OPTIONS] [DATASET]

Options

-s, --strategy <strategy>

Aggregation strategy to compute estimated labels from

--hard

Only consider hard labels even if the strategy produces soft labels

Default:

False

--metadata_path <metadata_path>

Path to the metadata of the dataset if different than default

--answers-file <answers_file>

Name (with json extension) of the path to the crowdsourced labels

--path-remove <path_remove>

Path to file of index to prune from the training set

Arguments

DATASET

Optional argument

All aggregated labels are stored in the associated dataset directory with the strategy name