kiwi.data.fieldsets package

Submodules

kiwi.data.fieldsets.extend_vocabs_fieldset module

kiwi.data.fieldsets.extend_vocabs_fieldset.build_fieldset(base_fieldset)

kiwi.data.fieldsets.fieldset module

class kiwi.data.fieldsets.fieldset.Fieldset

Bases: object

ALL = 'all'

TEST = 'test'

TRAIN = 'train'

VALID = 'valid'

add(name, field, file_option_suffix, required='all', vocab_options=None, vocab_vectors=None, file_reader=None)

Parameters:

• name –
• field –
• file_option_suffix –
• required (str or list or None) –
• file_reader (callable) – by default, uses Corpus.from_files().

Returns:

fields

fields_and_files(set_name, **files_options)

fields_vocab_options(**kwargs)

is_required(name, set_name)

vocab_kwargs(name, **kwargs)

vocab_vectors(name, **kwargs)

vocab_vectors_loader(name, embeddings_format='polyglot', embeddings_binary=False, **kwargs)

kiwi.data.fieldsets.linear module

kiwi.data.fieldsets.linear.build_fieldset()

kiwi.data.fieldsets.predictor module

kiwi.data.fieldsets.predictor.build_fieldset()

kiwi.data.fieldsets.predictor.build_label_field(postprocessing=None)

kiwi.data.fieldsets.predictor.build_text_field()

kiwi.data.fieldsets.predictor_estimator module

kiwi.data.fieldsets.predictor_estimator.build_fieldset(wmt18_format=False)

kiwi.data.fieldsets.predictor_estimator.build_label_field(postprocessing=None)

kiwi.data.fieldsets.predictor_estimator.build_text_field()

kiwi.data.fieldsets.quetch module

kiwi.data.fieldsets.quetch.build_fieldset(wmt18_format=False)

Module contents