KD_Lib.KD.text.utils package

Submodules

KD_Lib.KD.text.utils.bert module

KD_Lib.KD.text.utils.bert.df_to_bert_dataset(df, max_length, tokenizer)

KD_Lib.KD.text.utils.bert.df_to_bert_format(df, max_length, tokenizer)

KD_Lib.KD.text.utils.bert.get_bert_dataloader(df, tokenizer, max_seq_length=64, batch_size=16, mode='train')

Helper function for generating dataloaders for BERT

Module contents