Dataset

Dataset#

class CustomDataset(path, tokenizer, context_length=5, dataset_path='datasets', device='cpu')[source]#

Bases: Dataset