In Python, map works as follows: map(func, arg_1, arg_2) In datasets.map, we are required to pass in a callable (which expects objects of form dataset[idx], which means that certain things like tokenizer have to be defined and should be accessible within the scope of this function, along with that…

Can dataset.map accept multiple arguments like python map

ndvb April 20, 2023, 12:25pm 4

Can you show an example?

Topic		Replies	Views
How to use dataset with costume function? Beginners	3	848	June 19, 2023
Dataset map method - how to pass argument to the function Beginners	4	10692	April 5, 2022
How to distinguish train or eval in the callable function in dataset.map()? 🤗Datasets	2	464	June 8, 2022
Making multiple samples from single samples using HuggingFace Datasets 🤗Datasets	6	2702	March 3, 2024
Dealing with large objects as arguments in datasets.map 🤗Datasets	2	699	October 21, 2021