I want to add a column of type int32 to a dataset object. Currently I am using add_column()with a list of integers which leads to columns with type int64, followed by cast_column(). As I am iteratively loading a lot of datasets and then concatenating them, the above process is too slow. I was won…

Add column with a particular type in datasets

lhoestq July 5, 2024, 9:47am 2

As a workaround you can pass a numpy array with the right type

1 Like