Create a batch transform job with custom trained biobert model

Thank you for providing the link.
I wanna understand how to convert normal dataset to “datasets.arrow_dataset.Dataset” format. I see you are loading imdb dataset from directly from load_dataset function from dataset[s3] module.

I have my csv file with 3 columns 1)unique id 2)description column(ML input) 3) Labels.
I want to convert this dataframe to the “datasets.arrow_dataset.Dataset” format.