Also burned by this coercion, would be helpful to note the PyArrow limitation (although Tensor may be helpful here?) and workarounds in the docs…
Edit: looks like there’s some discussion on how to use PyArrow’s Tensor type at Use pyarrow Tensor dtype · Issue #5272 · huggingface/datasets · GitHub