UTF-16 for datasets?

You can pass encoding="utf-16" to the load_dataset call.

1 Like