Hi! Instead of copying the entire cache directory, use Dataset.save_to_disk locally to save the dataset to a specifc directory and then move only that directory to the server. In the final step, call datasets.load_from_disk on the server to load the dataset from the copied directory.
Additionally, you can speed up the process by using sftp/ssh to move the directory to the server:
dset.save_to_disk(path, fs=fsspec.filesystem("sftp", host=host, port=port, username=username, password=password))