Hello guys,
Running a summarization examples in optimum habana and seeing this errors:
(gaudi2-demo-env) test1@smgailab-SYS-820GH-TNR2:~/demo/optimum-habana/examples/translation$ python3 run_translation.py
–model_name_or_path t5-11b
–do_train
–do_eval
–source_lang en
–target_lang ro
–source_prefix “translate English to Romanian: "
–dataset_name wmt16
–dataset_config_name ro-en
–output_dir /tmp/tst-translation
–per_device_train_batch_size 4
–per_device_eval_batch_size 4
–overwrite_output_dir
–predict_with_generate
–use_habana
–use_lazy_mode
–use_hpu_graphs_for_inference
–gaudi_config_name Habana/t5
–ignore_pad_token_for_loss False
–pad_to_max_length
–save_strategy epoch
–throughput_warmup_steps 3
–bf16
Traceback (most recent call last):
File “/home/test1/demo/optimum-habana/examples/translation/run_translation.py”, line 51, in
from optimum.habana import GaudiConfig, GaudiSeq2SeqTrainer, GaudiSeq2SeqTrainingArguments
File “/home/test1/demo/gaudi2-demo-env/lib/python3.10/site-packages/optimum/habana/init.py”, line 29, in
check_synapse_version()
File “/home/test1/demo/gaudi2-demo-env/lib/python3.10/site-packages/optimum/habana/utils.py”, line 180, in check_synapse_version
habana_frameworks_version_number = get_habana_frameworks_version()
File “/home/test1/demo/gaudi2-demo-env/lib/python3.10/site-packages/optimum/habana/utils.py”, line 218, in get_habana_frameworks_version
return version.parse(output.stdout.split(”\n")[0].split()[-1])
IndexError: list index out of range
Below are the dependencies that was installed in my machine:
accelerate==0.27.2
aiohttp==3.9.3
aiosignal==1.3.1
annotated-types==0.6.0
async-timeout==4.0.3
attrs==23.2.0
Brotli==1.1.0
certifi==2024.2.2
charset-normalizer==3.3.2
colorama==0.4.6
coloredlogs==15.0.1
datasets==2.17.1
deepspeed==0.12.4+hpu.synapse.v1.14.0
diffusers==0.26.3
dill==0.3.8
evaluate==0.4.1
filelock==3.13.1
frozenlist==1.4.1
fsspec==2023.10.0
hjson==3.1.0
huggingface-hub==0.20.3
humanfriendly==10.0
idna==3.6
importlib-metadata==7.0.1
inflate64==1.0.0
Jinja2==3.1.3
lxml==5.1.0
MarkupSafe==2.1.5
mpmath==1.3.0
multidict==6.0.5
multiprocess==0.70.16
multivolumefile==0.2.3
networkx==3.2.1
ninja==1.11.1.1
numpy==1.26.4
nvidia-cublas-cu12==12.1.3.1
nvidia-cuda-cupti-cu12==12.1.105
nvidia-cuda-nvrtc-cu12==12.1.105
nvidia-cuda-runtime-cu12==12.1.105
nvidia-cudnn-cu12==8.9.2.26
nvidia-cufft-cu12==11.0.2.54
nvidia-curand-cu12==10.3.2.106
nvidia-cusolver-cu12==11.4.5.107
nvidia-cusparse-cu12==12.1.0.106
nvidia-nccl-cu12==2.19.3
nvidia-nvjitlink-cu12==12.3.101
nvidia-nvtx-cu12==12.1.105
optimum==1.17.1
optimum-habana==1.10.4
packaging==23.2
pandas==2.2.1
pillow==10.2.0
portalocker==2.8.2
protobuf==4.25.3
psutil==5.9.8
py-cpuinfo==9.0.0
py7zr==0.20.8
pyarrow==15.0.0
pyarrow-hotfix==0.6
pybcj==1.0.2
pycryptodomex==3.20.0
pydantic==2.6.2
pydantic_core==2.16.3
pynvml==11.5.0
pyppmd==1.1.0
python-dateutil==2.8.2
pytz==2024.1
PyYAML==6.0.1
pyzstd==0.15.9
regex==2023.12.25
requests==2.31.0
responses==0.18.0
sacrebleu==2.4.0
safetensors==0.4.2
sentencepiece==0.2.0
six==1.16.0
sympy==1.12
tabulate==0.9.0
texttable==1.7.0
tokenizers==0.15.2
torch==2.2.1
tqdm==4.66.2
transformers==4.37.2
triton==2.2.0
typing_extensions==4.10.0
tzdata==2024.1
urllib3==2.2.1
xxhash==3.4.1
yarl==1.9.4
zipp==3.17.0