Hi everyone! I’m trying to install Optimum and use it to go through this post from Phil (Optimize & Deploy BERT on AWS inferentia2)
I created an instance using this setup (https
://awsdocs-neuron.readthedocs-hosted.com/en/latest/general/setup/neuron-setup/pytorch/neuronx/amazon-linux/torch-neuronx-al2.html#setup-torch-neuronx-al2). It went through succesfully!
Now I’m trying to run optimum-cli, but no matter what I keep getting a “TaskManager” error ? Please help!