I am trying to use ISTA-DASLab/Meta-Llama-3.1-70B-AQLM-PV-2Bit-1x16 in the zero space KwabsHug/TestCompressedModelzero. When you press generate it starts but always returns
OSError: CUDA_HOME environment variable is not set. Please set it to your CUDA install root.
Does anyone know how resolve this?