Hello @ArthurZ @RaushanTurganbay , What are the backend libraries used for low level kernels operations(matmul, softmax etc) in transformers library? Issue: If I ran same model(say mamba or llama) on x86 machine and aarch64 machine, I observe difference in the model timing. I suspect there are d…

Backend low level kernel libraries used in Transformers

benstokes October 27, 2024, 9:06am 4

I also face this issue. but fortunately i saw your thread. Thanks for giving solution.

1 Like