datasets.Dataset.get_nearest_examples() on GPU

šŸ¤—Datasets
1

Hello everyone,

Is it possible to put get_nearest_examples() computation on GPU after having added a FAISS index?

1 Like
2

You can specify the GPU ID when you instantiated the index. Will use the CPU by default (None).

add_faiss_index(column, device=0)
3

Thank you, Bram. Tried a similar solution when loading my faiss_index.

However, throws an error: AttributeError: module 'faiss' has no attribute 'StandardGpuResources

I have created a topic in facebookresearch/faiss repository - AttributeError: module ā€˜faissā€™ has no attribute ā€˜StandardGpuResourcesā€™ on adding FAISS index to Hugging face Dataset.

4

You probably installed a prebuilt faiss-cpu rather than faiss-gpu. Remove that one and install faiss-gpu instead.

1 Like
5

Thank you Bram. I have some updates.

FAISS installation (1)

  1. Not having faiss-cpu, just having faiss-gpu. Installed it by:
    conda install faiss-gpu cudatoolkit=10.2 -c pytorch

According to (1), it should be cudatoolkit=10.0, but that leads to downgrades that can lead to future problems.

down-grades
down-grades762Ɨ311 21 KB

throws
AssertionError: You must install Faiss to use FaissIndex. To do so you can run pip install faiss-cpu or pip install faiss-gpu

  1. Not having faiss-cpu, just having faiss-gpu. Installed it by

pip install faiss-gpu

Problem solved.

Cheers

6

I donā€™t use conda so Iā€™m not sure I can help with that - but if I understand you correctly, the problem has been solved by using pip install?

2 Likes
7

Yes, thank you.

1 Like