Add_faiss_index with multiple columns

This article (Semantic search with FAISS - Hugging Face NLP Course) concatenates the title, body and comments together before creating embeddings.
Later, it uses embeddings_dataset.add_faiss_index(column=“embeddings”), with a single column.

I would like to use multiple columns separately for title, body and comments while indexing faiss, with separate embeddings for each.

I would highly appreciate if anyone could give a solution to resolve this scenario. Thanks!

1 Like