How to get vocabulary embedding matrix from an LLM?

HarshavardhanK · December 1, 2023, 12:34am

I want to access the entire vocabulary and its trained embedding of a large language model. How do I achieve that?

panigrah · December 1, 2023, 1:09am

is there a vocab.txt file in the model files?

Topic		Replies	Views
LLM and different embeddings interaction Beginners	0	596	October 17, 2023
Understanding regarding "Question Answering model using open-source LLM" Beginners	0	978	May 3, 2023
Building Own Knowledge Base LLM Beginners	1	758	April 6, 2024
Use embeddings stored in vector db to reduce work for LLM generating response Intermediate	0	1275	February 19, 2024
How to fine-tune an LLM model with an entire document in a format such as *.txt/docx/pdf ect 🤗AutoTrain	5	4573	December 3, 2023