Text to SQL Model Finetuning

Beginners
1

Hey all,
Want some suggestions! I am trying to create a Text to SQL based model where end user after training the model on my specific dataset will only ask questions in natural language should be able to get the right SQL query. Currently, I am finetuning the Llama-2-7B-chat-hf model with “b-mc2/sql-create-context” dataset on hf. Any suggestions on this usecase are highly appreciated!
Thanks

2

Hey @Manan2905 - did you find anything on this? How are you progressing?

I am in the same boat and trying to achieve similar thing.

3

achieved nothing significant yet, trying to use mistral and instruction finetuning!