Fine tuning of ctransformers model

Federic · March 11, 2024, 4:15pm

is possible to fine tuning a model loaded with ctransformers? my usecase is to load a model in gguf format 4bit and the fine tuning it, i am on apple m3 i cannot use bitsandbytes

Topic		Replies	Views
Finetuning model with smaller sequence size and Dmodel Models	0	331	April 15, 2021
Fine tuning with apple m3 Beginners	0	824	March 11, 2024
Finetuned LLM model conversion to GGUF - performance drop Models	4	1049	July 31, 2024
Fine tuning gguf models? 🤗Transformers	1	1368	April 30, 2024
Context window decreased after finetuning? 🤗Transformers	0	185	November 4, 2023

Fine tuning of ctransformers model

Related topics