Following the tutorial from optimum
, it says a list of string can be passed as a dataset, but my question is how to pass dataset having multiple columns ?
dataset = ["auto-gptq is an easy-to-use model quantization library with user-friendly apis, based on GPTQ algorithm."]
quantization = GPTQConfig(bits=4, dataset = dataset, tokenizer=tokenizer)