I want to use falcon for code (The Falcon has landed in the Hugging Face ecosystem) but noticed that LLaMA has a tokenizer issue which dissallows it’s use for code https://twitter.com/ParTmeAdvnturer/status/1670644399024533504?s=20 is this or something similar an issue with falcon too?
Cross posted twitter: https://twitter.com/BrandoHablando/status/1671219624220962816?s=20