You could also try EleutherAI/gpt-j-6B 路 Hugging Face which was already trained on code and performs pretty well.
For the quality of generations it makes sense to tune the sampling strategy. If the first suggestion by the model should be good then you should go for low temperatures whereas if you have several tries you can increase the temperature to get more variety in the generation.