Loading pretranied transformers

Do I need to retrain the model once I load it from the transformers library ? I ask this question because I got poor results from the default real time speech recognition pipeline. Even after adding a sleep of 2 seconds as mentioned in your shared tutorial.