Inference Hyperparameters

Have you made any other changes to the model or inference script? Can you please share exactly what you execute and do? The issue must be on your side somewhere since it perfectly works for the albert i tested.