Failed to Initialize MPT-7B endpoint due to 'trust_remote_code' Error

[John6666]

It seems there is env.

Model safety.

From now on, TGI will not convert automatically pickle files without having --trust-remote-code flag or TRUST_REMOTE_CODE=true in the environment variables. This flag is already used for community defined inference code, and is therefore quite representative of the level of confidence you are giving the model providers.

How to avoid trust_remote_code=True for my models

How to avoid `trust_remote_code=True` for my models

For that, Phi-3 would need to be integrated natively in the Transformers library.