Chapter 2 questions

Could you please help me to understand, do Tokenization and Embeddings both required to use Transformers?
In inferencing due we need to perform Tokenization / Embedding before passing the input ?