Hey @DELith I think you can tokenize the text as you normally would with any text. My suggestion would be to start with that first as a baseline and then see if there’s a need to improve the preprocessing 
Hey @DELith I think you can tokenize the text as you normally would with any text. My suggestion would be to start with that first as a baseline and then see if there’s a need to improve the preprocessing