Your question is Explain Tokenization in NLP. Take a moment with it on the right.
Talk me through your thinking if you like. When you're confident, submit your answer and I'll grade it like a real screen (7/10 or better passes).
You are working with text data for an NLP model, and the first step is to convert raw text into tokens the model can process. The input may include punctuation, numbers, product names, and mixed casing, so the tokenization choice affects both vocabulary size and model behavior.
What is tokenization?