Parse and Normalize Text Inputs | Dataford Interview Questions

Write a Python function to parse and normalize unstructured text inputs before tokenization.

Implement def normalize_text(text): to return a normalized string. Convert Unicode variants and text to case-insensitive form, interpret escaped whitespace sequences such as \ and \\t, replace email addresses with <email> and HTTP(S) URLs with <url>, replace remaining punctuation with spaces, and collapse whitespace. Preserve Unicode word characters and the placeholder tokens.

Constraints

text is a string
0 <= len(text) <= 10^5
Input may contain Unicode characters, actual whitespace, or escaped whitespace sequences
Email addresses and HTTP(S) URLs should be replaced with their specified placeholders

Function Signature

def normalize_text(text):

Your question is Parse and Normalize Text Inputs. Start with the requirements in the Question tab.

Run and submit as often as you like. When you're ready, talk me through your approach or go straight to the code.

Problem

Write a Python function to parse and normalize unstructured text inputs before tokenization.

Constraints

text is a string
0 <= len(text) <= 10^5
Input may contain Unicode characters, actual whitespace, or escaped whitespace sequences
Email addresses and HTTP(S) URLs should be replaced with their specified placeholders

Function Signature

def normalize_text(text):

Your question is Parse and Normalize Text Inputs. Start with the requirements in the Question tab.

Run and submit as often as you like. When you're ready, talk me through your approach or go straight to the code.