Skip to main content

Detect profane language in streaming services to protect young audiences

By Jingxiang Chen, Kai Wei, and Xiang Hao

With the rapid growth of online video streaming, recent years have seen increasing concerns about profane language in their content. Detecting profane language in streaming services is challenging due to the long sentences appeared in a video. While recent research on handling long sentences has focused on developing deep learning modeling techniques, little work has focused on techniques on improving data pipelines. In this work, we develop a data collection pipeline to address long sequence of texts and integrate this pipeline with a multi-head self-attention model. With this pipeline, our experiments show the selfattention model offers 12.5% relative accuracy improvement over state-of-the-art distilBERT model on profane language detection while requiring only 3% of parameters. This research designs a better system for informing users of profane language in video streaming services.

For the full paper, see Detect profane language in streaming services to protect young audiences on the Amazon Science website.

Research Scientist – Amazon
Principal Applied Scientist – Prime Video