Tag: polluted

OpenAI’s latest blunder shows the challenges facing Chinese AI models

In fact, among the few long Chinese tokens in GPT-4o that aren’t either pornography or

By Mike Powers

The Download: GPT-4o’s polluted Chinese training knowledge, and astronomy’s AI challenge

Soon after OpenAI released GPT-4o last Monday, some Chinese speakers started to notice that something

By Mike Powers

GPT-4o’s Chinese token-training data is polluted by spam and porn websites

The new tokenizer has 200,000 tokens in total, and about 25% are in non-English languages,

By Mike Powers