ByteDance Is Training a Massive AI Model That Could Rival Anthropic's Biggest Systems

ByteDance Trains 10 Trillion Parameter AI Model to Rival Anthropic

ByteDance, the Chinese technology company behind TikTok, is reportedly working on one of the largest artificial intelligence models ever attempted. According to a report from the Financial Times, ByteDance is training a new model that could eventually reach up to 10 trillion parameters. The project is still in its early pre-training stage, meaning the final size and capabilities of the model have not yet been determined.

If ByteDance reaches that target, the model would be more than three times the reported size of Moonshot AI's Kimi K3, currently one of China's largest AI models. But there's an important caveat: a larger parameter count doesn't automatically mean a better AI model.

What Does 10 Trillion Parameters Actually Mean?

Parameters are essentially numerical values that an AI model learns during training to recognize patterns and generate responses. Think of them as part of the model's learned knowledge and behaviour. A model with trillions of parameters requires enormous amounts of computing power, data and infrastructure to train.

However, comparing AI models purely by parameter count can be misleading.

Modern AI systems can use architectures such as Mixture-of-Experts (MoE), where only a portion of the model is activated for a particular task. That means a model can have an enormous total parameter count without using all of those parameters every time it answers a question. So if ByteDance eventually builds a 10-trillion-parameter model, 10 trillion alone won't tell us how intelligent it is.

China's AI Race Is Getting Bigger

ByteDance isn't working in isolation. Chinese AI companies have been rapidly increasing the scale and capability of their models.

Moonshot AI's Kimi K3 has been reported at around 2.8 trillion parameters, while other Chinese models such as Meituan's LongCat-2.0 and DeepSeek's V4-Pro have been reported at around 1.6 trillion parameters. A potential 10-trillion-parameter ByteDance model would therefore represent a dramatic increase in scale.

The development also highlights how aggressively Chinese companies are trying to close the gap with leading US AI laboratories.

ByteDance vs Anthropic

The most interesting comparison is with Anthropic. Anthropic does not publicly disclose the parameter counts of its frontier models, so the figures being discussed are industry estimates rather than official specifications.

According to the Financial Times report, industry estimates put Anthropic's most advanced Mythos 5 at around 8 trillion parameters. That would put ByteDance's potential 10-trillion-parameter model in the same general scale. But it doesn't mean ByteDance has already caught Anthropic.

The ByteDance model is still being trained, while parameter counts don't directly translate into model performance. The real test will come when the model is evaluated on reasoning, coding, mathematics, multimodal understanding and real-world tasks.

When Could We See It?

The project is reportedly still in the pre-training stage. Pre-training for a frontier model can take several months before the model moves into additional stages such as fine-tuning, safety testing and deployment.

The Financial Times report suggests the current training phase could take three to six months, although the eventual release schedule isn't known. That means we shouldn't expect a finished 10-trillion-parameter model to suddenly appear tomorrow.

And there's another possibility: The final model may be smaller than 10 trillion parameters.

The final size is reportedly still being determined.

Why This Matters for AI Users in Africa

At first glance, this might seem like another battle between huge American and Chinese technology companies. But the consequences could eventually reach African developers and businesses. More powerful foundation models could lead to:

• Better AI assistants

• More capable coding tools

• Better translation

• Improved African-language AI

• More advanced business automation

• Better image and video generation

• More capable AI agents

• Lower AI costs as competition increases

For African developers, the most interesting development may not necessarily be which company has the biggest model. It's whether increasingly capable models become cheaper and more accessible.

The Bigger AI Race Is Changing

The AI race is no longer simply: OpenAI vs Google vs Anthropic

Chinese companies including ByteDance, DeepSeek, Moonshot AI and others are becoming increasingly important players. At the same time, open-weight models are giving developers more choices outside the traditional closed API ecosystem.

This is particularly important for countries where access to expensive AI services can be a barrier. If Chinese companies can develop extremely capable models while offering competitive pricing or open-weight alternatives, developers in Africa could benefit from having more choices instead of depending on a handful of US AI providers.

But Bigger Doesn't Automatically Mean Better

This is perhaps the most important thing to remember about the ByteDance story. A 10-trillion-parameter model would be enormous, but size isn't the same thing as intelligence. Training data quality, model architecture, reasoning techniques, training efficiency, inference performance and post-training all matter.

A smaller model can outperform a much larger model if it is designed and trained more efficiently. So the real headline isn't:

ByteDance has built the world's best AI.

It hasn't.

The more accurate story is:

ByteDance is reportedly attempting to build a model at a scale that could put it in the same conversation as the world's leading frontier AI systems.

And if the project succeeds, it could become another major turning point in the increasingly competitive global AI race.

What This Means for the Future

ByteDance's reported project shows just how quickly the definition of a "large AI model" is changing. Only a few years ago, trillion-parameter models were considered extraordinary. Now, companies are reportedly experimenting with models several times that size. Whether ByteDance ultimately trains 10 trillion parameters or settles on a smaller architecture, one thing is becoming increasingly clear:

The global AI race is getting bigger, more expensive and far more competitive — and Africa's developers should be paying attention.

Read more: Nvidia Is Buying Hugging Face for $12.9 Billion And That Could Change Who Controls AI
Read more: Anthropic Researcher Quits and Warns AI Could ‘Kill Us All’ — Recent Incidents Are Fueling His Fear
Read more: EU Tells Advanced-AI Companies to Get Their Models Under Control — But Can Europe Actually Stop One?