Skip to content
Advertisement
When Appliance Fail?

ByteDance trains massive AI model in bid to rival Anthropic

TikTok owner training a model with 10 trillion parameters.

schedule 13:29 visibility 3 views
ByteDance trains massive AI model in bid to rival Anthropic
Source: Ars Technica

ByteDance is training an AI model that could approach the size of Anthropic’s most cutting-edge Mythos system, as Chinese companies continue to narrow the gap with the top US labs.

The Chinese tech giant is at an early stage of training a model with as many as 10 trillion parameters—three times larger than Moonshot’s Kimi K3, the biggest Chinese model released to date, according to three people with knowledge of the matter.

The ByteDance model is being pre-trained—a stage that typically takes three to six months—before it is fine-tuned and released if all goes well, one of the people said. The exact model size would only be determined at a later stage.

Read full article

Comments

newspaper

Originally published at

Ars Technica

open_in_new Read Full Article

Related Articles

Read More

Why does Apple keep banning Telegram, but never X?
Technology

Why does Apple keep banning Telegram, but never X?

For roughly an hour this week, Telegram vanished from Apple's App Store. Even during that blip, it was a stunning absence for such a major app: an avenue of communication for more than 1 billion users around the world, used widely as a secure...

The Verge
Your Appliance Broke?
Reliable Repair for