The model, called Hy4 preview, uses a "mixture-of-experts" design with 770 billion parameters in total, Tencent said, although only about 49 billion are used for any given text request.
The model, called Hy4 preview, uses a "mixture-of-experts" design with 770 billion parameters in total, Tencent said, although only about 49 billion are used for any given text request.
<iframe src="https://hindustansphere.com/embed/cluster/dff529b7806718138acd10b122cd77b4e7785b33" width="100%" height="320" style="border:0;max-width:680px" loading="lazy" title="China's Tencent releases new open-source AI model for coding, research tasks"></iframe>
