Tencent's Hy3 Model Features 295 Billion Parameters with 5.4% Hallucination Rate
Tencent has released the Hy3 open-source language model, which boasts a total of 295 billion parameters, with 21 billion active parameters at any given time. The model utilizes a mixture-of-experts...