Baichuan AI Releases Large-scale Model Baichuan 3 with Parameters Exceeding One Trillion

Baichuan AI Releases Large-scale Model Baichuan 3 with Parameters Exceeding One Trillion

On January 29th, Baichuan AI launched the big language design Baichuan 3 with criteria surpassing one trillion. In assessments such as CMMLU, GAOKAO, and AGI-Eval, Baichuan 3 declared to have actually exceeded GPT-4 in Chinese jobs.

In medical assessments such as MCMLE, MedExam, CMExam that test rational thinking capabilities, Baichuan 3’s Chinese efficiency is likewise declared to go beyond GPT-4 and is thought about the “best-performing big design for Chinese medical jobs”.

According to the intro, Baichuan AI has actually proposed different technical methods and options such as “vibrant information choice,” “significance conservation,” and “asynchronous CheckPoint storage” throughout the training procedure of Baichuan 3. The steady training time can reach more than one month, and the fault healing time does not surpass 10 minutes.

Baichuan AI formally mentioned that Baichuan 3 has actually made advancements in “iterative support knowing” innovation, additional boosting its semantic understanding and generation abilities. It has actually enhanced the format, rhythm, and expression of poetry development. For the extremely difficult literary design of Song Ci with variable formats, deep structures, and abundant rhythms, the produced material can likewise have cool parallelism, unified rhyme plans, permitting everybody to develop five-character controlled poems or seven-character quatrains applauding things or revealing ideas. They can document their goals and feelings through poems like “Qin Yuan Chun” or “Ding Feng Bo”.

Baichuan AI was developed on April 10, 2023, established by previous Sogou CEO Wang Xiaochuan. Presently, Baichuan 3 have actually been introduced on the main site of Baichuan AI.

SEE ALSO: Baichuan Launches the Model with the World’s Longest Context Window– Baichuan2-192K

Register today for 5 complimentary posts regular monthly!

Learn more

Leave a Reply

Your email address will not be published. Required fields are marked *