(JW Insights) Mar 21 -- Chinese developers of ChatGPT-like artificial intelligence chatbots are hindered by issues such as low computing power and a shortage of high-end GPUs, reported Yicai Global on March 20.

The lack of computing power platforms is a problem widely shared in the industry, Zhou Ming, founder and chief executive of Beijing-based big model startup Langboat(北京澜舟科技), told Yicai Global. But even if this issue is resolved, others remain, Zhou noted.

The key is to enhance our understanding of the essence of big models, according to Zhou. To develop big models, the focus should be on optimizing algorithms to lower reliance on models and computing power, Zhou said. “We can make big models even with very small GPUs.”

The current number of graphic processing units is far from enough to meet the needs of DataGrand(达观数据), said Chen Yunwen, founder of the Chinese big data application services provider. The computing power problem of many small and mid-sized firms will be resolved if super-computing centers rent out their computing power, he noted.

A lack of computing resources has curbed the development of MOSS, the big language model of Fudan University Natural Language Processing Group, Prof. Qiu Xipeng said previously. MOSS is based on 32 of Nvidia's A100 Tensor Core GPUs, while ChatGPT, which was developed by US artificial intelligence startup OpenAI, is based on 30,000 A100 GPUs.

Training big language models, such as GPT-3, can cost more than $4 million, according to market analysts and technical experts, who note that most small and mid-sized businesses cannot afford to spend that much, said Yicai Global.

Chinese tech giant Baidu unveiled its equivalent of ChatGPT, the Ernie Bot, last week. The chatbot is based on a big model, and the Beijing-based company became the first Chinese internet firm to debut a product in the GPT field.

DataGrand also made a breakthrough with its independently developed large language model Caozhi, which could become one of China's first industrial application-level models, Yica Global learned from the Shanghai-based firm.

(Gao J)