Warning: mkdir(): No space left on device in /var/www/tg-me/post.php on line 37

Warning: file_put_contents(aCache/aDaily/post/zaihuanews/--): Failed to open stream: No such file or directory in /var/www/tg-me/post.php on line 50
科技圈🎗在花频道📮 | Telegram Webview: zaihuanews/32105 -
Telegram Group & Telegram Channel
OpenAI揭秘GPT-4.5训练:10万块GPU,几乎全员上阵,有出现过“灾难性问题”

OpenAI近日披露了一些GPT-4.5研发细节,训练耗时两年,动用10万块GPU,几乎全员参与。过程中遭遇基础设施故障、隐藏Bug等问题,团队不得不“边修边训”。

模型性能较GPT-4提升约10倍,智能增强效果超出预期。OpenAI发现,未来突破关键在于数据效率,而非算力。系统架构正转向多集群,未来或需千万级GPU协作。

团队还分享了数据长尾效应与Scaling Law的关系,以及算法与系统协同设计的经验。GPT-4.5的成功验证了Scaling Law的长期有效性。

完整分享内容YouTube

📮投稿 ☘️频道 🌸聊天



tg-me.com/zaihuanews/32105
Create:
Last Update:

OpenAI揭秘GPT-4.5训练:10万块GPU,几乎全员上阵,有出现过“灾难性问题”

OpenAI近日披露了一些GPT-4.5研发细节,训练耗时两年,动用10万块GPU,几乎全员参与。过程中遭遇基础设施故障、隐藏Bug等问题,团队不得不“边修边训”。

模型性能较GPT-4提升约10倍,智能增强效果超出预期。OpenAI发现,未来突破关键在于数据效率,而非算力。系统架构正转向多集群,未来或需千万级GPU协作。

团队还分享了数据长尾效应与Scaling Law的关系,以及算法与系统协同设计的经验。GPT-4.5的成功验证了Scaling Law的长期有效性。

完整分享内容YouTube

📮投稿 ☘️频道 🌸聊天

BY 科技圈🎗在花频道📮


Warning: Undefined variable $i in /var/www/tg-me/post.php on line 283

Share with your friend now:
tg-me.com/zaihuanews/32105

View MORE
Open in Telegram


telegram Telegram | DID YOU KNOW?

Date: |

Spiking bond yields driving sharp losses in tech stocks

A spike in interest rates since the start of the year has accelerated a rotation out of high-growth technology stocks and into value stocks poised to benefit from a reopening of the economy. The Nasdaq has fallen more than 10% over the past month as the Dow has soared to record highs, with a spike in the 10-year US Treasury yield acting as the main catalyst. It recently surged to a cycle high of more than 1.60% after starting the year below 1%. But according to Jim Paulsen, the Leuthold Group's chief investment strategist, rising interest rates do not represent a long-term threat to the stock market. Paulsen expects the 10-year yield to cross 2% by the end of the year. A spike in interest rates and its impact on the stock market depends on the economic backdrop, according to Paulsen. Rising interest rates amid a strengthening economy "may prove no challenge at all for stocks," Paulsen said.

Telegram hopes to raise $1bn with a convertible bond private placement

The super secure UAE-based Telegram messenger service, developed by Russian-born software icon Pavel Durov, is looking to raise $1bn through a bond placement to a limited number of investors from Russia, Europe, Asia and the Middle East, the Kommersant daily reported citing unnamed sources on February 18, 2021.The issue reportedly comprises exchange bonds that could be converted into equity in the messaging service that is currently 100% owned by Durov and his brother Nikolai.Kommersant reports that the price of the conversion would be at a 10% discount to a potential IPO should it happen within five years.The minimum bond placement is said to be set at $50mn, but could be lowered to $10mn. Five-year bonds could carry an annual coupon of 7-8%.

telegram from us


Telegram 科技圈🎗在花频道📮
FROM USA