Cointime

Download App
iOS & Android

MiniMax M3 Officially Open-Sourced with Native Multimodal Support for One Million Contexts

According to monitoring by Dongcha Beating, the domestic large model company MiniMax has officially open-sourced the weights of its native multimodal mixture of experts (MoE) model MiniMax M3 on Hugging Face. MiniMax M3 has a total parameter count of 428 billion, with 23 billion parameters activated per token, and natively supports one million ultra-long contexts. To reduce deployment memory costs, the development team has simultaneously released an MXFP8 quantized version, compatible with mainstream inference frameworks such as SGLang, vLLM, and Transformers. In terms of multimodal design, MiniMax M3 conducts joint training of text, images, and videos during the pre-training phase to achieve native semantic fusion, rather than aligning multimodal data in the post-training phase. The model operates in two inference modes: the Thinking mode for complex logic and tool orchestration, and the Non-thinking mode for low-latency dialogue and code generation. The underlying kernel supporting one million ultra-long contexts is the lightweight attention kernel library MiniMax Sparse Attention (MSA), which is also open-sourced. Official data shows that MSA employs a grouped query attention (GQA) chunk retrieval mechanism, achieving over 9 times pre-fill acceleration and 15 times decoding speedup in tests with one million tokens on the NVIDIA Blackwell (SM100) architecture, while significantly reducing inference costs.

Comments

All Comments

Recommended for you

  • BTC Falls Below $66,000

    Market data shows that BTC has fallen below $66,000, currently priced at $65,977.25, with a 24-hour decline of 1.34%. The market is experiencing significant volatility, so please ensure proper risk management.
  • ETH Falls Below $1800

    Market data shows that ETH has fallen below $1800, currently priced at $1799.84, with a 24-hour decline of 1%. The market is experiencing significant volatility, so please ensure proper risk management.
  • CLARITY Act Proposes $150 Million Funding to Combat Digital Asset Crimes

    On June 16, U.S. Senator Cynthia Lummis posted on the X platform, stating that the CLARITY Act will allocate $150 million to support law enforcement in tracking down fraudsters and other criminals in the digital asset space, enhancing efforts to combat cryptocurrency-related criminal activities.
  • Trump: Strait of Hormuz Will Fully Resume Navigation by Friday

    Trump: The Strait of Hormuz will fully resume navigation by Friday.
  • SK Hynix Responds to Rumors of 100 Trillion Won Shareholder Return Plan

    On June 16, SK Hynix addressed market rumors regarding a proposed 100 trillion won shareholder return policy, stating that the reported figure is inaccurate. The company indicated that it is exploring various options to enhance shareholder value, but has never discussed the specific scale of shareholder returns mentioned in the reports.
  • Xiaohongshu's Valuation Reached $50 Billion in Private Secondary Market Trading

    On June 16, media reports cited informed sources revealing that Xiaohongshu's valuation in private secondary market trading once reached as high as $50 billion.
  • DeepSeek's First Round of Financing May Be Finalized with Liang Wenfeng Investing Approximately 20 Billion Yuan

    On June 16, it was reported from multiple investment institutions that DeepSeek's first round of financing may have been finalized. Founder Liang Wenfeng is the largest single investor in this round, contributing approximately 20 billion yuan. Tencent has invested about 10 billion yuan; the CATL system has contributed around 5 billion yuan, including investments from CATL and Puquan Capital; NetEase, JD.com, Monolith Lisi Capital, and IDG Capital have each invested about 3 billion yuan; Zhengxin Valley Investment and Shixiang Technology have each contributed approximately 1.5 billion yuan. (Ke Chuang Ban Daily)
  • HYPE Surges Over 13% Today, Breaking Previous High at $75.8

    On June 15, market data showed that HYPE surged over 13% today, breaking the previous high of $75.6, currently priced at $75.8.
  • European Parliament Votes to Approve EU-US Trade Agreement Legislation

    On June 16, the European Parliament held a final vote in Strasbourg, France, approving legislation related to the EU-US trade agreement. Following the procedure, the legislative text will be submitted to the EU Council for approval. On May 20, representatives from the European Parliament and the EU Council reached an agreement on the legislative proposal concerning the EU-US trade agreement, agreeing to implement tariff concessions on products imported from the US while strengthening related safeguards to protect the interests of the EU and its member states. Previously, US President Trump threatened to significantly increase tariffs on EU products imported into the US if the EU did not fulfill the agreement by July 4.
  • Robinhood Announces 10% Layoff, Anticipates Approximately $28 Million in Restructuring Costs

    On June 16, Robinhood (HOOD) announced on Tuesday that it will lay off about 10% of its full-time employees and simultaneously close the recruitment process for a small number of existing vacancies. The company expects the layoffs to incur approximately $20 million in employee severance and benefits costs, along with about $8 million in equity compensation expenses, totaling around $28 million in restructuring costs, which will be recognized in the second quarter of 2026. Following the announcement, Robinhood's pre-market stock price rose by 1.3%.