Cointime

Download App
iOS & Android

a16z Enters AI 'Third-Party Evaluation': Vals Secures $40 Million Funding

According to monitoring by Dongcha Beating, AI model evaluation company Vals AI has completed a $40 million Series A funding round, achieving a valuation of $400 million, led by a16z. Existing investors such as 8VC, Pear VC, and Bloomberg Beta also participated. Vals specializes in third-party evaluations of large models. Currently, many models report their performance metrics based on self-assessments by the manufacturers. Vals, however, conducts unified testing of different models using real tasks from programming, finance, law, and healthcare. The company claims its results have been cited in model cards from OpenAI, Anthropic, Google, Meta, and xAI, with this year's revenue already reaching eight times that of the entire year of 2025. a16z is particularly interested in the value of this 'third-party evaluation.' Public benchmarks are increasingly susceptible to score manipulation, inclusion of training data, and even targeted optimizations by manufacturers, meaning high scores on leaderboards do not necessarily equate to real-world usability. Additionally, Vals has fully opened Vals Smith, allowing users to create coding benchmarks directly from any GitHub repository. The system extracts real development tasks from historical pull requests and uses hidden tests to check whether models can complete them. This enables companies to directly test which model is best suited for their codebase, rather than relying solely on public leaderboards.

Comments

All Comments

Recommended for you

  • Jack Ma Increases Stake, Buying Over HKD 600 Million in Alibaba's Hong Kong Stocks

    According to sources speaking to the Science and Technology Innovation Board Daily on the 25th, as Alibaba initiates a placement financing, Alibaba founder Jack Ma has been continuously increasing his stake in Alibaba's Hong Kong stocks, with the total amount exceeding HKD 600 million, expressing strong confidence in Alibaba's AI prospects.
  • Jack Ma Increases Stake, Buys Over HKD 600 Million in Alibaba Shares

    According to sources speaking to the Science and Technology Innovation Board Daily on the 25th, as Alibaba initiates a placement financing, Alibaba founder Jack Ma has been increasing his stake in Alibaba's Hong Kong shares for several consecutive days, with the total amount exceeding HKD 600 million, expressing strong confidence in Alibaba's AI prospects.
  • BTC Falls Below $79,000

    Market data shows that BTC has fallen below $79,000, currently priced at $78,993.01, with a 24-hour increase of 1.85%. The market is experiencing significant volatility, so please ensure proper risk management.
  • BTC Falls Below $79,000

    Market data shows that BTC has fallen below $79,000, currently priced at $78,993.01, with a 24-hour increase of 1.85%. The market is experiencing significant fluctuations, so please ensure proper risk management.
  • BTC Falls Below $80,000

    Market data shows that BTC has fallen below $80,000, currently priced at $79,983.76, with a 24-hour increase of 3.33%. The market is highly volatile, so please ensure proper risk management.
  • BTC Drops Below $80,000

    Market data shows that BTC has dropped below $80,000, currently priced at $79,983.76, with a 24-hour increase of 3.33%. The market is highly volatile, so please ensure proper risk management.
  • Hyperliquid Policy Center Urges US SEC and CFTC to Adopt Unified Perpetual Contract Framework

    On August 25, the Hyperliquid Policy Center (HPC) submitted comments to the US SEC and CFTC, stating that the two agencies have been striving to find answers regarding the classification of perpetual contracts over the past year. HPC believes that perpetual contracts for stocks, which possess traditional features of futures contracts, can be classified as securities futures. HPC urges the US SEC and CFTC to establish a unified classification system for perpetual contracts, based on the characteristics of each contract and its trading methods, grouping similar products together regardless of whether they reference Bitcoin, crude oil, or individual securities. HPC calls for the US SEC and CFTC to take the following four actions: 1. Confirm that the definition of securities futures includes the established features of futures contracts, allowing cash-settled stock perpetual contracts with these features to be listed as securities futures. 2. Retain the flexibility that trading venues currently have in making product listing decisions. 3. Maintain consistency in classification between the two agencies so that perpetual contracts, regardless of the underlying asset, receive the same threshold classification. 4. Modernize the securities futures framework to revitalize the category and adapt to new product structures.
  • Hyperliquid Policy Center Urges Unified Perpetual Contract Framework from US SEC and CFTC

    On August 25, the Hyperliquid Policy Center (HPC) submitted comments to the US SEC and CFTC, stating that both agencies have been working over the past year to find answers regarding the classification of perpetual contracts. HPC believes that perpetual contracts for stocks, which possess traditional characteristics of futures contracts, can be classified as security futures. HPC urges the US SEC and CFTC to establish a unified classification system for perpetual contracts, based on the characteristics of each contract and its trading methods, grouping similar products together regardless of whether they reference Bitcoin, crude oil, or individual securities. HPC calls for the US SEC and CFTC to take the following four actions: 1. Confirm that the definition of security futures includes the established characteristics of futures contracts, allowing cash-settled stock perpetual contracts with these characteristics to be listed as security futures. 2. Retain the flexibility that trading venues currently have in product listing decisions. 3. Maintain consistency in classification between the two agencies so that perpetual contracts, regardless of the underlying asset, receive the same threshold classification. 4. Modernize the security futures framework to revitalize the category and adapt to new product structures.
  • BTC Surpasses $80,000

    Market data shows that BTC has surpassed $80,000, currently priced at $80,059.99, with a 24-hour increase of 3.35%. The market is highly volatile, so please ensure proper risk management.
  • BTC Surpasses $80,000

    Market data shows that BTC has surpassed $80,000, currently priced at $80,059.99, with a 24-hour increase of 3.35%. The market is experiencing significant volatility, so please ensure proper risk management.