Back to list
Meituan LongCat Team Launches General 365 Benchmark: Gemini 3 Pro Leads with 62.8% Accuracy
Industry NewsMeituanLongCatAI Benchmarking

Meituan LongCat Team Launches General 365 Benchmark: Gemini 3 Pro Leads with 62.8% Accuracy

The Meituan LongCat team has officially introduced General 365, a new benchmark designed to evaluate the reasoning capabilities of large language models. In a comprehensive assessment of 26 mainstream models, the results reveal a significant performance gap in the industry. Gemini 3 Pro, currently identified as the top-performing model, achieved an accuracy rate of 62.8%. However, the benchmark results highlight a broader challenge: the vast majority of tested models failed to reach the 60% accuracy threshold. This release establishes a new standard for measuring AI intelligence and underscores the current limitations of complex reasoning in even the most advanced AI systems.

美团技术团队

Key Takeaways

  • New Evaluation Standard: Meituan's LongCat team has officially released General 365, a benchmark specifically designed to measure AI reasoning.
  • Gemini 3 Pro Performance: Among 26 mainstream models tested, Gemini 3 Pro emerged as the leader with an accuracy rate of 62.8%.
  • Industry-Wide Challenge: The majority of models tested failed to reach a 60% accuracy score, indicating a significant gap in current reasoning capabilities.
  • Comprehensive Testing: The benchmark results are based on the real-world performance of 26 different mainstream AI models.

In-Depth Analysis

The Introduction of General 365 by Meituan LongCat

The Meituan LongCat team has officially unveiled General 365, a new evaluation benchmark that aims to set a more rigorous standard for the artificial intelligence industry. As large language models (LLMs) continue to proliferate, the need for precise and challenging evaluation tools has become paramount. General 365 is positioned as a "new yardstick" for reasoning, focusing on the ability of models to process complex logical tasks rather than simply retrieving information or performing basic linguistic functions. By introducing this benchmark, the Meituan technical team provides a structured framework to differentiate between models that possess genuine reasoning depth and those that do not.

Analyzing the Performance of Gemini 3 Pro

In the initial testing phase conducted by the LongCat team, 26 mainstream models were subjected to the General 365 evaluation. The results identify Google's Gemini 3 Pro as the current industry leader in terms of reasoning accuracy. However, the data also reveals the difficulty of the benchmark itself; Gemini 3 Pro achieved an accuracy rate of 62.8%. While this score places it at the top of the current field, it also suggests that even the most advanced AI models currently available have significant room for growth when it comes to mastering complex reasoning. The 62.8% figure serves as a high-water mark for the industry, yet it remains far from perfect, highlighting the "frontier" nature of AI reasoning tasks.

The 60% Accuracy Threshold

Perhaps the most significant finding from the release of General 365 is the overall performance distribution across the 26 tested models. The Meituan LongCat team noted that the vast majority of these mainstream models were unable to reach a 60% accuracy level. In many academic and professional contexts, 60% is often viewed as a baseline for a "passing" grade or a minimum standard of competency. The fact that most models failed to meet this threshold suggests that complex reasoning remains a formidable obstacle for the current generation of AI. This widespread failure to reach the 60% mark underscores the necessity of benchmarks like General 365, which can expose the limitations of models that might otherwise appear highly capable in simpler evaluation scenarios.

Industry Impact

The release of General 365 is likely to have a profound impact on how AI development is prioritized. By establishing a benchmark where even the strongest models score in the low 60s, Meituan is pushing the industry toward more meaningful and difficult evaluations. This shift encourages developers to move beyond optimizing for simple benchmarks and instead focus on the core logical capabilities that define true intelligence. Furthermore, the transparency provided by testing 26 different models allows for a clearer understanding of where the industry stands as a whole. As models strive to surpass the 60% mark and challenge Gemini 3 Pro's lead, General 365 will serve as a critical tool for tracking the evolution of AI reasoning.

Frequently Asked Questions

Question: What is the primary purpose of the General 365 benchmark?

General 365 was developed by the Meituan LongCat team to serve as a new standard for evaluating the reasoning capabilities of large language models, providing a more accurate measure of AI intelligence.

Question: How many models were tested in the initial General 365 report?

The Meituan LongCat team tested 26 mainstream AI models to provide a comprehensive overview of the current state of reasoning performance in the industry.

Question: Which model currently holds the highest score on General 365?

Gemini 3 Pro currently holds the highest accuracy score on the General 365 benchmark, with a recorded accuracy of 62.8%.

Related News

Industry News

Parallel Cuts Labor Market Research Time and Cost in Half Using OpenAI GPT-6 Astra

According to a release by OpenAI, Parallel has successfully halved both the operational time and overall financial cost required to research and synthesize complex labor-market data by integrating GPT-6 Astra into its agentic workflows. By deploying GPT-6 Astra, Parallel's autonomous agents achieve double the processing efficiency compared to prior models while simultaneously cutting operational expenses by fifty percent. This deployment highlights tangible performance gains in practical agent-driven data analysis and labor research pipelines.

Industry News

OpenAI Outlines Core Priorities and Principles for Rigorous and Independent Third-Party AI Safety Assessments

OpenAI has officially outlined a set of priorities and foundational principles aimed at guiding effective third-party AI safety assessments. As artificial intelligence advances into increasingly capable territory, the organization emphasizes the necessity of independent, rigorous, and secure evaluations targeting frontier models and their corresponding technical safeguards. This initiative highlights the growing recognition across the artificial intelligence sector that internal safety testing alone is insufficient for establishing comprehensive risk mitigation. By formalizing expectations around external assessment methodologies, OpenAI aims to promote transparent verification practices and robust safety validation. The framework addresses the need for external evaluators to thoroughly examine frontier system capabilities and safeguard effectiveness without compromising security, setting a strategic direction for future independent AI auditing standards.

Apple Agrees to $250 Million Siri AI Settlement: Eligible iPhone Owners Can Now Submit Payout Claims
Industry News

Apple Agrees to $250 Million Siri AI Settlement: Eligible iPhone Owners Can Now Submit Payout Claims

Apple has agreed to a $250 million settlement following allegations that the company failed to deliver an advertised AI-upgraded Siri, opening the claims submission process for eligible smartphone purchasers. The resolution allows qualifying United States residents who purchased an iPhone 15 Pro, iPhone 15 Pro Max, or any iPhone 16 model beginning on June 10, 2024, to seek financial compensation through official claims channels. The legal outcome reflects heightened consumer expectations and stricter accountability surrounding marketed artificial intelligence features versus actual product rollouts. This massive financial payout marks an important development for affected consumers and sets a clear precedent for tech companies promoting advanced AI capabilities on flagship hardware.