Subscribe to our newsletter and stay informed

Check out our list of top companies

Check out our carefully compiled lists of the most relevant and impactful companies within their fields.

Check out our list of top unicorns

Read and learn about the biggest companies that various countries have produced, how they made it, and what the future looks like for them.

xAI Launches Grok-1.5 with Improved Reasoning Capabilities

xAI's Grok-1.5 enhances AI problem-solving with advanced reasoning and longer context handling
March 29, 2024

xAI has announced the release of Grok-1.5, a new model boasting significant improvements in reasoning capabilities and an expanded context length of up to 128,000 tokens. This development is set to be available soon for early testers and existing users on the X platform, highlighting a step forward in the company's AI offerings.

Grok-1.5 is designed to excel in various tasks, especially in coding and mathematics, where it has demonstrated remarkable performance. In testing, the model achieved a 50.6% score on the MATH benchmark and a 90% score on the GSM8K benchmark, both of which assess a wide range of math problems. Additionally, it scored 74.1% on the HumanEval benchmark, reflecting its proficiency in code generation and problem-solving.

A key feature of Grok-1.5 is its ability to process and interpret long text inputs, allowing it to handle complex prompts and perform text retrieval tasks effectively, even within large contexts. This enhanced memory capacity is a significant improvement over previous models, enabling the model to utilize information from longer documents more efficiently.

The infrastructure supporting Grok-1.5 incorporates a custom distributed training framework utilizing JAX, Rust, and Kubernetes. This setup facilitates the rapid prototyping and scalable training of new architectures, addressing the challenge of maintaining reliability and uptime during the training of large language models. The team behind Grok-1.5 has also optimized various aspects of the training process to ensure minimal downtime.

As Grok-1.5 prepares for a wider release, xAI is inviting feedback from its early users to further refine the model. This launch represents not only an advancement in AI technology but also xAI's commitment to pushing the boundaries of what's possible in artificial intelligence research and application.

More about:  | |

Last related articles

chevron-down linkedin facebook pinterest youtube rss twitter instagram facebook-blank rss-blank linkedin-blank pinterest youtube twitter instagram