Elon Musk teases next-gen AI chatbot Grok-1.5 with superior coding and math skills Elon Musk teases next-gen AI chatbot Grok-1.5 with superior coding and math skills
Grok-1.5 is an advanced version of the Grok-1 AI model and comes with improved reasoning.
2 min read
Updated: Mar. 29, 2024 at 5:43 pm UTC
Cover art/illustration via CryptoSlate. Image includes combined content which may include AI-generated content.
Elon Musk announced that an upgraded iteration of his artificial intelligence firm xAI’s chatbot Grok may be released next week.
This revelation came via Musk’s social media post on March 29, following xAI’s announcement of Grok-1.5 in a blog post. The enhanced AI chatbot will initially be accessible to “early testers and existing Grok users on the social media platform.”
Additionally, Musk hinted at the ongoing development of Grok 2, which he anticipates will surpass current AI standards in all aspects.
Grok-1.5
Grok-1.5 is an advanced version of the Grok-1 AI model and comes with improved reasoning and a context length of 128,000 tokens.
xAI’s analysis indicates significant enhancements in the performance of its advanced chatbot, particularly in coding and math-related tasks. However, it falls short compared to Google’s Gemini Pro 1.5 and OpenAI’s GPT-4.
According to the firm:
“Grok-1.5 achieved a 50.6% score on the MATH benchmark and a 90% score on the GSM8K benchmark, two math benchmarks covering a wide range of grade school to high school competition problems. Additionally, it scored 74.1% on the HumanEval benchmark, which evaluates code generation and problem-solving abilities.”
Moreover, Grok-1.5 can utilize information from substantially longer documents, and the model can handle longer and more complex prompts while maintaining its instruction-following capability as its context window expands.
The firm added:
“Grok-1.5 is built on a custom distributed training framework based on JAX, Rust, and Kubernetes. This training stack enables our team to prototype ideas and train new architectures at scale with minimal effort.”
Grok is Open-source
Earlier this month, xAI took a significant step by open-sourcing the base code of Grok-1.
This decision arose as a response to a legal action initiated by Musk against OpenAI, the organization he once co-founded. Musk alleged that OpenAI has deviated from its original commitment to prioritize open-source model development over shareholder interests.
Meanwhile, xAI said the released code was “the raw base model checkpoint from the Grok-1 pre-training phase, which concluded in October 2023. This means that the model is not fine-tuned for any specific application, such as dialogue.” It added that the model was licensed under Apache License 2.0.
Mentioned in this article
Author 
Oluwapelumi Adejumo
Oluwapelumi values Bitcoin's potential. He imparts insights on a range of topics like DeFi, hacks, mining and culture, underlining transformative power.
Featured Story
Advertise Here
In this article
X
X (formerly Twitter) is an American social media company based in San Francisco, California, that was founded by Jack Dorsey, Noah Glass, Biz Stone, and Evan Williams in March 2006 and was launched July of the same year.
OpenAI
OpenAI is an AI research and deployment company committed to ensuring that general-purpose artificial intelligence helps all of humanity.
Google LLC is an American multinational technology company that is most commonly known for its search engine that was founded by Sergey Brin and Larry Page in 1998.
South African-born Elon Musk has founded several companies, including X.com (which later became PayPal), SpaceX and Tesla Motors.