Elon Musk’s artificial intelligence (AI) company xAI is set to introduce a version of its Grok language model that can process visuals. This development was shared by the company recently. The news signifies that Grok can now handle visual information, such as documents, photos, and diagrams, making the model competitive with other multimodal platforms. The release from xAI introduces Grok-1.5V as the company’s first-generation multimodal model.
In addition to its strong text capabilities, Grok can now process a wide variety of visual information, including documents, diagrams, charts, screenshots, and photographs. xAI mentions that Grok-1.5V will soon be available to early testers and existing Grok users. Although not publicly released yet, xAI states that Grok 1.5V will soon become accessible to early testers and existing Grok users. The release also includes detailed benchmarking information comparing Grok 1.5V with multimodal competitors such as OpenAI’s ChatGPT-4V, Anthropic’s Claude 3 Sonnet and Claude 3 Opus, and the Google-owned Gemini Pro 1.5.
Moreover, it shares seven different examples of how Grok 1.5V can use visual information. These examples include the use of real-world images and translating charts into code. The release displays the Grok 1.5V benchmarking chart and features two examples of visual processing. The announcement of xAI’s introduction of Grok 1.5V, a multimodal version of its language model, marks a significant advancement in the capabilities of the AI platform.
This development will likely enable the platform to gain a stronger foothold in the AI market and attract new users looking for advanced visual processing capabilities.