OVHcloud launches AI endpoints to simplify and democratise access to AI models – CRN

OVHcloud launches AI Endpoints, a serverless solution that enables developers to effortlessly add high-value AI functions to their apps. With over 40 advanced and powerful open-source LLM and generative AI models, addressing use cases such as chatbots, text-to-speech or coding assistance, AI Endpoints makes it easier to democratise AI whatever the size of the organisation. Without the need to manage the underlying infrastructure or requiring Machine Learning expertise, AI Endpoints enables easy access to open-source AI models hosted in a trusted Cloud environment.

AI ready to consume: easily level-up business applications

OVHcloud AI Endpoints enables developers to test AI features in a sandbox environment before deploying at scale in applications, internal tools, or business processes. Use cases include:
Integrating LLMs into applications: Easily add conversations through agents. With real-time, natural language interactions, AI Endpoints helps improve user engagement or automate customer service at scale.
Text Extraction: Advanced machine learning models automatically extract, interpret, and organise unstructured data, playing a key role in ETL (Extract, Transform, Load) pipelines to improve operational efficiency.
Bring speech to your app: Through APIs, the service converts spoken language into text and vice versa, enabling transcription and interactive voice-based transcriptions.
Coding assistance: With tools like Continue, developers can integrate private, real-time AI assistance directly into their IDEs. Code suggestions, error detection, task automation all improve both productivity and code quality.
A serverless platform answering organisations’ need for strategic autonomy

OVHcloud’s sovereign cloud infrastructure gives peace of mind to developers, assuring them that data is hosted in Europe, and is protected against non-European regulations, providing both technical and strategic autonomy.

The cloud is central to AI and AI Endpoints runs on OVHcloud’s energy-efficient infrastructure, powered by water-cooled servers in ecofriendly data centers. This helps reduce the environmental impact of AI workloads, without compromising performance.

AI Endpoints promotes full model transparency through open weight AI models. This ensures that organisations can implement the same models on their infrastructure or deploy them on other Cloud services, whilst keeping control over data.

“We are excited to launch AI Endpoints and are humbled by the incredible feedback we get from our amazing community. With support for the most diverse and sought after open source LLM models, AI Endpoints helps to democratise AI so developers can add to their apps the most cutting-edge models. Our solution enables them to do this easily in a trusted cloud environment with full confidence in OVHcloud’s sovereign infrastructure” said Yaniv Fdida, Chief Product and Technology Officer, OVHcloud.