Persistent Systems, a global Digital Engineering and Enterprise Modernization leader, announced the launch of GenAI Hub, an innovative platform designed to accelerate the creation and deployment of Generative AI applications within enterprises. This platform seamlessly integrates with an organization’s existing infrastructure, applications, and data, enabling the rapid development of tailored, industry specific GenAI solutions. GenAI Hub supports the adoption of GenAI across various Large Language Models and clouds, without provider lock-in. To effectively leverage the potential of GenAI and translate ideas into tangible business outcomes, enterprises must seamlessly integrate it into their existing systems. With a wide array of AI models ranging from extensive to specialized, clients require a robust platform like the GenAI Hub. This platform simplifies the development and management of multiple GenAI
models, expediting market readiness through pre-built software components, all while upholding
responsible AI principles.
The GenAI Hub is comprised of five major components:
\ Playground is a no-code tool for domain experts to explore and apply GenAI with LLMs on
enterprise data without the need for programming skills. It provides a single uniform
interface to LLMs from private providers like Azure OpenAI, AWS Bedrock, and Google
Gemini, and open models from Hugging Face like LLaMA2 and Mistral.
\ Agents Framework provides a versatile architecture for GenAI application development,
leveraging libraries like LangChain and LlamaIndex for innovative solutions, including
Retrieval Augmented Generation
Evaluation Framework uses an “AI to validate AI” approach and can auto-generate
ground-truth questions to be verified by a human-in-the-loop. It employs metrics to track
application performance and measures any drift and bias that can be addressed.
\ Gateway serves as a router across LLMs, enabling application compatibility and improving
the management of service priorities and load balancing. It also offers detailed insights into
token consumption and associated costs.
\ Custom Model Pipelines facilitate the creation and integration of bespoke LLMs and Small
Language Models into the GenAI ecosystem, supporting a streamlined process for
data preparation and model fine-tuning suitable for both cloud and on-premises
deployments.
The GenAI Hub streamlines the development of use cases for enterprises, offering step-by-step
guidance and seamless integration of data in LLMs, enabling the rapid creation of efficient and
secure GenAI solutions at scale, whether for end users, customers, or employees.
Praveen Bhadada, Global Business Head–AI, Persistent:
“At Persistent, we have always stayed ahead of the curve to capitalize on the latest industry
technology trends, and now we’re reaching new frontiers in GenAI to solve critical enterprise
challenges and turbocharge client growth. With the Persistent GenAI Hub, clients can embrace
a “GenAI-First” strategy, delivering AI-powered applications and services at scale. They can
accelerate innovation while practicing responsible AI, leveraging pre-built accelerators and
evaluation frameworks, and optimizing costs with a cross-LLM strategy. The GenAI Hub
enables enterprises to streamline operations, enhance customer experiences, and identify new
avenues for growth.”
Mark Troller, CIO, Tangoe:
“Tangoe has been leading the industry in automation for more than a decade, and with
Persistent’s expertise and support, we have developed a secure generative AI chatbot that
empowers employees to drive higher efficiency in their daily work. This collaboration has not
only opened new doors for innovation but also sharpened our competitive edge. We’ve seen
strong early adoption from our employees and look forward to building more advanced
capabilities using this emerging technology.”
Thomas Reuner, Executive Research Leader and Head of EMEA, HFS Research:
“We are seeing a shift in the market as organizations look to scale out their GenAI deployments.
A pause of reflection often follows this shift as they encounter new deployment challenges and
risks. Persistent’s GenAI Hub provides both an evaluation framework to validate the AI
approach and a comprehensive set of capabilities to accelerate the time to value to help
organizations navigate those challenges.
