On premises Teammates (Kubernetes hosted)

It is possible to extend Kubiya with your Teammates. Using custom Teammates allows you to provision pre-defined environments with common tools and solutions such as scripts, repositories and binaries.

Kubiya can invoke the different tools and provide a conversational interface to them

Custom Teammates are running from your environment using local runners. You'll need to setup a local runner before being able to create and use custom Teammates.

Architecture

  • Once a Teammate is created, users can invoke it using the /agent slash command or from within active conversations

  • Kubiya will be able to provision or reuse a container to serve the profile on your own Kubernetes cluster for each Teammate in a user-based way.

  • Self-hosted Teammates offer a flexible solution for organizations seeking to integrate Large Language Models (LLMs) into their infrastructure. Key points include:

    • Custom Hosting: Deploy Teammates on your own infrastructure, providing control over performance, security, and integration.

    • Bring Your Own LLM: Users have the option to integrate their own LLMs with these Teammates, allowing for personalized and specialized use cases.

    • Scalability and Customization: Tailor Teammate deployment and management according to specific organizational needs, leveraging Kubernetes for scalability and maintenance.

    • Enhanced Security and Compliance: Hosting Teammates in-house aligns with internal security protocols and compliance requirements.

    This approach provides a versatile and secure platform for utilizing advanced language models within your unique ecosystem.

Last updated