Cornserve: Easy, Fast, and Scalable Multimodal AI

Cornserve is an execution platform for multimodal AI. It performs model fission and automatic sharing of common components across applications on your infrastructure.

• Model fission

  ---

  Split up your complex models into smaller components and scale them independently.

• Automatic sharing

  ---

  Common model components are automatically shared across applications.

• Multimodal-native

  ---

  Cornserve is built multimodal-native from the ground up. Image, video, audio, and text are all first-class citizens.

• Deploy to K8s with one command

  ---

  One-command deployment to Kubernetes with Kustomize.

• Observability

  ---

  Built-in support for OpenTelemetry to monitor your apps and requests.

• Open Source, Apache-2.0

  ---

  Cornserve is open-source with the Apache 2.0 license and is available on GitHub.