Serving

Serving

Publishing and deploying your models has never been this easy. With one click you’re able to deploy models on Kubernetes clusters quickly and easily. 

cnvrg supports three types of endpoints: web services, kafka streams and batch predictions. For web services, cnvrg will automatically encase your code and models in a lightweight REST API and expose it to the web. It will generate an authentication token to protect the use of the endpoint and automatically build comprehensive model tracking and monitoring tools. 

For kafka streams, cnvrg supports integrating model predictions with existing Kafka streams. This allows you to ingest Kafka streams and perform realtime predictions with complex model monitoring features. 

For batch predictions, cnvrg will create a model endpoint that will be remain inactive with 0 pods until a prediction is made. The endpoint will then scale up as needed and scale back down after the prediction is completed.

Read more in the docs