Introduction In the previous blog posts (camel-tensorflow-serving and camel-torchserve), we discussed the recent release of Apache Camel 4.10 LTS, which introduced three new AI model serving components. 1 TorchServe component TensorFlow Serving component KServe component We previously wrote about the TorchServe and TensorFlow Serving components. This post introduces the KServe component, concluding the series. KServe Component KServe is a platform for serving AI models on Kubernetes. KServe defines an API protocol enabling clients to perform health checks, retrieve metadata, and run inference on model servers.

Continue reading ❯

AI

Observability is a pillar of any distributed Microservices oriented architecture. As the number of services to govern may rise in number, it’s very important to have a clear and easy way to understand (observe) what’s going on in a distributed system at any time. And this feature become even more important when you’re running your application in the cloud. What is Observability from Camel perspective The term Observability is often used with a wide perspective and may provide misunderstanding about what it really encompass.

Continue reading ❯

HOWTOS

Introduction As noted in the previous article, the recent release of Apache Camel 4.10 LTS introduced three new AI model serving components into its supported component family. 1 TorchServe component TensorFlow Serving component KServe component Previously we wrote about the TorchServe component, this time we introduce the TensorFlow Serving component. TensorFlow Serving component TensorFlow Serving is the serving feature provided by the popular machine learning framework TensorFlow. By using the Camel TensorFlow Serving component, you can invoke AI models deployed on the TensorFlow Serving model servers through their gRPC Client APIs.

Continue reading ❯

AI