What if I want to serve a Huggingface model on ClearML? Where do I start? In general, machine learning engineers know by now that a good model serving engine is invaluable when serving models in production. These days, NVIDIA’s Triton inference engine is a popular option to do so, but it is lacking in some respects.
Iguazio users can now run their ML workloads on AWS EC2 Spot instances. When running ML functions, you might want to control whether to run on Spot nodes or On-Demand compute instances. When deploying Iguazio MLOps platform on AWS, running a job (e.g. model training) or deploying a serving function users are now able to choose to deploy it on AWS EC2 Spot compute instances.
Machine learning is used across industries and user communities for a wide variety of predictive analytics needs – use cases ranging from sales forecasting to churn reduction, customer lifetime value, inventory optimization, capital allocation and more.