Andrews Kangah
Speaker at AMLD Africa 2024
Ata serves as the Lead Software and DevSecOps Engineer at MinoHealth AI Labs, an AI Healthtech company, and KaraAgro AI Labs, an AI-powered Plant & Pest Disease Detection and Precision Agriculture platform. Ata contributed in the past to The Startup and Better Programming on Medium as a content creator. He was also a mentor at the 2021 Google Africa Developers Scholarship Program as a cloud track instructor. Prior to his current role, Ata was a Contingent Software Engineer at Morgan Stanley, where he contributed to the Central Tools team.
At AMLD Africa
United States International University Africa, Nairobi, Kenya
Deploying Models in Production: Optimization, Speed, and Scalability
While models can generate remarkable predictions and valuable outputs, their true worth lies in their accessibility to end-users. Manual deployment processes are often cumbersome and costly, hindering the efficient delivery of models for end-users. Automated deployments offer a promising alternative that ensures rapid delivery of updated models and numerous other benefits. Efficient deployment mechanisms must prioritize resource utilization, speed, and scalability to ensure robust and enriching user experiences. Techniques like pipelines, containerization, microservice architecture and auto-scaling infrastructure are some of the explorable options in optimizing deployments. In this workshop, we explore an industry-centric perspective on model deployment and system architectures, drawing from minoHealth AI's deployment practices, to showcase the efficiency gains achievable by doing it right. We also provide insights into optimizing inference and generation processes and scalability considerations for deployments.
