Tuan Luong
Title
Senior AI Engineer at Saigon Technology
About
Tuan Luong is a Senior AI Engineer at Saigon Technology with over 9 years of experience of experience in AI and software engineering. He holds a Master’s degree in Software Engineering, specializing in Data Science and Big Data. Tuan excels in developing sophisticated conversational AI systems, and he has profound expertise in deploying robust machine-learning models using frameworks like TensorFlow, PyTorch, and Keras. His technical prowess extends to cloud computing, with significant experience on platforms like AWS, Google Cloud, and Azure.
Topic
Scaling Deep Learning Models with Kafka and Triton in Microservices Architecture
1402
2:30 – 3:00 PM
Language
Vietnamese
Audience
Students
Description
This presentation discusses the integration of deep learning models into microservices architectures. He focuses on utilizing Apache Kafka for robust data handling and NVIDIA's Triton Inference Server to deploy AI models dynamically at scale. The session will highlight best practices for building modular and scalable AI applications, effective strategies for integrating Kafka and Triton, and tips for managing performance and reliability in production environments. This talk is tailored for developers, architects, and technical leads invested in advanced AI technologies and microservices infrastructure.
