Description
I'm going to summarize the outline of Model Serving, one of the fields of MLOps. I'll explain what to do in the field of Model Serving through a framework called BentoML.
This session covers the following two major topics.
Model Serving Framework: BentoML, torchserve, tenrsorflowserving, triton-inference-server Model Serving Platform: kserve, yatai, sagemaker (deploy part)
I'll mainly show examples through BentoML and compare other frameworks.
Kim Seong-ryeol I'm working on Serving in the Naver Biz CIC advertising recommendation section.