⚙️Model Serving
Also known as ML Model Serving, Model Deployment, Model Endpoint
A model put behind a web address. Apps send it data and get answers.
Think of it like
Think of it like a shop window with a bell. Anyone can ring, and someone comes to help.
Example
Emma's team serves a spam model at a web address. The email app sends each new message to it and gets back a spam score in about 20 milliseconds.
Why it matters
A model nobody can call is not doing any work. Serving is the step that puts it to use.
Definition
Example code
bash
curl -X POST http://localhost:8080/predict -d '{"text": "You won a prize!"}'
{"spam": 0.97}Common mistake
Key takeaways
- 1Load once. Then wait for calls.
- 2Input in, answer out. At a web address.
- 3Swap safely. No downtime.