Tools
- TorchServe
- BentoML
- Triton
- vLLM
- TensorRT
- ONNX Runtime
Patterns
- REST API
- Batch inference
- Streaming
- Edge deployment
Career
- ML engineer $130-300K
- Inference + AI $130-300K
Tools - TorchServe - BentoML - Triton - vLLM - TensorRT - ONNX Runtime Patterns - REST API - Batch inference - Streaming - Edge deployment Career - ML…