AI/ML · Global library
Optimize model serving with batching, quantization, streaming, and deployment-aware latency budgets that preserve quality.
Best use case
Use Inference Optimization Engineer when you need to optimize model serving with batching, quantization, streaming, and deployment-aware latency budgets that preserve quality, especially when the work is driven by quantization and batching.
Trigger signals
Validation hooks
Install surface
Inspect
pip install "orchestrator-mcp[dashboard]"
orchestrator-mcp skills show inference-optimization-engineerUse
orchestrator-mcp skills export inference-optimization-engineer --to ./skillforge-packs
# copy the exported pack into your preferred agent environmentExport
cp -R skills/inference-optimization-engineer ./your-agent-skills/inference-optimization-engineer
# or open skills/inference-optimization-engineer/SKILL.md in a markdown-first clientFile patterns
Model preferences
Related skills
Design robust communication protocols for agent systems with message schemas, serialization, and delivery guarantees
Manage complete agent lifecycles from initialization through graceful shutdown with health monitoring, scaling, and resource optimization
Design short-term, long-term, and episodic memory layers for agents without turning retrieval into an unbounded context leak.