AI/ML · Global library
Design intelligent load balancing for LLM inference with request routing, session affinity, and dynamic capacity management
Best use case
Use LLM Load Balancer Designer when you need to design intelligent load balancing for LLM inference with request routing, session affinity, and dynamic capacity management, especially when the work is driven by load balancing and request routing.
Trigger signals
Validation hooks
Install surface
Inspect
pip install "orchestrator-mcp[dashboard]"
orchestrator-mcp skills show llm-load-balancer-designerUse
orchestrator-mcp skills export llm-load-balancer-designer --to ./skillforge-packs
# copy the exported pack into your preferred agent environmentExport
cp -R skills/llm-load-balancer-designer ./your-agent-skills/llm-load-balancer-designer
# or open skills/llm-load-balancer-designer/SKILL.md in a markdown-first clientFile patterns
Model preferences
Related skills
Design robust communication protocols for agent systems with message schemas, serialization, and delivery guarantees
Manage complete agent lifecycles from initialization through graceful shutdown with health monitoring, scaling, and resource optimization
Design short-term, long-term, and episodic memory layers for agents without turning retrieval into an unbounded context leak.