AI/ML · Global library

LLM Model Server Architect

Design and implement production-grade LLM serving infrastructure with optimal throughput, latency, and cost efficiency

CodexClaude CodeKimi Codeorchestrator-mcp

Best use case

Use LLM Model Server Architect when you need to design and implement production-grade LLM serving infrastructure with optimal throughput, latency, and cost efficiency, especially when the work is driven by model serving and LLM server.

Trigger signals

model servingLLM serverinference APIvLLMTGImodel deployment

Validation hooks

latency-checkthroughput-validation

Install surface

Copy the exact command path you need.

Inspect

pip install "orchestrator-mcp[dashboard]"
orchestrator-mcp skills show llm-model-server-architect

Use

orchestrator-mcp skills export llm-model-server-architect --to ./skillforge-packs
# copy the exported pack into your preferred agent environment

Export

cp -R skills/llm-model-server-architect ./your-agent-skills/llm-model-server-architect
# or open skills/llm-model-server-architect/SKILL.md in a markdown-first client

File patterns

*.py*.yamlDockerfileserving/*.py

Model preferences

claude-opus-4gpt-4oclaude-haiku-3

Related skills

Adjacent packs to compose next.

Design robust communication protocols for agent systems with message schemas, serialization, and delivery guarantees

CodexClaude Code

Manage complete agent lifecycles from initialization through graceful shutdown with health monitoring, scaling, and resource optimization

CodexClaude Code

Design short-term, long-term, and episodic memory layers for agents without turning retrieval into an unbounded context leak.

CodexClaude Code

Apache-2.0 licensedUse it, fork it, redistribute it. No strings attached.Safety-first by designSecret redaction, release scanning, and no shell execution. Constraints are public.GitHub nativeEvery pack is a real folder. Fork, edit, PR. No hidden backend or proprietary pipeline.

LLM Model Server Architect

Copy the exact command path you need.

Adjacent packs to compose next.

Agent Communication Protocol Designer

Agent Lifecycle Manager

Agent Memory Designer