20 Serving LLMs on AMD EPYC alternatives
Serving LLMs on AMD EPYC: AMD's official skill for CPU inference: brings up a single vLLM + zentorch endpoint on an EPYC server, sized to the socket it runs on. 20 agent skills do similar work, most sharing Inference, Deployment and Official, ranked by how much they have in common with Serving LLMs on AMD EPYC.
Back to Serving LLMs on AMD EPYC
-
by AMD
AMD's official skill for standing up a vLLM endpoint on Instinct MI300X/MI325X/MI350X/MI355X GPUs — detection, recipe lookup, launch and health check in one flow.
Also: AMD, Deployment, Inference, Official
-
by NVIDIA
Inspects the host's hardware, OS, CUDA driver and existing tooling, recommends one Holoscan SDK install method with a reason, then hands off to the matching install skill.
-
by NVIDIA
Trains, distils, quantises, evaluates, exports and runs inference for RT-DETR real-time object detection in NVIDIA TAO, routing training through AutoML hyperparameter search by default.
-
by NVIDIA
Deploy, configure and troubleshoot the NVIDIA RAG Blueprint from your agent — Docker Compose, Helm or library, with feature toggles for VLM, guardrails and agentic RAG.
Also: Deployment, Docker
-
by AMD
AMD's official meta-skill: permanently reroutes an agent's image generation, text-to-speech and speech-to-text to a local Lemonade Server instead of a paid cloud API.
-
by AMD
AMD's official skill for benchmarking vLLM/SGLang inference and driving GPU kernel optimization with Magpie and TraceLens trace analysis.
-
by NVIDIA
Picks the right vLLM or SGLang runtime for your Jetson generation and JetPack version, then produces a working OpenAI-compatible serving command.
Also: Deployment, Inference
-
by Replicate
Replicate's official skill for running models via its API — predictions, polling, Prefer: wait, webhooks with signature validation, streaming and file handling.
-
by Vercel
Vercel's official deployment skill — inspects project state, picks the right deploy path, and defaults to preview deployments with a claimable URL when no account is linked.
Also: Deployment, Official
-
by NVIDIA
NVIDIA's official skill for bringing up Dynamo inference routing — pick a router mode, enable KV-aware routing, and smoke-test the frontend endpoint before claiming anything works.
Also: Inference
-
by NVIDIA
Runs NVIDIA's NV-Reason-CXR-3B chest X-ray reasoning model through a documented wrapper, locally on GPU or via the public Hugging Face Space, and returns the model's full reasoning trace as engineering evidence.
Also: Inference
-
by NVIDIA
Turns a plain-language weather question into a working Earth2Studio inference script — picks the AI forecast model, a compatible data source, an IO backend, and the step count.
Also: Inference
-
by NVIDIA
NVIDIA's official skill for deploying and operating Nemotron Speech (Riva) NIMs — ASR, text-to-speech and translation, cloud-hosted or self-hosted on your own GPUs.
Also: Inference
-
by NVIDIA
NVIDIA's official skill for generating and validating runnable gst-launch DeepStream pipelines from a plain-language description of the video inference you want.
Also: Inference
-
by Hugging Face
Choose and run the right local model with llama.cpp and GGUF — quantisation, hardware fit, and local serving.
Also: Inference
-
by Hugging Face
Run machine learning models directly in the browser or Node with Transformers.js — no inference server required.
Also: Inference
-
by Anthropic
Authoritative reference for the Claude API and Anthropic SDKs — model IDs, pricing, parameters, streaming, tool use, MCP, agents, prompt caching, and token counting.
Also: Inference
-
by Railway
Railway's official agent skill: create projects, provision databases and buckets, deploy, manage variables and domains, and read build failures back — from the CLI, API or MCP server.
Also: Deployment
-
by mikehasa
Open-source agent skill that takes an AI-built app live on your own accounts: hosting, database, domain, email and payments, with a plan-and-approve workflow.
Also: Deployment
-
by Cloudflare
Cloudflare's routing skill for Next.js on Workers — sends the agent to vinext, the Vite-based Next.js runtime Cloudflare now recommends ahead of OpenNext.
Also: Deployment
