Best Inference agent skills
Serving model predictions in production — routing, batching and accelerated pipelines. The 14 highest-ranked of the 14 agent skills tagged Inference in the Onei AI catalogue.
Everything tagged Inference: apps, skills and MCP servers Best Inference AI tools (apps), ranked
-
by Hugging Face
Run machine learning models directly in the browser or Node with Transformers.js — no inference server required.
-
by NVIDIA
Picks the right vLLM or SGLang runtime for your Jetson generation and JetPack version, then produces a working OpenAI-compatible serving command.
Also: Deployment, GPU, NVIDIA
-
by NVIDIA
NVIDIA's official skill for bringing up Dynamo inference routing — pick a router mode, enable KV-aware routing, and smoke-test the frontend endpoint before claiming anything works.
Also: NVIDIA
-
by NVIDIA
NVIDIA's official skill for generating and validating runnable gst-launch DeepStream pipelines from a plain-language description of the video inference you want.
Also: Computer Vision, NVIDIA
-
by Hugging Face
Choose and run the right local model with llama.cpp and GGUF — quantisation, hardware fit, and local serving.
-
by NVIDIA
Trains, distils, quantises, evaluates, exports and runs inference for RT-DETR real-time object detection in NVIDIA TAO, routing training through AutoML hyperparameter search by default.
Also: Computer Vision, Docker, GPU
-
by Replicate
Replicate's official skill for running models via its API — predictions, polling, Prefer: wait, webhooks with signature validation, streaming and file handling.
Also: Official
-
by NVIDIA
Turns a plain-language weather question into a working Earth2Studio inference script — picks the AI forecast model, a compatible data source, an IO backend, and the step count.
-
by NVIDIA
NVIDIA's official skill for deploying and operating Nemotron Speech (Riva) NIMs — ASR, text-to-speech and translation, cloud-hosted or self-hosted on your own GPUs.
-
by AMD
AMD's official skill for CPU inference: brings up a single vLLM + zentorch endpoint on an EPYC server, sized to the socket it runs on.
Also: Deployment, Docker, Official
-
by AMD
AMD's official skill for standing up a vLLM endpoint on Instinct MI300X/MI325X/MI350X/MI355X GPUs — detection, recipe lookup, launch and health check in one flow.
Also: Deployment, GPU, Official
-
by NVIDIA
Inspects the host's hardware, OS, CUDA driver and existing tooling, recommends one Holoscan SDK install method with a reason, then hands off to the matching install skill.
-
by NVIDIA
Runs NVIDIA's NV-Reason-CXR-3B chest X-ray reasoning model through a documented wrapper, locally on GPU or via the public Hugging Face Space, and returns the model's full reasoning trace as engineering evidence.
Also: Computer Vision, GPU, NVIDIA
-
by Anthropic
Authoritative reference for the Claude API and Anthropic SDKs — model IDs, pricing, parameters, streaming, tool use, MCP, agents, prompt caching, and token counting.
How this list is ranked
Ranked by 20 points for an editor's pick, plus 4 points per copy of the install command or SKILL.md up to 10, plus a point per 5 page views up to 100; ties go to the most recently updated. Discontinued skills are never ranked.