20 Jetson LLM Serve alternatives
Jetson LLM Serve: Picks the right vLLM or SGLang runtime for your Jetson generation and JetPack version, then produces a working OpenAI-compatible serving command. 20 agent skills do similar work, most sharing NVIDIA, GPU and Inference, ranked by how much they have in common with Jetson LLM Serve.
-
by NVIDIA
Inspects the host's hardware, OS, CUDA driver and existing tooling, recommends one Holoscan SDK install method with a reason, then hands off to the matching install skill.
-
by NVIDIA
Trains, distils, quantises, evaluates, exports and runs inference for RT-DETR real-time object detection in NVIDIA TAO, routing training through AutoML hyperparameter search by default.
-
by NVIDIA
Runs NVIDIA's NV-Reason-CXR-3B chest X-ray reasoning model through a documented wrapper, locally on GPU or via the public Hugging Face Space, and returns the model's full reasoning trace as engineering evidence.
-
by NVIDIA
Turns a plain-language weather question into a working Earth2Studio inference script — picks the AI forecast model, a compatible data source, an IO backend, and the step count.
-
by NVIDIA
NVIDIA's official skill for deploying and operating Nemotron Speech (Riva) NIMs — ASR, text-to-speech and translation, cloud-hosted or self-hosted on your own GPUs.
-
by AMD
AMD's official skill for standing up a vLLM endpoint on Instinct MI300X/MI325X/MI350X/MI355X GPUs — detection, recipe lookup, launch and health check in one flow.
Also: Deployment, GPU, Inference
-
by Hugging Face
Choose and run the right local model with llama.cpp and GGUF — quantisation, hardware fit, and local serving.
Also: Inference, Local Models
-
by Deno
Deploy Deno applications to production on Deno Deploy — CLI workflows, environment config, KV, and custom domains.
Also: Deployment, Edge
-
by NVIDIA
NVIDIA's official skill for bringing up Dynamo inference routing — pick a router mode, enable KV-aware routing, and smoke-test the frontend endpoint before claiming anything works.
-
by NVIDIA
NVIDIA's official skill for generating and validating runnable gst-launch DeepStream pipelines from a plain-language description of the video inference you want.
-
by AMD
AMD's official skill for CPU inference: brings up a single vLLM + zentorch endpoint on an EPYC server, sized to the socket it runs on.
Also: Deployment, Inference
-
by NVIDIA
Diagnoses wrong gradients in differentiable NVIDIA Warp programs by measuring first — comparing autodiff against finite differences on a shrunk reproduction before proposing any fix.
-
by NVIDIA
GPU-accelerated Mean-CVaR and Mean-Variance portfolio construction with NVIDIA cuOpt: scenario generation, variance-capped SOCP allocations, efficient frontiers, backtests and rebalancing.
-
by NVIDIA
NVIDIA's official skill for DALI's imperative dynamic-mode API — write GPU data loading as ordinary Python, or migrate an existing pipeline-mode graph across.
-
by NVIDIA
NVIDIA's official onboarding skill for CUDA-Q — installs the platform, writes your first quantum kernel, picks a GPU simulator and routes you to real QPU hardware.
-
by NVIDIA
NVIDIA's own guidance for moving pandas workloads onto GPU DataFrames with cuDF and dask-cuDF — when it pays off, and how to keep results identical.
-
by Hugging Face
Deploy and maintain applications on Hugging Face Spaces — SDK choice, GPU hardware, model loading, and debugging.
Also: Deployment, GPU
-
by NVIDIA
Deploy, configure and troubleshoot the NVIDIA RAG Blueprint from your agent — Docker Compose, Helm or library, with feature toggles for VLM, guardrails and agentic RAG.
Also: Deployment, NVIDIA
-
by AMD
AMD's official meta-skill: permanently reroutes an agent's image generation, text-to-speech and speech-to-text to a local Lemonade Server instead of a paid cloud API.
Also: Local Models
-
by Cloudflare
Cloudflare's official platform skill — Workers, Pages, storage, AI, networking, security, and IaC in one reference.
Also: Edge
