Guides you through adding inference deployment support for a new open-source LLM to the FastDeploy repository. Given a model path (local or HuggingFace/ModelScope hub), this skill walks through analyzing the model architecture, choosing the right base class, generating the model implementation file, updating registries, writing docs, and producing a deployment test script.
English通用 GPU 推理服务 nsys 性能抓取工具。根据用户的启动脚本自动注入 nsys 命令、构建带 nsys 的启动脚本,完成完整的 GPU profiling 抓取流程,输出 .nsys-rep…
ChineseIncludes Fastdeploy LLM Integration and other workflows.
Supported by the Atlas install prompt. Skill-specific requirements vary.
Pack stats
What’s included
Fastdeploy LLM Integration
Guides you through adding inference deployment support for a new open-source LLM to the FastDeploy repository. Given a model path (local or HuggingFace/ModelScope hub), this skill walks through analyzing the model architecture, choosing the right base class, generating the model implementation file, updating registries, writing docs, and producing a deployment test script.
Nsys Capture
通用 GPU 推理服务 nsys 性能抓取工具。根据用户的启动脚本自动注入 nsys 命令、构建带 nsys 的启动脚本,完成完整的 GPU profiling 抓取流程,输出 .nsys-rep 文件。
Quick start
- Choose your skills. Select individual skills above, or choose the entire pack.
- Copy the install prompt. Use Copy install prompt above the list.
- Send it to your agent. Paste into your coding agent’s chat. Your agent reviews the source and guides the setup.
Try it with your agent
After installation, start with a request like:
Use the Fastdeploy LLM Integration skill to help with my task.
Ask me for the context you need before getting started.Requirements & license
- A coding agent that can access your project files and install skills.
- Your agent checks each skill’s instructions, dependencies, and permissions during setup.
- Reported license for the skills shown: Apache-2.0. The author’s terms apply.