Repository navigation
feat: 新增 tgi 的 examples 看护 - #215
Merged
Merged
Conversation
| # rounds are green (same policy as peft-examples.yml / accelerate-examples.yml). | ||
| # Re-enable: | ||
| # schedule: | ||
| # - cron: '30 */6 * * *' |
- 看护文件：tgi-examples.yml 薄触发器（每日 03:00 北京定时、手动 dispatch、PR 触发，三臂并发组）+ examples-guards/tgi 清单/约束/脚本 - setup 按 quick_start.md §4 配方构建：系统构建依赖 apt、rust 工具链 1.85.1、cargo release-opt 编译 launcher+router、uv 安装 server 依赖、 grpcio-tools/mypy-protobuf 代码生成；构建缓存落持久卷增量复用 - setup 环境持久化：uv 全套环境（UV_SYSTEM_PYTHON 等）供 run 步 start-tgi.sh 懒装 modelscope；PIP_CACHE_DIR 显式指向共享持久卷， torch_npu wheel 跨腿复用避免重复下载 - CUDA 排除清单（constraints-npu.txt）防 nvidia/cuda 依赖误装； max_parallel=1（场景独占整机 + cargo 共享 target 锁）
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
总结
将 TGI 用例看护接入 docs。
manifest 包含 4 条 supported、1 条 unsupported。
定时看护未开启（bring-up 阶段，跑绿几轮后开启）；保留手动触发，新增 PR 触发（待 #201 引擎 PR 运行支持合入后效）。
用例本体位于 cosdt fork 的 examples/npu/（tgi-example 分支），非拆分模式：看护对象与看护代码同仓。
变更文件
.github/workflows/tgi-examples.yml：薄触发器、PR 触发及三臂并发组配置。
examples-guards/tgi/examples_manifest.yaml：用例清单、支持情况及 CI 参数。
examples-guards/tgi/constraints-npu.txt：NPU 环境依赖约束。
examples-guards/tgi/scripts/{setup_example,run_example}.sh：环境准备与启动配方（release-opt 增量构建复用 runner 持久卷）。
验证
接入后的 NPU CI 待验证；