From d191ec1b2b7baabff86fa31f20d1ce57457fc138 Mon Sep 17 00:00:00 2001 From: UsernameFull Date: Fri, 3 Jul 2026 21:17:44 +0800 Subject: [PATCH] fix: Change the decord dependency to decord2. update Ascend doc --- .../Hardware Support/ascend_docker_usage.md | 19 +++++++++++++++---- .../Hardware Support/ascend_npu_env_config.md | 4 ++-- .../Hardware Support/ascend_usage.md | 14 +++++++------- .../Hardware Support/ascend_docker_usage.md | 17 ++++++++++++++--- .../Hardware Support/ascend_npu_env_config.md | 4 ++-- .../Hardware Support/ascend_usage.md | 18 +++++++++--------- requirements_vision.txt | 2 +- 7 files changed, 50 insertions(+), 28 deletions(-) diff --git a/docs_roll/docs/User Guides/Hardware Support/ascend_docker_usage.md b/docs_roll/docs/User Guides/Hardware Support/ascend_docker_usage.md index 5d08ee814..c37c92756 100644 --- a/docs_roll/docs/User Guides/Hardware Support/ascend_docker_usage.md +++ b/docs_roll/docs/User Guides/Hardware Support/ascend_docker_usage.md @@ -2,7 +2,7 @@ Last updated: 06/23/2026. -This guide explains how to get, build, and run ROLL images on **Huawei Ascend NPU**. Prefer the pre-built image when possible; use `Dockerfile.A2` or `Dockerfile.A3` when you need to customize dependencies. Atlas 950 currently follows the manual installation profile in [ROLL x Ascend](ascend_usage.md). +This guide explains how to get, build, and run ROLL images on **Huawei Ascend NPU**. Prefer the pre-built image when possible; use `Dockerfile.A2` or `Dockerfile.A3` when you need to customize dependencies. Ascend 950 currently follows the manual installation profile in [ROLL x Ascend](ascend_usage.md). ## Hardware & Software Requirements @@ -15,7 +15,7 @@ This guide explains how to get, build, and run ROLL images on **Huawei Ascend NP | Docker | >= 20.10 | >= 20.10 | | Ascend NPU Driver | Installed on host | Installed on host | -This Docker guide covers the A2/A3 Dockerfiles. For Atlas 950, use the manual installation profile: torch 2.10, vLLM v0.20.2, vLLM-Ascend `main`, and `COMPILE_CUSTOM_KERNELS=1` when building vLLM-Ascend. +This Docker guide covers the A2/A3 Dockerfiles. For Ascend 950, use the manual installation profile: torch 2.10, vLLM v0.20.2, vLLM-Ascend `main`, and `COMPILE_CUSTOM_KERNELS=1` when building vLLM-Ascend. ## Key Components @@ -29,9 +29,9 @@ Both Dockerfiles install the same versions of core dependencies: | Transformers | 4.57.6 | | triton-ascend | 3.2.1 | -Atlas 950 uses a newer manual installation stack: +Ascend 950 uses a newer manual installation stack: -| Component | Atlas 950 Version / Setting | +| Component | Ascend 950 Version / Setting | | --------- | -------------------------- | | PyTorch | 2.10 | | vLLM | v0.20.2 | @@ -113,6 +113,7 @@ docker build -f docker/Dockerfile.A3 --build-arg SOC_VERSION=ascend910_9391 -t r ```bash docker run -dit \ --name roll_a2 \ + --ulimit nofile=65536:65536 \ --device /dev/davinci0 \ --device /dev/davinci1 \ --device /dev/davinci2 \ @@ -141,6 +142,7 @@ docker run -dit \ ```bash docker run -dit \ --name roll_a3 \ + --ulimit nofile=65536:65536 \ --device /dev/davinci0 \ --device /dev/davinci1 \ --device /dev/davinci2 \ @@ -149,6 +151,14 @@ docker run -dit \ --device /dev/davinci5 \ --device /dev/davinci6 \ --device /dev/davinci7 \ + --device /dev/davinci8 \ + --device /dev/davinci9 \ + --device /dev/davinci10 \ + --device /dev/davinci11 \ + --device /dev/davinci12 \ + --device /dev/davinci13 \ + --device /dev/davinci14 \ + --device /dev/davinci15 \ --device /dev/davinci_manager \ --device /dev/devmm_svm \ --device /dev/hisi_hdc \ @@ -171,6 +181,7 @@ For multi-NPU training, mount all available NPU devices. Adjust the number of `- ```bash docker run -dit \ --name roll_ascend \ + --ulimit nofile=65536:65536 \ --device /dev/davinci0 \ --device /dev/davinci1 \ --device /dev/davinci2 \ diff --git a/docs_roll/docs/User Guides/Hardware Support/ascend_npu_env_config.md b/docs_roll/docs/User Guides/Hardware Support/ascend_npu_env_config.md index 5cba8754e..e15f3e203 100644 --- a/docs_roll/docs/User Guides/Hardware Support/ascend_npu_env_config.md +++ b/docs_roll/docs/User Guides/Hardware Support/ascend_npu_env_config.md @@ -175,9 +175,9 @@ The following variable is used when building vLLM-Ascend from source. Set it bef | Variable | Recommended Value | Description | | -------- | ----------------- | ----------- | -| `COMPILE_CUSTOM_KERNELS` | `1` for Atlas A5 | Compile vLLM-Ascend custom kernels. Required by the Atlas A5 installation profile that uses vLLM-Ascend `main`. | +| `COMPILE_CUSTOM_KERNELS` | `1` for Ascend 950 | Compile vLLM-Ascend custom kernels. Required by the Ascend 950 installation profile that uses vLLM-Ascend `main`. | -Example (Atlas A5): +Example (Ascend 950): ```bash git clone -b main --depth 1 https://github.com/vllm-project/vllm-ascend.git diff --git a/docs_roll/docs/User Guides/Hardware Support/ascend_usage.md b/docs_roll/docs/User Guides/Hardware Support/ascend_usage.md index d529fc677..ab43a1d4a 100644 --- a/docs_roll/docs/User Guides/Hardware Support/ascend_usage.md +++ b/docs_roll/docs/User Guides/Hardware Support/ascend_usage.md @@ -12,11 +12,11 @@ ROLL's Ascend support is currently validated on training-series Ascend hardware: | ------- | -------------- | ----- | | Atlas 900 A2 PODc (Ascend 910B1) / Atlas A2 training series | √ | Use `docker/Dockerfile.A2` or the `roll:ascend-a2` image. | | Atlas 900 A3 PODc (Ascend 910_9391) / Atlas A3 training series | √ | Use `docker/Dockerfile.A3` or the `roll:ascend-a3` image. | -| Atlas A5 training series | √ | Use the A5 installation profile: torch 2.10, vLLM v0.20.2, vLLM-Ascend `main`, and `COMPILE_CUSTOM_KERNELS=1` when building vLLM-Ascend. | +| Ascend 950 training series | √ | Use the Ascend 950 installation profile: torch 2.10, vLLM v0.20.2, vLLM-Ascend `main`, and `COMPILE_CUSTOM_KERNELS=1` when building vLLM-Ascend. | | Atlas A2/A3 inference series and Atlas 200I/500 A2 inference products | x | Current ROLL NPU images and examples target training-series devices. | | Other Ascend training or inference products | Not validated | Validate the driver, firmware, CANN, `torch_npu`, and vLLM-Ascend versions before use. | -> In this table, `√` means supported by the current ROLL Ascend Dockerfiles/examples or the manual A5 installation profile, and `x` means not supported in the current ROLL NPU setup. +> In this table, `√` means supported by the current ROLL Ascend Dockerfiles/examples or the manual Ascend 950 installation profile, and `x` means not supported in the current ROLL NPU setup. Supported operating systems: @@ -24,7 +24,7 @@ Supported operating systems: | ------------------- | ------------ | ----- | | Physical host | Ubuntu 22.04 | Recommended and validated by the current ROLL Ascend guides. | | ROLL Ascend container | Ubuntu 22.04 | The A2/A3 Dockerfiles are based on `quay.io/ascend/cann:9.0.0-*-ubuntu22.04-py3.11`. | -| Atlas A5 manual installation | Ubuntu 22.04 | Use the A5-specific torch/vLLM stack below. Keep the driver, firmware, CANN, and `torch_npu` versions aligned with the target A5 environment. | +| Ascend 950 manual installation | Ubuntu 22.04 | Use the Ascend 950-specific torch/vLLM stack below. Keep the driver, firmware, CANN, and `torch_npu` versions aligned with the target Ascend 950 environment. | | VM/container deployments on other host OS versions | Follow Ascend/CANN compatibility guidance | Check the Ascend compatibility query assistant and the CANN Software Installation OS compatibility notes for the target hardware. | ## Installation @@ -36,7 +36,7 @@ Supported operating systems: | Python | 3.11 | | CANN | 9.0.0 | -For Atlas A5, keep Python 3.11 and use the A5-specific torch/vLLM stack described in [A5 Installation Profile](#a5-installation-profile). +For Ascend 950 , keep Python 3.11 and use the Ascend 950-specific torch/vLLM stack described in [Ascend 950 Installation Profile](#Ascend 950-installation-profile). ### Create Conda Environment @@ -89,9 +89,9 @@ pip install vllm==0.18.0 pip install vllm-ascend==0.18 ``` -### A5 Installation Profile +### Ascend 950 Installation Profile -For Atlas A5, use torch 2.10, vLLM v0.20.2, and vLLM-Ascend from the `main` branch. Set `COMPILE_CUSTOM_KERNELS=1` before installing vLLM-Ascend so its custom kernels are built: +For Ascend 950, use torch 2.10, vLLM v0.20.2, and vLLM-Ascend from the `main` branch. Set `COMPILE_CUSTOM_KERNELS=1` before installing vLLM-Ascend so its custom kernels are built: ``` # Install torch 2.10 @@ -172,7 +172,7 @@ python examples/start_agentic_pipeline.py \ | --------------- | ------------------------------------------------------------ | ---------------- | ----------------- | ----------------- | | Agentic | examples/qwen2.5-0.5B-agentic/run_agentic_pipeline_sokoban.sh | FSDP2 | vLLM | Atlas 900 A2/A3 PODc | | Agentic-Rollout | examples/qwen2.5-0.5B-agentic/run_agentic_rollout_sokoban.sh | FSDP2 | vLLM | Atlas 900 A2/A3 PODc | -| RLVR | examples/ascend_examples/run_rlvr_pipeline.sh | FSDP2 | vLLM | Atlas 900 A2/A3/A5 training series | +| RLVR | examples/ascend_examples/run_rlvr_pipeline.sh | FSDP2 | vLLM | Atlas 900 A2/A3/Ascend 950 training series | ## Disclaimer diff --git a/docs_roll/i18n/zh-Hans/docusaurus-plugin-content-docs/current/User Guides/Hardware Support/ascend_docker_usage.md b/docs_roll/i18n/zh-Hans/docusaurus-plugin-content-docs/current/User Guides/Hardware Support/ascend_docker_usage.md index a83e7cb07..f41c20be6 100644 --- a/docs_roll/i18n/zh-Hans/docusaurus-plugin-content-docs/current/User Guides/Hardware Support/ascend_docker_usage.md +++ b/docs_roll/i18n/zh-Hans/docusaurus-plugin-content-docs/current/User Guides/Hardware Support/ascend_docker_usage.md @@ -15,7 +15,7 @@ | Docker | >= 20.10 | >= 20.10 | | 昇腾 NPU 驱动 | 已安装在宿主机上 | 已安装在宿主机上 | -本 Docker 指南覆盖 A2/A3 Dockerfile。Atlas 950 请使用手动安装配置：torch 2.10、vLLM v0.20.2、vLLM-Ascend `main`，并在构建 vLLM-Ascend 时设置 `COMPILE_CUSTOM_KERNELS=1`。 +本 Docker 指南覆盖 A2/A3 Dockerfile。Ascend 950 请使用手动安装配置：torch 2.10、vLLM v0.20.2、vLLM-Ascend `main`，并在构建 vLLM-Ascend 时设置 `COMPILE_CUSTOM_KERNELS=1`。 ## 主要组件 @@ -29,9 +29,9 @@ | Transformers | 4.57.6 | | triton-ascend | 3.2.1 | -Atlas 950 使用更新的手动安装版本组合： +Ascend 950 使用更新的手动安装版本组合： -| 组件 | Atlas 950 版本 / 设置 | +| 组件 | Ascend 950 版本 / 设置 | | ---- | -------------------- | | PyTorch | 2.10 | | vLLM | v0.20.2 | @@ -113,6 +113,7 @@ docker build -f docker/Dockerfile.A3 --build-arg SOC_VERSION=ascend910_9391 -t r ```bash docker run -dit \ --name roll_a2 \ + --ulimit nofile=65536:65536 \ --device /dev/davinci0 \ --device /dev/davinci1 \ --device /dev/davinci2 \ @@ -141,6 +142,7 @@ docker run -dit \ ```bash docker run -dit \ --name roll_a3 \ + --ulimit nofile=65536:65536 \ --device /dev/davinci0 \ --device /dev/davinci1 \ --device /dev/davinci2 \ @@ -149,6 +151,14 @@ docker run -dit \ --device /dev/davinci5 \ --device /dev/davinci6 \ --device /dev/davinci7 \ + --device /dev/davinci8 \ + --device /dev/davinci9 \ + --device /dev/davinci10 \ + --device /dev/davinci11 \ + --device /dev/davinci12 \ + --device /dev/davinci13 \ + --device /dev/davinci14 \ + --device /dev/davinci15 \ --device /dev/davinci_manager \ --device /dev/devmm_svm \ --device /dev/hisi_hdc \ @@ -171,6 +181,7 @@ docker run -dit \ ```bash docker run -dit \ --name roll_ascend \ + --ulimit nofile=65536:65536 \ --device /dev/davinci0 \ --device /dev/davinci1 \ --device /dev/davinci2 \ diff --git a/docs_roll/i18n/zh-Hans/docusaurus-plugin-content-docs/current/User Guides/Hardware Support/ascend_npu_env_config.md b/docs_roll/i18n/zh-Hans/docusaurus-plugin-content-docs/current/User Guides/Hardware Support/ascend_npu_env_config.md index a41b892c2..8121dfc67 100644 --- a/docs_roll/i18n/zh-Hans/docusaurus-plugin-content-docs/current/User Guides/Hardware Support/ascend_npu_env_config.md +++ b/docs_roll/i18n/zh-Hans/docusaurus-plugin-content-docs/current/User Guides/Hardware Support/ascend_npu_env_config.md @@ -175,9 +175,9 @@ export VLLM_ASCEND_ENABLE_PREFETCH_MLP=1 | 变量 | 推荐值 | 说明 | | ---- | ------ | ---- | -| `COMPILE_CUSTOM_KERNELS` | Atlas A5 设置为 `1` | 编译 vLLM-Ascend 自定义 kernel。使用 vLLM-Ascend `main` 的 Atlas A5 安装配置需要设置该变量。 | +| `COMPILE_CUSTOM_KERNELS` | Ascend 950 设置为 `1` | 编译 vLLM-Ascend 自定义 kernel。使用 vLLM-Ascend `main` 的 Ascend 950 安装配置需要设置该变量。 | -示例（Atlas A5）： +示例（Ascend 950）： ```bash git clone -b main --depth 1 https://github.com/vllm-project/vllm-ascend.git diff --git a/docs_roll/i18n/zh-Hans/docusaurus-plugin-content-docs/current/User Guides/Hardware Support/ascend_usage.md b/docs_roll/i18n/zh-Hans/docusaurus-plugin-content-docs/current/User Guides/Hardware Support/ascend_usage.md index 16f32ba9a..7c6f7941b 100644 --- a/docs_roll/i18n/zh-Hans/docusaurus-plugin-content-docs/current/User Guides/Hardware Support/ascend_usage.md +++ b/docs_roll/i18n/zh-Hans/docusaurus-plugin-content-docs/current/User Guides/Hardware Support/ascend_usage.md @@ -12,11 +12,11 @@ ROLL 昇腾适配当前覆盖以下训练系列硬件： | ---- | -------- | ---- | | Atlas 900 A2 PODc（Ascend 910B1）/ Atlas A2 训练系列产品 | √ | 使用 `docker/Dockerfile.A2` 或 `roll:ascend-a2` 镜像。 | | Atlas 900 A3 PODc（Ascend 910_9391）/ Atlas A3 训练系列产品 | √ | 使用 `docker/Dockerfile.A3` 或 `roll:ascend-a3` 镜像。 | -| Atlas A5 训练系列产品 | √ | 使用 A5 安装配置：torch 2.10、vLLM v0.20.2、vLLM-Ascend `main`，并在构建 vLLM-Ascend 时设置 `COMPILE_CUSTOM_KERNELS=1`。 | +| Ascend 950 训练系列产品 | √ | 使用 Ascend 950 安装配置：torch 2.10、vLLM v0.20.2、vLLM-Ascend `main`，并在构建 vLLM-Ascend 时设置 `COMPILE_CUSTOM_KERNELS=1`。 | | Atlas A2/A3 推理系列产品、Atlas 200I/500 A2 推理产品 | x | 当前 ROLL NPU 镜像和示例面向训练系列设备。 | | 其他昇腾训练或推理产品 | 未验证 | 使用前请确认驱动、固件、CANN、`torch_npu` 与 vLLM-Ascend 版本配套。 | -> 本节表格中 `√` 代表当前 ROLL 昇腾 Dockerfile、示例或 A5 手动安装配置已支持，`x` 代表当前 ROLL NPU 配套不支持。 +> 本节表格中 `√` 代表当前 ROLL 昇腾 Dockerfile、示例或 Ascend 950 手动安装配置已支持，`x` 代表当前 ROLL NPU 配套不支持。 支持的操作系统： @@ -24,7 +24,7 @@ ROLL 昇腾适配当前覆盖以下训练系列硬件： | -------- | -------------- | ---- | | 物理机宿主机 | Ubuntu 22.04 | 当前 ROLL 昇腾文档推荐并验证的宿主机操作系统。 | | ROLL 昇腾容器 | Ubuntu 22.04 | A2/A3 Dockerfile 基于 `quay.io/ascend/cann:9.0.0-*-ubuntu22.04-py3.11`。 | -| Atlas A5 手动安装 | Ubuntu 22.04 | 使用下文 A5 专用 torch/vLLM 版本组合。驱动、固件、CANN 和 `torch_npu` 版本需要与目标 A5 环境匹配。 | +| Ascend 950 手动安装 | Ubuntu 22.04 | 使用下文 Ascend 950 专用 torch/vLLM 版本组合。驱动、固件、CANN 和 `torch_npu` 版本需要与目标 Ascend 950 环境匹配。 | | 其他宿主机 OS 上的虚拟机或容器部署 | 以昇腾/CANN 兼容性说明为准 | 请结合目标硬件查询昇腾兼容性查询助手，以及 CANN 软件安装文档中的操作系统兼容性说明。 | ## 安装 @@ -36,7 +36,7 @@ ROLL 昇腾适配当前覆盖以下训练系列硬件： | Python | 3.11 | | CANN | 9.0.0 | -Atlas A5 请保持 Python 3.11，并使用下文 [A5 安装配置](#a5-安装配置) 中的专用 torch/vLLM 版本组合。 +Ascend 950 请保持 Python 3.11，并使用下文 [Ascend 950 安装配置](#Ascend 950-安装配置) 中的专用 torch/vLLM 版本组合。 ### 创建 conda 环境 @@ -90,9 +90,9 @@ pip install vllm==0.18.0 pip install vllm-ascend==0.18 ``` -### A5 安装配置 +### Ascend 950 安装配置 -Atlas A5 上使用 torch 2.10、vLLM v0.20.2，并从 `main` 分支安装 vLLM-Ascend。安装 vLLM-Ascend 前需要设置 `COMPILE_CUSTOM_KERNELS=1`，以便编译自定义 kernel： +Ascend 950上使用 torch 2.10、vLLM v0.20.2，并从 `main` 分支安装 vLLM-Ascend。安装 vLLM-Ascend 前需要设置 `COMPILE_CUSTOM_KERNELS=1`，以便编译自定义 kernel： ``` # 安装 torch 2.10 @@ -171,9 +171,9 @@ python examples/start_agentic_pipeline.py \ | 功能 | 示例 | 训练后端 | 推理后端 | 硬件 | | ---- | ---- | -------- | -------- | ---- | -| Agentic | examples/qwen2.5-0.5B-agentic/run_agentic_pipeline_sokoban.sh | FSDP2 | vLLM | Atlas 900 A2/A3 PODc | -| Agentic-Rollout | examples/qwen2.5-0.5B-agentic/run_agentic_rollout_sokoban.sh | FSDP2 | vLLM | Atlas 900 A2/A3 PODc | -| RLVR | examples/ascend_examples/run_rlvr_pipeline.sh | FSDP2 | vLLM | Atlas 900 A2/A3/A5 训练系列 | +| Agentic | examples/qwen2.5-0.5B-agentic/run_agentic_pipeline_sokoban.sh | FSDP2 | vLLM | Atlas 900 A2/A3/Ascend 950 训练系列 | +| Agentic-Rollout | examples/qwen2.5-0.5B-agentic/run_agentic_rollout_sokoban.sh | FSDP2 | vLLM | Atlas 900 A2/A3/Ascend 950 训练系列 | +| RLVR | examples/ascend_examples/run_rlvr_pipeline.sh | FSDP2 | vLLM | Atlas 900 A2/A3/Ascend 950 训练系列 | ## 声明 diff --git a/requirements_vision.txt b/requirements_vision.txt index 9d2f25aa2..9c7f51e66 100644 --- a/requirements_vision.txt +++ b/requirements_vision.txt @@ -1,4 +1,4 @@ pycocotools # for detection verify qwen_vl_utils # for video -decord # for video +decord2 # for video rouge_score==0.1.2 # for video-r1 reward \ No newline at end of file