ci(github): remove actions

.github/ISSUE_TEMPLATE/bug-report.yml

@@ -1,67 +0,0 @@
-name: "\U0001F41B Bug Report"
-description: Submit a bug report to help us improve TRL
-labels: [ "bug" ]
-body:
-  - type: markdown
-    attributes:
-      value: |
-        Thanks for taking the time to fill out this bug report! 🤗
-
-        🚩 If it is your first time submitting, be sure to check our [bug report guidelines](https://github.com/huggingface/trl/blob/main/CONTRIBUTING.md#did-you-find-a-bug)
-
-  - type: textarea
-    id: reproduction
-    validations:
-      required: true
-    attributes:
-      label: Reproduction
-      description: |
-        Please provide a code sample that reproduces the problem you ran into. It can be a Colab link or just a code snippet.
-        If you have code snippets, error messages, stack traces please provide them here as well.
-        Important! Use code tags to correctly format your code. See https://help.github.com/en/github/writing-on-github/creating-and-highlighting-code-blocks#syntax-highlighting
-        Do not use screenshots, as they are hard to read and (more importantly) don't allow others to copy-and-paste your code.
-
-      value: |
-        ```python
-        from trl import ...
-
-        ```
-
-        outputs:
-
-        ```
-        Traceback (most recent call last):
-          File "example.py", line 42, in <module>
-            ...
-        ```
-
-  - type: textarea
-    id: system-info
-    attributes:
-      label: System Info
-      description: |
-        Please provide information about your system: platform, Python version, PyTorch version, Transformers version, devices, TRL version, ...
-        You can get this information by running `trl env` in your terminal.
-
-      placeholder: Copy-paste the output of `trl env`
-    validations:
-      required: true
-
-  - type: checkboxes
-    id: terms
-    attributes:
-      label: Checklist
-      description: |
-        Before submitting, please confirm that you've completed each of the following.
-        If an item doesn't apply to your issue, check it anyway to show you've reviewed it.
-      options:
-        - label: "I have checked that my issue isn't already filed (see [open issues](https://github.com/huggingface/trl/issues?q=is%3Aissue))"
-          required: true
-        - label: "I have included my system information"
-          required: true
-        - label: "Any code provided is minimal, complete, and reproducible ([more on MREs](https://docs.github.com/en/get-started/writing-on-github/working-with-advanced-formatting/creating-and-highlighting-code-blocks))"
-          required: true
-        - label: "Any code provided is properly formatted in code blocks, (no screenshot, [more on code blocks](https://docs.github.com/en/get-started/writing-on-github/working-with-advanced-formatting/creating-and-highlighting-code-blocks))"
-          required: true
-        - label: "Any traceback provided is complete"
-          required: true

.github/ISSUE_TEMPLATE/feature-request.yml

@@ -1,31 +0,0 @@
-name: "\U0001F680 Feature request"
-description: Submit a proposal/request for a new TRL feature
-labels: [ "Feature request" ]
-body:
-  - type: textarea
-    id: feature-request
-    validations:
-      required: true
-    attributes:
-      label: Feature request
-      description: |
-        A clear and concise description of the feature proposal. Please provide a link to the paper and code in case they exist.
-
-  - type: textarea
-    id: motivation
-    validations:
-      required: true
-    attributes:
-      label: Motivation
-      description: |
-        Please outline the motivation for the proposal. Is your feature request related to a problem? e.g., I'm always frustrated when [...]. If this is related to another GitHub issue, please link here too.
-
-
-  - type: textarea
-    id: contribution
-    validations:
-      required: true
-    attributes:
-      label: Your contribution
-      description: |
-        Is there any way that you could help, e.g. by submitting a PR? Make sure to read the CONTRIBUTING.MD [readme](https://github.com/huggingface/trl/blob/main/CONTRIBUTING.md)

.github/ISSUE_TEMPLATE/new-trainer-addition.yml

@@ -1,32 +0,0 @@
-name: "\U0001F31F New trainer addition"
-description: Submit a proposal/request to implement a new trainer for a post-training method 
-labels: [ "New trainer" ]
-
-body:
-  - type: textarea
-    id: description-request
-    validations:
-      required: true
-    attributes:
-      label: Method description
-      description: |
-        Put any and all important information relative to the method
-
-  - type: checkboxes
-    id: information-tasks
-    attributes:
-      label: Open source status
-      description: |
-          Please note that if the method implementation isn't available or model weights with training datasets aren't available, we are less likely to implement it in `trl`.
-      options:
-        - label: "The method implementation is available"
-        - label: "The model weights are available"
-        - label: "The training datasets are available"
-
-  - type: textarea
-    id: additional-info
-    attributes:
-      label: Provide useful links for the implementation
-      description: |
-        Please provide information regarding the implementation, the weights, and the authors.
-        Please mention the authors by @gh-username if you're aware of their usernames.

.github/PULL_REQUEST_TEMPLATE.md

@@ -1,31 +0,0 @@
-# What does this PR do?
-
-<!--
-Congratulations! You've made it this far! You're not quite done yet though.
-
-Once merged, your PR is going to appear in the release notes with the title you set, so make sure it's a great title that fully reflects the extent of your awesome contribution.
-
-Then, please replace this with a description of the change and which issue is fixed (if applicable). Please also include relevant motivation and context. List any dependencies (if any) that are required for this change.
-
-Once you're done, someone will review your PR shortly. They may suggest changes to make the code even better.
--->
-
-<!-- Remove if not applicable -->
-
-Fixes # (issue)
-
-
-## Before submitting
-- [ ] This PR fixes a typo or improves the docs (you can dismiss the other checks if that's the case).
-- [ ] Did you read the [contributor guideline](https://github.com/huggingface/trl/blob/main/CONTRIBUTING.md#create-a-pull-request),
-      Pull Request section?
-- [ ] Was this discussed/approved via a GitHub issue? Please add a link
-      to it if that's the case.
-- [ ] Did you make sure to update the documentation with your changes?
-- [ ] Did you write any new necessary tests?
-
-
-## Who can review?
-
-Anyone in the community is free to review the PR once the tests have passed. Feel free to tag
-members/contributors who may be interested in your PR.

.github/codeql/custom-queries.qls

@@ -1,19 +0,0 @@
-import codeql
-
-from WorkflowString interpolation, Workflow workflow
-where 
-  interpolation.getStringValue().matches("${{ github.event.issue.title }}") or
-  interpolation.getStringValue().matches("${{ github.event.issue.body }}") or
-  interpolation.getStringValue().matches("${{ github.event.pull_request.title }}") or
-  interpolation.getStringValue().matches("${{ github.event.pull_request.body }}") or
-  interpolation.getStringValue().matches("${{ github.event.review.body }}") or
-  interpolation.getStringValue().matches("${{ github.event.comment.body }}") or
-  interpolation.getStringValue().matches("${{ github.event.inputs.* }}") or
-  interpolation.getStringValue().matches("${{ github.event.head_commit.message }}")
-  interpolation.getStringValue().matches("${{ github.event.* }}") and
-  (
-    step.getKey() = "run" or  // Injection in run
-    step.getKey() = "env" or  // Injection via env
-    step.getKey() = "with"    // Injection via with
-  )
-select workflow, "🚨 Do not use directly as input of action"

.github/workflows/build_documentation.yml

@@ -1,19 +0,0 @@
-name: Build documentation
-
-on:
-  push:
-    branches:
-      - main
-      - doc-builder*
-      - v*-release
-
-jobs:
-   build:
-    uses: huggingface/doc-builder/.github/workflows/build_main_documentation.yml@main
-    with:
-      commit_sha: ${{ github.sha }}
-      package: trl
-      version_tag_suffix: ""
-      custom_container: huggingface/transformers-doc-builder
-    secrets:
-      hf_token: ${{ secrets.HF_DOC_BUILD_PUSH }}

.github/workflows/build_pr_documentation.yml

@@ -1,19 +0,0 @@
-name: Build PR Documentation
-
-on:
-  pull_request:
-
-concurrency:
-  group: ${{ github.workflow }}-${{ github.head_ref || github.run_id }}
-  cancel-in-progress: true
-
-jobs:
-  build:
-    if: github.event.pull_request.draft == false
-    uses: huggingface/doc-builder/.github/workflows/build_pr_documentation.yml@main
-    with:
-      commit_sha: ${{ github.event.pull_request.head.sha }}
-      pr_number: ${{ github.event.number }}
-      package: trl
-      version_tag_suffix: ""
-      custom_container: huggingface/transformers-doc-builder

.github/workflows/clear_cache.yml

@@ -1,33 +0,0 @@
-name: "Cleanup Cache"
-
-on:
-  workflow_dispatch:
-  schedule:
-    - cron: "0 0 * * *"
-    
-jobs:
-  cleanup:
-    runs-on: ubuntu-latest
-    steps:
-      - name: Check out code
-        uses: actions/checkout@v4
-        
-      - name: Cleanup
-        run: |
-          gh extension install actions/gh-actions-cache
-          
-          REPO=${{ github.repository }}
-
-          echo "Fetching list of cache key"
-          cacheKeysForPR=$(gh actions-cache list -R $REPO | cut -f 1 )
-
-          ## Setting this to not fail the workflow while deleting cache keys. 
-          set +e
-          echo "Deleting caches..."
-          for cacheKey in $cacheKeysForPR
-          do
-              gh actions-cache delete $cacheKey -R $REPO --confirm
-          done
-          echo "Done"
-        env:
-          GH_TOKEN: ${{ secrets.GITHUB_TOKEN }}

.github/workflows/codeQL.yml

@@ -1,26 +0,0 @@
-name: "CodeQL Analysis - Workflows"
-
-on:
-  workflow_dispatch:
-
-jobs:
-  analyze:
-    name: "Analyze GitHub Workflows"
-    runs-on: ubuntu-latest
-    permissions:
-      security-events: write
-      actions: read
-      contents: read
-
-    steps:
-      - name: "Checkout repository"
-        uses: actions/checkout@v4
-
-      - name: "Initialize CodeQL"
-        uses: github/codeql-action/init@v2
-        with:
-          languages: "yaml"
-          queries: +security-and-quality, ./.github/codeql/custom-queries.qls
-
-      - name: "Perform CodeQL Analysis"
-        uses: github/codeql-action/analyze@v2

.github/workflows/docker-build.yml

@@ -1,95 +0,0 @@
-name: Build Docker images (scheduled)
-
-on:
-  workflow_dispatch:
-  workflow_call:
-  schedule:
-    - cron: "0 1 * * *"
-
-concurrency:
-  group: docker-image-builds
-  cancel-in-progress: false
-
-env:
-  CI_SLACK_CHANNEL: ${{ secrets.CI_DOCKER_CHANNEL }}
-
-jobs:
-  trl-latest:
-    name: "Latest TRL GPU"
-    runs-on: ubuntu-latest
-    steps:
-      - name: Cleanup disk
-        run: |
-          sudo ls -l /usr/local/lib/
-          sudo ls -l /usr/share/
-          sudo du -sh /usr/local/lib/
-          sudo du -sh /usr/share/
-          sudo rm -rf /usr/local/lib/android
-          sudo rm -rf /usr/share/dotnet
-          sudo du -sh /usr/local/lib/
-          sudo du -sh /usr/share/
-      - name: Set up Docker Buildx
-        uses: docker/setup-buildx-action@v1
-      - name: Check out code
-        uses: actions/checkout@v4
-      - name: Login to DockerHub
-        uses: docker/login-action@v1
-        with:
-          username: ${{ secrets.DOCKERHUB_USERNAME }}
-          password: ${{ secrets.DOCKERHUB_PASSWORD }}
-
-      - name: Build and Push GPU
-        uses: docker/build-push-action@v4
-        with:
-          context: ./docker/trl-latest-gpu
-          push: true
-          tags: huggingface/trl-latest-gpu
-
-      - name: Post to Slack
-        if: always()
-        uses: huggingface/hf-workflows/.github/actions/post-slack@main
-        with:
-          slack_channel: ${{ env.CI_SLACK_CHANNEL }}
-          title: 🤗 Results of the trl-latest-gpu Docker Image build
-          status: ${{ job.status }}
-          slack_token: ${{ secrets.SLACK_CIFEEDBACK_BOT_TOKEN }}
-
-  trl-source:
-    name: "Latest TRL + HF ecosystem from source"
-    runs-on: ubuntu-latest
-    steps:
-      - name: Cleanup disk
-        run: |
-          sudo ls -l /usr/local/lib/
-          sudo ls -l /usr/share/
-          sudo du -sh /usr/local/lib/
-          sudo du -sh /usr/share/
-          sudo rm -rf /usr/local/lib/android
-          sudo rm -rf /usr/share/dotnet
-          sudo du -sh /usr/local/lib/
-          sudo du -sh /usr/share/
-      - name: Set up Docker Buildx
-        uses: docker/setup-buildx-action@v1
-      - name: Check out code
-        uses: actions/checkout@v4
-      - name: Login to DockerHub
-        uses: docker/login-action@v1
-        with:
-          username: ${{ secrets.DOCKERHUB_USERNAME }}
-          password: ${{ secrets.DOCKERHUB_PASSWORD }}
-
-      - name: Build and Push GPU
-        uses: docker/build-push-action@v4
-        with:
-          context: ./docker/trl-source-gpu
-          push: true
-          tags: huggingface/trl-source-gpu
-
-      - name: Post to Slack
-        if: always()
-        uses: huggingface/hf-workflows/.github/actions/post-slack@main
-        with:
-          slack_channel: ${{ env.CI_SLACK_CHANNEL }}
-          title: 🤗 Results of the trl-source-gpu Docker Image build
-          status: ${{ job.status }}
-          slack_token: ${{ secrets.SLACK_CIFEEDBACK_BOT_TOKEN }}  

.github/workflows/issue_auto_labeller.yml

@@ -1,15 +0,0 @@
-name: "Hugging Face Issue Labeler"
-on:
-  issues:
-    types: opened
-
-jobs:
-  triage:
-    runs-on: ubuntu-latest
-    permissions:
-      issues: write
-    steps:
-      - uses: actions/checkout@v3
-      - uses: August-murr/auto-labeler@main
-        with:
-            hf-api-key: ${{ secrets.CI_HF_API_TOKEN }}

.github/workflows/pr_style_bot.yml

@@ -1,127 +0,0 @@
-name: PR Style Bot
-
-on:
-  workflow_dispatch:
-
-
-permissions:
-  contents: write
-  pull-requests: write
-
-jobs:
-  run-style-bot:
-    if: >
-      contains(github.event.comment.body, '@bot /style') &&
-      github.event.issue.pull_request != null
-    runs-on: ubuntu-latest
-
-    steps:
-      - name: Extract PR details
-        id: pr_info
-        uses: actions/github-script@v6
-        with:
-          script: |
-            const prNumber = context.payload.issue.number;
-            const { data: pr } = await github.rest.pulls.get({
-              owner: context.repo.owner,
-              repo: context.repo.repo,
-              pull_number: prNumber
-            });
-            
-            // We capture both the branch ref and the "full_name" of the head repo
-            // so that we can check out the correct repository & branch (including forks).
-            core.setOutput("prNumber", prNumber);
-            core.setOutput("headRef", pr.head.ref);
-            core.setOutput("headRepoFullName", pr.head.repo.full_name);
-
-      - name: Check out PR branch
-        uses: actions/checkout@v3
-        env: 
-          HEADREPOFULLNAME: ${{ steps.pr_info.outputs.headRepoFullName }}
-          HEADREF: ${{ steps.pr_info.outputs.headRef }}
-        with:
-          # Instead of checking out the base repo, use the contributor's repo name
-          repository: ${{ env.HEADREPOFULLNAME }}
-          ref: ${{ env.HEADREF }}
-          # You may need fetch-depth: 0 for being able to push
-          fetch-depth: 0
-          token: ${{ secrets.GITHUB_TOKEN }}
-      
-      - name: Debug
-        env: 
-          HEADREPOFULLNAME: ${{ steps.pr_info.outputs.headRepoFullName }}
-          HEADREF: ${{ steps.pr_info.outputs.headRef }}
-          PRNUMBER: ${{ steps.pr_info.outputs.prNumber }}
-        run: |
-          echo "PR number: ${{ env.PRNUMBER }}"
-          echo "Head Ref: ${{ env.HEADREF }}"
-          echo "Head Repo Full Name: ${{ env.HEADREPOFULLNAME }}"
-
-      - name: Set up Python
-        uses: actions/setup-python@v4
-
-      - name: Install dependencies
-        run: |
-          pip install ruff pre-commit
-
-      - name: Download Makefile from main branch
-        run: |
-          curl -o main_Makefile https://raw.githubusercontent.com/huggingface/trl/main/Makefile
-        
-      - name: Compare Makefiles
-        run: |
-          if ! diff -q main_Makefile Makefile; then
-            echo "Error: The Makefile has changed. Please ensure it matches the main branch."
-            exit 1
-          fi
-          echo "No changes in Makefile. Proceeding..."
-          rm -rf main_Makefile
-
-      - name: Run make style and make quality
-        run: |
-          make precommit || true
-
-      - name: Commit and push changes
-        id: commit_and_push
-        env: 
-          HEADREPOFULLNAME: ${{ steps.pr_info.outputs.headRepoFullName }}
-          HEADREF: ${{ steps.pr_info.outputs.headRef }}
-          PRNUMBER: ${{ steps.pr_info.outputs.prNumber }}
-          GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }}
-        run: |
-          echo "HEADREPOFULLNAME: ${{ env.HEADREPOFULLNAME }}, HEADREF: ${{ env.HEADREF }}"
-          # Configure git with the Actions bot user
-          git config user.name "github-actions[bot]"
-          git config user.email "github-actions[bot]@users.noreply.github.com"
-
-          # Make sure your 'origin' remote is set to the contributor's fork
-          git remote set-url origin "https://x-access-token:${GITHUB_TOKEN}@github.com/${{ env.HEADREPOFULLNAME }}.git"
-
-          # If there are changes after running style/quality, commit them
-          if [ -n "$(git status --porcelain)" ]; then
-            git add .
-            git commit -m "Apply style fixes"
-            # Push to the original contributor's forked branch
-            git push origin HEAD:${{ env.HEADREF }}
-            echo "changes_pushed=true" >> $GITHUB_OUTPUT
-          else
-            echo "No changes to commit."
-            echo "changes_pushed=false" >> $GITHUB_OUTPUT
-          fi
-
-      - name: Comment on PR with workflow run link
-        if: steps.commit_and_push.outputs.changes_pushed == 'true'
-        uses: actions/github-script@v6
-        with:
-          script: |
-            const prNumber = parseInt(process.env.prNumber, 10);
-            const runUrl = `${process.env.GITHUB_SERVER_URL}/${process.env.GITHUB_REPOSITORY}/actions/runs/${process.env.GITHUB_RUN_ID}`
-
-            await github.rest.issues.createComment({
-              owner: context.repo.owner,
-              repo: context.repo.repo,
-              issue_number: prNumber,
-              body: `Style fixes have been applied. [View the workflow run here](${runUrl}).`
-            });
-        env:
-          prNumber: ${{ steps.pr_info.outputs.prNumber }}

.github/workflows/slow-tests.yml

@@ -1,98 +0,0 @@
-name: Slow tests (on push)
-
-on:
-  push:
-    branches: [ main ]
-    paths:
-      # Run only when python files are modified
-      - "trl/**.py"
-      - "examples/**.py"
-env:
-  RUN_SLOW: "yes"
-  IS_GITHUB_CI: "1"
-  SLACK_API_TOKEN: ${{ secrets.SLACK_CIFEEDBACK_BOT_TOKEN }}
-
-
-jobs:
-  run_all_tests_single_gpu:
-    strategy:
-      fail-fast: false
-      matrix:
-        docker-image-name: ["huggingface/trl-latest-gpu:latest", "huggingface/trl-source-gpu:latest"]
-    runs-on:
-      group: aws-g4dn-2xlarge
-    env:
-      CUDA_VISIBLE_DEVICES: "0"
-      TEST_TYPE: "single_gpu_${{ matrix.docker-image-name }}"
-    container:
-      image: ${{ matrix.docker-image-name }}
-      options: --gpus all --shm-size "16gb" -e NVIDIA_DISABLE_REQUIRE=true
-    defaults:
-      run:
-        shell: bash
-    steps:
-      - uses: actions/checkout@v4
-      - name: Pip install
-        run: |
-          source activate trl
-          pip install -e ".[test]" --no-deps
-          pip install pytest-reportlog parameterized
-
-      - name: Run slow SFT tests on single GPU
-        if: always()
-        run: |
-          source activate trl
-          make slow_tests
-      
-      - name: Generate Report
-        if: always()
-        run: |
-          pip install slack_sdk tabulate
-          python scripts/log_reports.py >> $GITHUB_STEP_SUMMARY
-
-
-  run_all_tests_multi_gpu:
-    strategy:
-      fail-fast: false
-      matrix:
-        docker-image-name: ["huggingface/trl-latest-gpu:latest", "huggingface/trl-source-gpu:latest"]
-    runs-on:
-      group: aws-g4dn-2xlarge
-    env:
-      CUDA_VISIBLE_DEVICES: "0,1"
-      TEST_TYPE: "multi_gpu_${{ matrix.docker-image-name }}"
-    container:
-      image: ${{ matrix.docker-image-name }}
-      options: --gpus all --shm-size "16gb" -e NVIDIA_DISABLE_REQUIRE=true
-    defaults:
-      run:
-        shell: bash
-    steps:
-      - uses: actions/checkout@v4
-      - name: Pip install
-        run: |
-          source activate trl
-          pip install -e ".[test]" --no-deps
-          pip install pytest-reportlog parameterized
-
-      - name: Run slow SFT tests on Multi GPU
-        if: always()
-        run: |
-          source activate trl
-          make slow_tests
-
-      - name: Run end-to-end examples tests on multi GPU
-        if: always()
-        run: |
-          source activate trl
-          pip install deepspeed
-          make test_examples
-      
-      - name: Generate Reports
-        if: always()
-        run: |
-          pip install slack_sdk tabulate
-          python scripts/log_reports.py >> $GITHUB_STEP_SUMMARY
-          python scripts/log_example_reports.py --text_file_name temp_results_sft_tests.txt >> $GITHUB_STEP_SUMMARY
-          python scripts/log_example_reports.py --text_file_name temp_results_dpo_tests.txt >> $GITHUB_STEP_SUMMARY
-          rm *.txt

.github/workflows/tests.yml

@@ -1,252 +0,0 @@
-name: Tests
-
-on:
-  push:
-    branches: [ main ]
-  pull_request:
-    paths:
-      # Run only when relevant files are modified
-      - ".github/**.yml"
-      - "examples/**.py"
-      - "scripts/**.py"
-      - "tests/**.py"
-      - "trl/**.py"
-      - "setup.py"
-
-env:
-  TQDM_DISABLE: 1
-  CI_SLACK_CHANNEL: ${{ secrets.CI_PUSH_MAIN_CHANNEL }}
-
-jobs:
-  check_code_quality:
-    name: Check code quality
-    runs-on: ubuntu-latest
-    if: github.event.pull_request.draft == false
-    steps:
-      - uses: actions/checkout@v4
-      - name: Set up Python 3.12
-        uses: actions/setup-python@v5
-        with:
-          python-version: 3.12
-      - uses: pre-commit/action@v3.0.1
-        with:
-          extra_args: --all-files
-
-  tests:
-    name: Tests
-    strategy:
-      matrix:
-        python-version: ['3.9', '3.10', '3.11', '3.12', '3.13']
-      fail-fast: false
-    runs-on:
-      group: aws-g4dn-2xlarge
-    container:
-      image: pytorch/pytorch:2.6.0-cuda12.6-cudnn9-devel
-      options: --gpus all
-    defaults:
-      run:
-        shell: bash
-    if: github.event.pull_request.draft == false
-    steps:
-      - name: Git checkout
-        uses: actions/checkout@v4
-
-      - name: Set up Python ${{ matrix.python-version }}
-        uses: actions/setup-python@v5
-        with:
-          python-version: ${{ matrix.python-version }}
-
-      - name: Install Make and Git
-        run: |
-          apt-get update && apt-get install -y make git curl
-
-      - name: Install uv
-        run: |
-          curl -LsSf https://astral.sh/uv/install.sh | sh
-
-      - name: Create Python virtual environment
-        run: |
-          uv venv
-          uv pip install --upgrade setuptools wheel
-
-      - name: Install dependencies
-        run: |
-          source .venv/bin/activate
-          uv pip install ".[dev]"
-
-      - name: Test with pytest
-        run: |
-          source .venv/bin/activate
-          make test
-
-      - name: Post to Slack
-        if: github.ref == 'refs/heads/main' && always()  # Check if the branch is main
-        uses: huggingface/hf-workflows/.github/actions/post-slack@main
-        with:
-          slack_channel: ${{ env.CI_SLACK_CHANNEL }}
-          title: Results with Python ${{ matrix.python-version }} and latest dependencies
-          status: ${{ job.status }}
-          slack_token: ${{ secrets.SLACK_CIFEEDBACK_BOT_TOKEN }}
-
-  tests_dev:
-    name: Tests with dev dependencies
-    runs-on:
-      group: aws-g4dn-2xlarge
-    container:
-      image: pytorch/pytorch:2.6.0-cuda12.6-cudnn9-devel
-      options: --gpus all
-    defaults:
-      run:
-        shell: bash
-    if: github.event.pull_request.draft == false
-    steps:
-      - name: Git checkout
-        uses: actions/checkout@v4
-
-      - name: Set up Python 3.12
-        uses: actions/setup-python@v5
-        with:
-          python-version: '3.12'
-
-      - name: Install Make and Git
-        run: |
-          apt-get update && apt-get install -y make git curl
-
-      - name: Install uv
-        run: |
-          curl -LsSf https://astral.sh/uv/install.sh | sh
-
-      - name: Create Python virtual environment
-        run: |
-          uv venv
-          uv pip install --upgrade setuptools wheel
-
-      - name: Install dependencies
-        run: |
-          source .venv/bin/activate
-          uv pip install ".[dev]"
-          uv pip install -U git+https://github.com/huggingface/accelerate.git
-          uv pip install -U git+https://github.com/huggingface/datasets.git
-          uv pip install -U git+https://github.com/huggingface/transformers.git
-          
-
-      - name: Test with pytest
-        run: |
-          source .venv/bin/activate
-          make test
-
-      - name: Post to Slack
-        if: github.ref == 'refs/heads/main' && always()  # Check if the branch is main
-        uses: huggingface/hf-workflows/.github/actions/post-slack@main
-        with:
-          slack_channel: ${{ env.CI_SLACK_CHANNEL }}
-          title: Results with Python 3.12 and dev dependencies
-          status: ${{ job.status }}
-          slack_token: ${{ secrets.SLACK_CIFEEDBACK_BOT_TOKEN }}
-
-  tests_wo_optional_deps:
-    name: Tests without optional dependencies
-    runs-on:
-      group: aws-g4dn-2xlarge
-    container:
-      image: pytorch/pytorch:2.6.0-cuda12.6-cudnn9-devel
-      options: --gpus all
-    defaults:
-      run:
-        shell: bash
-    if: github.event.pull_request.draft == false
-    steps:
-      - name: Git checkout
-        uses: actions/checkout@v4
-
-      - name: Set up Python 3.12
-        uses: actions/setup-python@v5
-        with:
-          python-version: '3.12'
-
-      - name: Install Make and Git
-        run: |
-          apt-get update && apt-get install -y make git curl
-
-      - name: Install uv
-        run: |
-          curl -LsSf https://astral.sh/uv/install.sh | sh
-
-      - name: Create Python virtual environment
-        run: |
-          uv venv
-          uv pip install --upgrade setuptools wheel
-
-      - name: Install dependencies
-        run: |
-          source .venv/bin/activate
-          uv pip install ".[test]"
-
-      - name: Test with pytest
-        run: |
-          source .venv/bin/activate
-          make test
-
-      - name: Post to Slack
-        if: github.ref == 'refs/heads/main' && always()  # Check if the branch is main
-        uses: huggingface/hf-workflows/.github/actions/post-slack@main
-        with:
-          slack_channel: ${{ env.CI_SLACK_CHANNEL }}
-          title: Results with Python 3.12 without optional dependencies
-          status: ${{ job.status }}
-          slack_token: ${{ secrets.SLACK_CIFEEDBACK_BOT_TOKEN }}
-
-  tests_min_versions:
-    name: Tests with minimum versions
-    runs-on:
-      group: aws-g4dn-2xlarge
-    container:
-      image: pytorch/pytorch:2.6.0-cuda12.6-cudnn9-devel
-      options: --gpus all
-    defaults:
-      run:
-        shell: bash
-    if: github.event.pull_request.draft == false
-    steps:
-      - name: Git checkout
-        uses: actions/checkout@v4
-
-      - name: Set up Python 3.12
-        uses: actions/setup-python@v5
-        with:
-          python-version: '3.12'
-
-      - name: Install Make and Git
-        run: |
-          apt-get update && apt-get install -y make git curl
-
-      - name: Install uv
-        run: |
-          curl -LsSf https://astral.sh/uv/install.sh | sh
-
-      - name: Create Python virtual environment
-        run: |
-          uv venv
-          uv pip install --upgrade setuptools wheel
-
-      - name: Install dependencies
-        run: |
-          source .venv/bin/activate
-          uv pip install ".[dev]"
-          uv pip install accelerate==1.4.0
-          uv pip install datasets==3.0.0
-          uv pip install transformers==4.51.0
-
-      - name: Test with pytest
-        run: |
-          source .venv/bin/activate
-          make test
-
-      - name: Post to Slack
-        if: github.ref == 'refs/heads/main' && always()  # Check if the branch is main
-        uses: huggingface/hf-workflows/.github/actions/post-slack@main
-        with:
-          slack_channel: ${{ env.CI_SLACK_CHANNEL }}
-          title: Results with Python 3.12 and minimum dependencies versions
-          status: ${{ job.status }}
-          slack_token: ${{ secrets.SLACK_CIFEEDBACK_BOT_TOKEN }}

.github/workflows/tests_latest.yml

@@ -1,66 +0,0 @@
-name: Tests latest TRL release with dev dependencies
-
-on:
-  schedule:
-    - cron: '0 0 * * *'  # Runs daily at midnight UTC
-
-  workflow_dispatch:
-
-env:
-  TQDM_DISABLE: 1
-  CI_SLACK_CHANNEL: ${{ secrets.CI_PUSH_MAIN_CHANNEL }}
-
-jobs:
-  tests:
-    name: Tests latest TRL release with dev dependencies
-    runs-on:
-      group: aws-g4dn-2xlarge
-    container:
-      image: pytorch/pytorch:2.6.0-cuda12.6-cudnn9-devel
-      options: --gpus all
-    defaults:
-      run:
-        shell: bash
-    steps:
-      - name: Git checkout
-        uses: actions/checkout@v4
-        with: { ref: v0.18-release }
-
-      - name: Set up Python 3.12
-        uses: actions/setup-python@v5
-        with:
-          python-version: '3.12'
-
-      - name: Install Make and Git
-        run: |
-          apt-get update && apt-get install -y make git curl
-
-      - name: Install uv
-        run: |
-          curl -LsSf https://astral.sh/uv/install.sh | sh
-
-      - name: Create Python virtual environment
-        run: |
-          uv venv
-          uv pip install --upgrade setuptools wheel
-
-      - name: Install dependencies
-        run: |
-          source .venv/bin/activate
-          uv pip install ".[dev]"
-          uv pip install -U git+https://github.com/huggingface/accelerate.git
-          uv pip install -U git+https://github.com/huggingface/datasets.git
-          uv pip install -U git+https://github.com/huggingface/transformers.git
-
-      - name: Test with pytest
-        run: |
-          source .venv/bin/activate
-          make test
-
-      - name: Post to Slack
-        uses: huggingface/hf-workflows/.github/actions/post-slack@main
-        with:
-          slack_channel: ${{ env.CI_SLACK_CHANNEL }}
-          title: Results of latest TRL with Python 3.12 and dev dependencies
-          status: ${{ job.status }}
-          slack_token: ${{ secrets.SLACK_CIFEEDBACK_BOT_TOKEN }}

.github/workflows/trufflehog.yml

@@ -1,18 +0,0 @@
-on:
-  push:
-
-name: Secret Leaks
-
-jobs:
-  trufflehog:
-    runs-on: ubuntu-latest
-    steps:
-    - name: Checkout code
-      uses: actions/checkout@v4
-      with:
-        fetch-depth: 0
-    - name: Secret Scanning
-      uses: trufflesecurity/trufflehog@853e1e8d249fd1e29d0fcc7280d29b03df3d643d
-      with:
-        # exclude buggy postgres detector that is causing false positives and not relevant to our codebase
-        extra_args: --results=verified,unknown --exclude-detectors=postgres

.github/workflows/upload_pr_documentation.yml

@@ -1,16 +0,0 @@
-name: Upload PR Documentation
-
-on:
-  workflow_run:
-    workflows: ["Build PR Documentation"]
-    types:
-      - completed
-
-jobs:
-  build:
-    uses: huggingface/doc-builder/.github/workflows/upload_pr_documentation.yml@main
-    with:
-      package_name: trl
-    secrets:
-      hf_token: ${{ secrets.HF_DOC_BUILD_PUSH }}
-      comment_bot_token: ${{ secrets.COMMENT_BOT_TOKEN }}