mirror of
https://github.com/DeusData/codebase-memory-mcp.git
synced 2026-11-06 17:49:47 +00:00
Martin Vogel
674a731fcc
The test-impact engine certifies the history it diffs and refuses a shallow
clone ("Graft or shallow state prevents history certification"). The shadow
job, the gate-mode select-tests job and the main-branch producer all checked
out with fetch-depth 2. So every shadow answer since #2458 was run_all:
GIT_UNAVAILABLE, then POLICY_UNAVAILABLE, because the merge base's
.codebase-memory.json is read through the same git facts. That was 24 of 24
measured PR runs. All three jobs now check out full history (about 400 MiB,
these jobs only).
The producer never published a bundle either. coverage-map.py exits 1 when a
suite fails under coverage: the map is still written and that suite's tests
are incomplete. test-impact-publish.sh ran it under set -e, so the publish
aborted. The failing suite was test_impact_git. Its hostile-diff probe
re-enters the runner as a child, which inherited CBM_TEST_COVERAGE_DIR,
started a coverage run of its own, and refused the per-test LLVM_PROFILE_FILE
it inherits.
Two changes:
- The probe now clears CBM_TEST_COVERAGE_DIR, as it already clears
CBM_TEST_ONLY_FILE. The child's profile then goes to the spawning test, like
any other child process.
- publish treats exit 1 as a written, conservative map (incomplete tests run
whole), with a warning that names the suite. It fails only on exit 2.
Proof:
- Depth-2 clone at f9ce3865: test-impact select answers run_all
[GIT_UNAVAILABLE, POLICY_UNAVAILABLE] with "Graft or shallow state ...", as
in CI. Same commit with full history: graph certified, run_all
[RUNNER_REACHED] (the change reaches the runner's main).
- Coverage runner (Homebrew LLVM, macOS), test_impact_git: before, 43 passed
and 2 failed ("a coverage run starts with LLVM_PROFILE_FILE=/dev/null");
after, 45 passed. coverage-map.py --suite test_impact_git: 45 tests,
0 incomplete, exit 0.
Signed-off-by: Martin Vogel <martin.vogel.tech@gmail.com>
88 lines
3.5 KiB
YAML
88 lines
3.5 KiB
YAML
# Team artifact for test selection (smart CI, report-only until the oracles
|
|
# and the shadow comparison are green). Every push to main publishes the
|
|
# commit's bundle — its frozen graph, built incrementally from the previous
|
|
# bundle, and its per-test coverage map, re-run only for the suites the push
|
|
# selects — as the Actions artifact test-impact-<sha>. A weekly run rebuilds
|
|
# both from scratch and fails when the incremental graph differs from the full
|
|
# one. PR selection fetches the bundle of its merge base
|
|
# (scripts/ci/test-impact-bundle.sh) and never narrows on anything else.
|
|
name: test-impact-artifact
|
|
|
|
on:
|
|
push:
|
|
branches: [main]
|
|
schedule:
|
|
- cron: "23 3 * * 0" # weekly full refresh, Sunday 03:23 UTC
|
|
workflow_dispatch:
|
|
inputs:
|
|
mode:
|
|
description: incremental or full
|
|
type: choice
|
|
options: [incremental, full]
|
|
default: full
|
|
|
|
permissions:
|
|
contents: read
|
|
actions: read # fetch the previous bundle
|
|
|
|
concurrency:
|
|
# Bundles chain: each push builds on the previous one, so runs never overlap
|
|
# and are never cancelled half-way.
|
|
group: test-impact-artifact
|
|
cancel-in-progress: false
|
|
|
|
jobs:
|
|
publish:
|
|
runs-on: ubuntu-24.04
|
|
timeout-minutes: 120
|
|
steps:
|
|
- uses: actions/checkout@3d3c42e5aac5ba805825da76410c181273ba90b1 # v7.0.1
|
|
with:
|
|
# Full history: `test-impact select/publish` certify the history they
|
|
# read and refuse a shallow clone.
|
|
fetch-depth: 0
|
|
persist-credentials: false
|
|
|
|
- name: Install build deps and LLVM 21 (coverage toolchain)
|
|
run: |
|
|
sudo apt-get update && sudo apt-get install -y zlib1g-dev
|
|
wget -qO- https://apt.llvm.org/llvm-snapshot.gpg.key | sudo tee /etc/apt/trusted.gpg.d/apt.llvm.org.asc
|
|
echo "deb http://apt.llvm.org/noble/ llvm-toolchain-noble-21 main" | sudo tee /etc/apt/sources.list.d/llvm-21.list
|
|
sudo apt-get update
|
|
sudo apt-get install -y clang-21 llvm-21 libclang-rt-21-dev
|
|
|
|
- name: Build the production binary and the coverage runner
|
|
run: |
|
|
scripts/build.sh CC=gcc CXX=g++
|
|
make -f Makefile.cbm test-runner-cov COV_LLVM_BIN=/usr/lib/llvm-21/bin -j"$(nproc)"
|
|
|
|
- name: Publish the bundle
|
|
env:
|
|
GH_TOKEN: ${{ github.token }}
|
|
EVENT: ${{ github.event_name }}
|
|
BEFORE: ${{ github.event.before }}
|
|
REQUESTED: ${{ inputs.mode }}
|
|
# The selection lane excludes @perf and PR CI skips perf, so their
|
|
# (slowest, longest under coverage) suites are neither mapped nor
|
|
# listed: the runner then neither lists nor runs them.
|
|
CBM_SKIP_PERF: "1"
|
|
run: |
|
|
mode=incremental
|
|
if [ "$EVENT" = schedule ] || [ "$REQUESTED" = full ]; then mode=full; fi
|
|
before="$(git rev-parse HEAD^1)"
|
|
if [ "$EVENT" = push ] && [ -n "$BEFORE" ] && [ "$BEFORE" != 0000000000000000000000000000000000000000 ]; then
|
|
before="$BEFORE"
|
|
fi
|
|
scripts/ci/test-impact-publish.sh --binary build/c/codebase-memory-mcp \
|
|
--runner build/cov/test-runner --llvm-bin /usr/lib/llvm-21/bin \
|
|
--out "$RUNNER_TEMP/bundle" --mode "$mode" --before "$before"
|
|
|
|
- name: Upload the bundle
|
|
uses: actions/upload-artifact@043fb46d1a93c77aae656e7c1c64a875d1fc6a0a # v7.0.1
|
|
with:
|
|
name: test-impact-${{ github.sha }}
|
|
path: ${{ runner.temp }}/bundle
|
|
include-hidden-files: true # the graph lives in .codebase-memory/
|
|
retention-days: 30
|
|
if-no-files-found: error
|