All notable changes to this project will be documented in this file.
- 2026-03-19 Deprecate force_skip argument by @cbeauchesne
- 2026-03-23 Support multiple lang-branch overrides in PR title by @bm1549
- 2026-03-05 revamp: use a classic test for schema validation by @cbeauchesne
- 2026-03-02 AI devx tools by @robertomonteromiguel
- 2026-03-09 Centralized constant handling: list of all components grouped by use case by @nccatoni
- 2026-03-10 README improvement and restructuration of the documentation by @nccatoni
- 2026-02-26 Adding the datadog mcp to system-tests cursor configuration by @nccatoni
- 2026-02-23 Support v1 trace format from libraries by @cbeauchesne and @ajgajg1134
- 2026-02-19 [ruby] Use dd-trace-rb version as it is in the library by @p-datadog
- 2026-02-10 codex: pr review rules by @robertomonteromiguel
- 2026-02-06 Activate ANN001 format rules (typings) on K8s utils by @robertomonteromiguel
- 2026-02-02 Update K8s Components github workflow by @robertomonteromiguel
- 2026-02-06 [APMSP-2608] Introduce weblog infra abstraction by @cbeauchesne
- 2026-01-30 Adds library branch selector in debug harness by @cbeauchesne
- 2026-01-27 AWS SSI: Better exception handler by @robertomonteromiguel
- 2026-01-26 refactor(parametric): implement version-aware RC capability definitions by @watson
- 2026-01-29 Add two new decorators to replace the force skip option by @nccatoni
- 2026-01-30 python: add tornado weblog by @florentinl
- 2026-01-21 Pushing system-tests CI executions to Test Optim on DataDog prod by @nccatoni
- 2026-01-19 python: improved local development experience for scenarios with a python weblog by @florentinl
- 2026-01-27 [envoy / haproxy] Create new components manifests by @e-n-0
- 2026-01-12 Allow code editors to collect tests by @florentinl
- 2026-01-07 New AWs Account for local develpment by @robertomonteromiguel
- 2026-01-28 K8s: Add cluster agent dev into the job matrix by @robertomonteromiguel
- 2026-01-02 Test auto activation migration by @nccatoni
- 2025-12-30 allows list of weblogs in weblog declaration keys by @christophe-papazian
- 2025-12-18 Auto sort for manifest files by @nccatoni
- 2025-12-16 Auto complete based on schema for yaml-language-server by @nccatoni
- 2025-12-04 Allow parametric test to set agent env by @cbeauchesne
- 2025-12-09 Manifests migration by @nccatoni
- 2025-11-26 Clean API to control mocked behavior on proxy by @cbeauchesne
- 2025-11-21 Simplify PARAMETRIC TestClient API by @cbeauchesne
- 2025-11-26 Add OpenAI LLM Observability Tests by @sabrenner
- 2025-11-05 Pushing to test optimization by @nccatoni
- 2025-11-04 Activate ANN001 on all endtoend and parametric scenarios by @cbeauchesne
- 2025-11-13 expand openai integration frameworks tests by @sabrenner
- 2025-10-24 Allow running php system tests with self-compiled artifact by @bwoebi
- 2025-10-21 Clarification of interface.validate API by @cbeauchesne
- 2025-10-21 Automatic changelog generation by @nccatoni
- 2025-10-15 SSI: Allow use the installer from binaries by @robertomonteromiguel
- 2025-10-10 AWS SSI: Allow to use a custom library version for each language by @robertomonteromiguel
- 2025-10-01 Set good owners (agent, ASM, SDK) by @cbeauchesne
- 2025-10-02 Display code owners of modified files in a PR comment by @avara1986
- 2025-10-10 Add Open Telemetry Collector // Postgres Tests by @wantsui
- 2025-09-15 Report code owners in junit/test optimization by @cbeauchesne
- 2025-09-23 Automatic easy win activation script by @nccatoni
- 2025-09-10 Reduce parametric logs verbosity by @nccatoni
- 2025-09-02 Add debugger harness to allow on demand flake reproduction by @cbeauchesne
- 2025-09-19 feat: add haproxy stream_processing_offload system tests by @e-n-0
- 2025-09-22 Add scenario deduplication validation with test_minimal_number_of_scenarios by @jandro996
- 2025-08-28 Using prebuilt wheel for dd-trace-py by @nccatoni
- 2025-08-25 Do not run any scenario/libraries if only documentation is modified. by @nccatoni
- 2025-08-28 Add initial support for v1.0 traces endpoint by @ajgajg1134
- 2025-08-07 Add the dimension of feature owner by @cbeauchesne
- 2025-08-06 Add force-execute input in official workflow by @cbeauchesne
- 2025-08-20 [python_lambda] Add scenario for testing the python tracer for AWS Lambda by @florentinl
- 2025-07-29 [ruby] Remove excessive Rails versions by @Strech
- 2025-07-02 Allow to use a subset of weblog in official workflow by @cbeauchesne
- 2025-07-18 K8s injector dev first scenario by @robertomonteromiguel
- 2025-06-26 Check that all declared production version exists for java by @cbeauchesne
- 2025-06-25 Implement AI Testing Framework and Specialized Prompts by @robertomonteromiguel
- 2025-06-16 Use the bare agent image in end-to-end scenario by @cbeauchesne
- 2025-06-12 Add optional inputs ref for system-tests.yml by @TonyCTHsu
- 2025-06-09 Robertomonteromiguel/cursor copilot endtoend scenarios by @robertomonteromiguel
- 2025-06-04 Test that tracer version is reported as semver to RC by @smola
- 2025-06-11 [Nodejs] init fastify weblog by @IlyasShabi
- 2025-06-03 Robertomonteromiguel/GitHub copilot and docs by @robertomonteromiguel
- 2025-05-27 add a script that adds a label on tickets referenced in system-tests by @cbeauchesne
- 2025-05-22 Allow parametric tests to run against an arbitrary system-tests ref by @cbeauchesne
- 2025-05-21 do not require ca-certificate for agent image #4676 by @cbeauchesne
- 2025-05-05 Use ensure-ci-success for all-green gatekeeper by @cbeauchesne
- 2025-05-09 ssi: track ssi configurations via telemetry by @mabdinur
- 2025-04-22 Add an option to exclude some scenarios in system-tests.yml by @cbeauchesne
- 2025-04-04 Introduce a way to add extra argument to library cmd on parametric scenario by @cbeauchesne
- 2025-03-28 Add core dump on PHP weblogs by @cbeauchesne
- 2025-03-24 Create cpp_nginx library by @cbeauchesne
- 2025-03-20 onboarding: force the apm instrumentation after install the installer. by @robertomonteromiguel
- 2025-03-30 retry npm install when it fails by @rochdev
- 2025-03-18 Add library cpp_httpd by @cbeauchesne
- 2025-03-18 Allow manifest to declare skips on entire folder by @cbeauchesne
- 2025-03-19 Add order checking to format.sh by @bm1549
- 2025-03-10 support for TARGET_BRANCH load_binary.sh golang by @eliottness
- 2025-03-12 Add parallel mode in CI #4035 by @cbeauchesne
- 2025-03-04 Onboarding: gitlab ci by @robertomonteromiguel
- 2025-02-12 Add yamlfmt + yamllint by @bm1549
- 2025-02-10 Green CI policy by @cbeauchesne
- 2025-02-04 Extend mypy to full project by @cbeauchesned
- SSI:
- Implement retry policies on Gitlab pipeline with the aim of reducing flakiness
- Improvements in exception handling and messages displayed to the end user
- Enable all new vm distros and report to feature parity dashboard
- 2025-01-20 Deserialize JSON in multipart by @cbeauchesne
- 2025-01-14 [python] add new python weblog: django-py3.13 by @christophe-papazian
- 2025-01-09 Removes CircleCI job by @cbeauchesne
- 2025-01-03 Add an option that skip all tests if scenario contains only xfail/skip by @cbeauchesne
- 2025-01-27 Try to get TARGET_BRANCH from PR's title by @iunanua
- 2025-01-30 [golang] new orchestrion go weblog by @eliottness
- 2025-01-16 Add tests for Service Extension (Envoy External Processing) by @e-n-0
- 2024-12-31 Allow a class to declare several scenarios by @cbeauchesne
- 2024-12-17 Optimization of java weblogs 1, 2, 3 and 4 by @smola
- 2024-12-13 Use ruff instead of black as formatter and linter by @cbeauchesne
- 2024-12-03 Lot ofrevamp of k8 tests by @robertomonteromiguel
- 2024-11-22 Docker SSI: report data to FPD by @robertomonteromiguel
- 2024-11-21 adding mypy checks by @rachelyangdog
- 2024-11-18 [ruby] Add Rails 7.2 and Rails 8.0 weblogs by @vpellan
- 2024-11-13 Use a unique way to define scenario groups #3400 by @cbeauchesne
- 2024-11-18 Test for zombie processes in crashtracking by @kevingosse
- 2024-11-04 Fix parametric instability at container start by @cbeauchesne
- 2024-11-06 parametric: Adds a feature to track the parity for parametric endpoints by @mabdinur
- 2024-11-04 [golang] Migrate Parametric app from grpc to http by @mtoffl01
- Lot of work done on SSI/onboarding by @robertomonteromiguel and @emmettbutler
- 2024-10-24 [Ruby] Convert parametric implementation from grpc to http by @ZStriker19 and @marcotc
- 2024-10-17 Onboarding: feature parity dashboard by @robertomonteromiguel
- 2024-10-08 Proxy exports files content in a separated folder in logs by @cbeauchesne
- 2024-10-07 External processing : initial poc by @cbeauchesne and @e-n-0
- 2024-09-23 Remove legacy check on python 3.9 by @cbeauchesne
- 2024-09-18 Enforce JIRA ticket in bug/flaky declarations by @cbeauchesne
- 2024-09-12 [ruby] Increment path in ruby "dev" version, and set a prerelease by @cbeauchesne
- 2024-09-12 Removes system-tests-core form owners of manifests by @cbeauchesne
- 2024-09-06
-o xfail_strict=Trueto force XPASS to fail by @cbeauchesne - 2024-09-10 Print weblog crash logs by @simon-id
- 2024-08-29 [java] Enable e2e tests on all spring-boot variants by @smola
- 2024-08-22 [java] Use HTTP interface for parametric test by @cbeauchesne
- 2024-08-05 parametric: adds a consistent interface for retrieving traces and spans by @mabdinur
- 2024-08-05 [nodejs] allow mounting local dd-trace-js as weblog volume by @rochdev
- 2024-07-22 Ability to change the support state of meta struct of the agent by @e-n-0
- 2024-07-18 Add better support for the new RC API by @christophe-papazian
- 2024-07-23 Start containers in parallel by @rochdev
- 2024-07-10 New Remote Config testing API by @cbeauchesne
- 2024-07-02 OnBoarding: Host and container guardrail testing by @robertomonteromiguel
- 2024-06-26 add pytest-split to allow splitting test running in groups by @rochdev
- 2024-06-24 Remote config test API by @cbeauchesne
- 2024-06-20 [golang] Enable RASP SSRF tests by @eliottness
- 2024-06-24 RASP SQLi: enhance test & activate for Go by @Hellzy
- 2024-06-19 [go] implement RASP endpoints by @eliottness
- 2024-06-03 [python] RASP sqli tests for python by @christophe-papazian
- 2024-05-27 Use semver for version parser by @cbeauchesne
- 2024-05-07 [python] decrease the waiting time for python libraries from 25s to 5s by @christophe-papazian
- 2024-05-29 Manifest references + Node.js semver migration by @simon-id
- 2024-05-03 Dynamically compute scenarios to run by @cbeauchesne
- 2024-04-18 Compute dynamically the matrix to run in CI by @cbeauchesne
- 2024-04-18 Build docker images if there is a label by @robertomonteromiguel
- 2024-04-03 K8s lib injection: new python variants by @robertomonteromiguel
- 2024-04-25 Support semver version ranges for
releaseddecorator (and manifests) by @simon-id
- 2024-03-27 Add more ruby variants by @lloeki
- 2024-03-20 New Ruby variant : Rails 7.1 by @lloeki
- 2024-03-18 Add OTel Interoperability System tests by @PROFeNoM
- 2024-02-15 Allow the main workflow to be called in a distant workflow by @cbeauchesne
- 2024-02-16 Conti/add aws kinesis tests by @wconti27
- 2024-02-15 feat: add aws sns context propagation and DSM tests by @wconti27
- 2024-02-01 OnBoarding: new tests for args block list by @robertomonteromiguel
- 2024-02-01 feat: add rabbitmq sample apps by @wconti27
- 2024-02-13 Graphql blocking tests by @uurien
- 2024-01-29 Check variant names in manifest validation by @cbeauchesne
- 2024-01-29 Generate buddies on merge if needed by @robertomonteromiguel
- 2024-01-15 Support for PHP unified client library by @robertomonteromiguel
- 2024-01-08 Parametric: test "dev" version of clienty libraries by @robertomonteromiguel
- 2024-01-04 parametric: test C++ client library by @dmehala
- 2023-12-27 Declare lot of features ID (1, 2, 3, 4, 5, 6, 7) by @cbeauchesne
- 2023-12-01 Add "features" decorator, and ensure in CI that all tests has a features decorator by @cbeauchesne
- 2023-12-27 Parametric: allow to test dev version for python, java, nodejs and golang by @robertomonteromiguel
- 2023-11-23 [PHP] Support unified package by @Anilm3
- 2023-11-07 Sleep mode for all scenarios by @robertomonteromiguel
- 2023-11-07 [Tracing] Add endpoints to Python Weblog application related to Kafka Producer and Consumer calls by @wantsui
- 2023-10-09 New python/FastAPI variant by @christophe-papazian
- 2023-10-27 New Node.js/NextJS variant by @uurien
- 2023-10-01 New scenario for testing debugger probes by @shurivich
- 2023-09-25 New weblog variant: testing new Python version 3.12
- 2023-09-22 DB Integrations scenario: validate DB query reporting
- 2023-09-20 Parametric tests can use version in decorator/manifest file
- 2023-09-08 Agent version can be used in decorators and manifest file
- 2023-09-08 DB Integrations scenario: validate DB query reporting
- All the month: lot of PR to migrate all
releaseddecorators to manifest files 🎉
- 2023-08-31 Deserilize appsec tags in deserializer ASM data are visible as plain JSON in logs
- 2023-08-18 Add stdout interface for postgres DB container Ability to make assertion on DB containers (like Postgres) logs
- 2023-08-14 Add pylint Code quality for system-tests internales
- 2023-08-16 Implementation of manifest files 🎉
- 2023-07-31 Add library version detection for parametric tests Parametric tests can now use
@released - 2023-07-19 Merge parametric CI inside main CI Lot of simplifications in system tests CI
- 2023-07-21 RFC: manifest file Manifest file RFC is validated !
- 2023-07-04 Live Debugger test scenarios New scenario for live debugger features
- 2023-06-12 VsCode configuration files: Run and debug your test
- 2023-06-16 Force a test execution: Temporary force a test to be executed in your CI (doc)
- 2023-06-22 Migrate parametric tests: Parametric tests are now a regular scenario of system tests
- 2023-06-07 New onboarding tests: Test the APM onboarding experience for customers using lib injection (doc)
- 2023-06-26 New java weblog: spring-boot-payara
- Some performance improvements on build step.
- 2023-05-30 Each tracer team is owner of its weblog variants by @smola
- 2023-05-23 New java weblog : akka-http by @cataphract
- 2023-05-16 Replay mode 🎉 by @cbeauchesne
- 2023-05-09 Ability to run a set of scenario by @cbeauchesne
- 2023-05-02 New java weblog : Vert.x 4.x by @manuel-alvarez-alvarez
- 2023-04-28 Show requests/response in log on failure by @cbeauchesne
- 2023-04-27 Allow to specify an arbitrary test file in a non-default scenario by @cbeauchesne
- 2023-04-25 Add opentelemetry intake end-to-end system tests by @songy23
- 2023-04-25 new onboarding tests by @robertomonteromiguel
- 2023-04-25 Update CODEOWNERS : Add @DataDog/appsec-libraries to owmers of tests/appsec folder by @cbeauchesne
- 2023-04-19 Runner is now in executed on host by @cbeauchesne
- 2023-04-13 Add Vert.x support for java IAST by @manuel-alvarez-alvarez
- ...
- ...