Releases: cnti-testcatalog/testsuite
Releases · cnti-testcatalog/testsuite
main-2024-12-09-150805-9dbb5ae4 December 09, 2024
main-2024-12-08-123829-91a45e46 December 08, 2024
UPDATES
Issues addressed in this release:
- #2187 - Force the use of ubuntu-24.04
- #2186 - Update all github actions
- #2185 - Remove 2 incorrect submodules not listed in .gitmodules
- #2171 - installation: CNF Installation (8) Transition to new installation
- #2169 - [Feature] CNF Installation (8), Transition to new installation method.
- #2177 - installation: CNF Installation (7) Verify new installation process
- #2168 - [Feature] CNF Installation (7), Analyze and prepare specs for new installation process
- #2161 - [Feature] CNF Installation (6), Prepare new installation process
- #2176 - [Feature] Allow to specify deployment order in cnfs that have multiple deployments
Artifact info:
- Commit: main-2024-12-08-123829-91a45e46
- SHA256SUM: 86602683fee715297d4ea6808bcf7c2f8aa4dd49b78a61e1725428b1942ed5ec cnf-testsuite-main-2024-12-08-123829-91a45e46.tar.gz
v1.4.0-beta
Release Notes for v1.4.0-beta (Thursday, November 14, 2024)
Changes since v1.3.3 (September 16, 2024)
🙌 Kudos
We appreciate everyone who helped with Release v1.4.0-beta! 🎉
Special thanks to contributors committed to this release:
@kosstennbl
@svteb
@collivier
@barmull
Please submit a PR to add your name to the CONTRIBUTORS.md.
Features
- #2129 CNF Installation (1) introduce new config format and parser
- #2147 CNF Installation (2.1) Transformer for old version of config
- #2148 CNF Installation (2.2) Add generator for v2 config
- #2149 CNF Installation (3) Switch to new config usage
- #2162 CNF Installation (3.1) Limit cnf_setup to only one CNF
- #2150 CNF Installation (4) Group several manifest into one file
- #2163 CNF Installation (5.1) Test preparation for new installation
- #2164 CNF Installation (5.2) Remove installation configmap
- #2166 CNF Installation (5.3) Disable new cluster tests and adapt service_discovery
- #2167 CNF Installation (5.4) Update compatibility tests
- #2165 CNF Installation (6) New installation process
- #2177 (beta) CNF Installation (7) Verify new installation process
- #2171 (beta) CNF Installation (8) Transition to new installation
🐛 Bug Fixes
- #2175 typo: close cat call in github action definition
🔧 Maintenance
- #2160 Remove ameba from shard dependencies
Artifact info:
- Commit: v1.4.0-beta
- SHA256SUM: 4c8feb391ff746eed3489cbc662b569279f6df6649142fd465188893b9c92875 cnf-testsuite-v1.4.0-beta.tar.gz
Full Changelog: v1.3.3...v1.4.0-beta
main-2024-11-07-134304-bc1f193d November 07, 2024
UPDATES
Issues addressed in this release:
- #2161 - [Feature] CNF Installation (6), Prepare new installation process
- #2153 - [Feature] CNF Installation (5), Prepare tests for new installation method
- #2150 - Feature: CNF Installation (4) Group several manifest into one file
- #2162 - config: CNF installation (3.1) Limit cnf_setup to only one CNF
- #2095 - [MAINTENACE] Clarify usage and behavior of testing multiple CNFs
- #2149 - config: CNF Installation (3) Switch to new config usage
- #2135 - [Feature] CNF Installation (3), Switch to new config usage
- #2160 - ameba: Remove ameba from shard dependencies
- #2157 - [MAINTENANCE] Remove Ameba from shard dependencies
- #2148 - config-generator: CNF Installation (2.2) Add generator for v2 config
- #2138 - [Feature] CNF Installation (2.2), New config format generation
- #2147 - config: CNF installation (2.1) Transformer for old version of config
- #2130 - [Feature] CNF Installation (2.1), Config format transformer for older version
- #2129 - config: CNF installation (1) introduce new config format and parser
- #2121 - [Feature] CNF installation (1), Implement new config format
- #2127 - fix: Change Helm library to CNFInstall module
- #2139 - helm-install: Make helm install failure fatal
- #2140 - Bump cluster-tools to v1.0.7
- #24 - Scalability Test: Can CNF increase and decrease capacity?
- #2137 - quick fix: remove protected image repo spec test
- #2114 - cnf_setup: Exit on setup failure or timeout
- #2136 - [BUG] Image size spec test using protected repo is not working
- #1937 - [BUG] cnf_setup command is not working correctly in case of failing cnf creation
- #2083 - [BUG] spec tests don't fail on unsuccessful cnf-setup
- #2132 - Update links to the cnti slack channel
- #2126 - cert: remove cert tag from non-essential tests
- #2117 - [MAINTENANCE] Align cert set with "Certification 2.0 beta" - reduce it to 19 essential tests
- #2119 - Removal and exchange duplicate test for privileged containers
- #2115 - [MAINTENANCE] Remove and exchange duplicate test for privileged containers
- #2110 - Fix: Optimize single_process_type execution
- #2084 - [Improvement] Optimize runtime of single_process_type test
- #2056 - [Feature] Make helm_install_namespace default value "cnf-default"
- #2122 - envoy: Change installation method to Helm directory
- #2113 - workflow: Cancel workflows on push
- #1928 - Removal of allowlist from priviledged tests
- #1906 - [BUG] Consider only the CNF's resources for the
privilegedtest that checks for containers running in privileged mode - #2111 - manifest_install: Move manifest install to repo
- #2105 - [Feature] Separate manifest installation mode from helm
- #2109 - airgap: Remove airgap mode
- #2104 - [MAINTENANCE] Remove AIRGAP mode from code
- #2102 - Add possibility to change node drain duration
- #2098 - Global timer makes litmus create verdict sooner than the AUT is ready causing the node drain test to fail
- #2097 - Feat: Rework k8s_tshark functionality and apply the changes in tests
- #2072 - [BUG] Unstable 5G tests(suci_enabled) in github actions
- #2087 - [Improvement] Refactor K8sTshark module
- #2082 - Docs: Relocate alpha_k8s_apis to configuration sections across docs
- #2077 - [BUG] Relocation of the "alpha_k8s_apis" task
- #2052 - Fix: export_published_chart correctly detects and exports tar file
- #1947 - [BUG] Erroneous file globbing in cnf_manager - export_published_chart
- #2096 - hardcoded-ip-test: Redesign test, add more info on fail
- #2093 - [Improvement] hardcoded_ip_addresses_in_k8s_runtime_configuration should give more information on failure
- #2089 - docs: Add linter for the documentation
- #2055 - Change: Cluster setup exception message shortened
- #1926 - [BUG] Unintuitive output of install_cluster_tools/uninstall_cluster_tools within the context of spec tests.
- #2028 - remove duplicate test "volume_hostpath_not_found"
- #2027 - [MAINTENANCE] Remove duplicate test "volume_hostpath_not_found"
- #2086 - Bump k8s_netstat to fix database timeouts
- #2078 - [BUG] shared_database2 spec test has inconsistent results in actions
- #2080 - Allow GH actions on PRs from forked repos
- #2066 - [MAINTENANCE] Enable github actions to be (successfully) run for PRs created from forked repos
- #1995 - improvement: check if cluster is up and running
- #1955 - docs: Unification of documentation
- #2085 - Bump kubectl_client to fix labelling issue
- #2062 - Label filtering on StatefulSets is bringing additional pods into the test
- #2079 - Update registry mirror to UNH infrastructure
- #2013 - Urgent: Move off CNCF Equinix Resources
- #1964 - fix: add condition in method ensure_kubeconfig!
- #2023 - timeouts: Redesign and unify timeouts
- #335 - [Feature] Replace hardcoded timeouts with variables
- #2069 - Remove deprecated capacity tests in docs
- #2034 - Fix: Routed logs test now correctly checks if CNF is being tailed
- #2025 - [BUG] Fluentd tailing check is incorrect - observability, routed logs
- #2016 - [BUG] Outdated helm repo path in fluentd bitnami install
- #2051 - cert: Add test exclusion in cert tasks
- #2048 - Test exclusion during certification no longer working (e.g. Cert ~testname)
- #2067 - Don't fail on delete cluster in github actions
- #2064 - [BUG] github actions fail frequently on cluster delete
- #2054 - Add exclusion of init system from single process check
- #2040 - Add namespace when calling pods_by_resource
- #2030 - The single process type check is skipped if the AUT is deployed in a non-default namespace
- #2057 - Rename MAINTAINERS.md to CONTRIBUTORS.md
- #2058 - Update CONTRIBUTION_LADDER.md
- #2045 - fix: add error_task into cnf-testsuite-results file
- #2046 - Add Martin Matyas to maintainers
Artifact info:
- Commit: main-2024-11-07-134304-bc1f193d
- SHA256SUM: 6a1eafdad0169f1e1f4ca8f2b27c68a88e1efe3bb2a1b6de2f2177df29f18aab cnf-testsuite-main-2024-11-07-134304-bc1f193d.tar.gz
v1.3.3
Release Notes for v1.3.3 (Monday, September 16, 2024)
Changes since v1.3.2 (August 19, 2024)
🙌 Kudos
We appreciate everyone who helped with Release v1.3.3! 🎉
Special thanks to contributors committed to this release:
@kosstennbl
@barmull
@martin-mat
Please submit a PR to add your name to the CONTRIBUTORS.md.
🐛 Bug Fixes
🔧 Maintenance
- #2140 - Bump cluster-tools to v1.0.7 with optimized cluster-tools docker image size
Artifact info:
- Commit: v1.3.3
- SHA256SUM: f92910f2800f2a109091af23ddacd0b649cf0212fe54ab99d76c31c5a059188a cnf-testsuite-v1.3.3.tar.gz
Full Changelog: v1.3.2...v1.3.3
Contributors
martin-mat, kosstennbl, and barmull
Assets 3
v1.3.2 August 19, 2024
Release Notes for v1.3.2 (Monday, August 19, 2024)
Changes since v1.3.1 (July 18, 2024)
🙌 Kudos
We appreciate everyone who helped with Release v1.3.2! 🎉
Special thanks to contributors committed to this release:
@kosstennbl
@svteb
@martin-mat
@barmull
@horecoli
Please submit a PR to add your name to the CONTRIBUTORS.md.
✨ Enhancements
- #2114 #1937 #2083 - Exit on cnf_setup failure or timeout
- #2110 #2084 - Optimize single_process_type execution time
- #2056 - Make helm_install_namespace default value "cnf-default"
🐛 Bug Fixes
- #2122 - Change installation method of Envoy to Helm directory
🔧 Maintenance
- #2126 #2117 - Remove cert tag from non-essential tests
- #2119 #2115 - Removal and exchange duplicate test for privileged containers
- #2113 - Cancel Github workflows on push
- #1928 #1906 - Removal of allowlist from priviledged tests
- #2111 #2105 - Move manifest install to testsuite repo
- #2109 #2104 - Remove airgap mode
📖 Documentation
- #2132 - Update links to the cnti slack channel
Artifact info:
- Commit: v1.3.2
- SHA256SUM: aea826aaf56ccd0ba92292264a772bbab7b13aaaf9829c055d48f1afc083d8bb cnf-testsuite-v1.3.2.tar.gz
Full Changelog: v1.3.1...v1.3.2
Contributors
martin-mat, kosstennbl, and 3 other contributors
Assets 3
v1.3.1 July 16, 2024
Release Notes for v1.3.1 (Thursday, July 18, 2024)
Changes since v1.3.0 (June 27, 2024)
🙌 Kudos
We appreciate everyone who helped with Release v1.3.1! 🎉
Special thanks to contributors:
@kosstennbl
@svteb
@martin-mat
Please submit a PR to add your name to the CONTRIBUTORS.md.
✨ Enhancements
- #2096 #2093 - Hardcoded-ip-test: Redesign test, add more info on fail
- #2102 #2098 - Add possibility to change node drain duration to prevent the test from failing due to timeout
🐛 Bug Fixes
🔧 Maintenance
- #2055 #1926 - Cluster setup exception message shortened
- #2097 #2072 #2087 - Rework k8s_tshark functionality to make 5G tests stable
📖 Documentation
- #2089 - Add linter for the documentation
- #2082 #2077 - Relocate alpha_k8s_apis to configuration sections across docs
Artifact info:
- Commit: v1.3.1
- SHA256SUM: 3934bc00a48f124831bf91cc277def0d18b2077b89422a0e5a4e4238aaf75fa3 cnf-testsuite-v1.3.1.tar.gz
Full Changelog: v1.3.0...v1.3.1
Contributors
martin-mat, kosstennbl, and svteb
Assets 3
v1.3.0 June 27, 2024
Release Notes for v1.3.0 (Thursday, June 27, 2024)
Changes since v1.2.0 (May 9, 2024)
🙌 Kudos
We appreciate everyone who helped with Release v1.3.0! 🎉
Special thanks to contributors:
@denverwilliams
@horecoli
@kosstennbl
@taylor
@svteb
@lixuna
@martin-mat
@barmull
@collivier
Please submit a PR to add your name to the CONTRIBUTORS.md.
✨ Enhancements
- #1995 #1964 - add checks for KUBECONFIG and cluster health
- #2045 - add ERROR result state for tests when an unexpected error occurs
- #2008 #2000 - Add possibility to direct logs into a file
🐛 Bug Fixes
- #2086 - Bump k8s_netstat to fix database timeouts
- #2078 - shared_database2 spec test has inconsistent results in actions
- #2062 #2085 - Label filtering on StatefulSets is bringing additional pods into the test
- #2034 #2025 - Routed logs test now correctly checks if CNF is being tailed
- #2016 - Outdated helm repo path in fluentd bitnami install
- #2048 #2051 - Test exclusion during certification no longer working (note a changed CLI format for this)
- #2054 #2038 - Add exclusion of init system from single process check
- #2030 #2040 - The single process type check is skipped if CNF is deployed in a non-default namespace
- #2015 - cni_compatible test failing due to outdated Cilium
- #2033 #2022 #2024 - Node drain test not starting due to unable to get chaos resources
- #2019 #2020 - Fix bug with Litmus Pod Mem Test
🔧 Maintenance
- #2028 #2027- remove duplicate test "volume_hostpath_not_found"
- #2066 #2080 - Enable github actions to be (successfully) run for PRs created from forked repos
- #2079 - Update registry mirror to UNH infrastructure
- #2013 - Move off CNCF Equinix Resources
- #2023 #335 - Redesign and unify timeouts
- #2067 #2064 - Don't fail on delete cluster in github actions
- #2037 #2044 - Cilium version update
- #2018 #2017 - Add removal of pvc in the end of spec test
📖 Documentation
- #1955 - Unification of documentation
- #2069 - Remove deprecated capacity tests in docs
- #2057 #2058 #2043 - Rename MAINTAINERS.md to CONTRIBUTORS.md, updates of CONTRIBUTION_LADDER.md and README.md
Artifact info:
- Commit: v1.3.0
- SHA256SUM: 86f42d796d650cc416d7d32d73d692c680ffa086ab15ec2d3863b0e804032168 cnf-testsuite-v1.3.0.tar.gz
Full Changelog: v1.2.0...v1.3.0
Contributors
taylor, collivier, and 7 other contributors
Assets 3
main-2024-05-21-003415-b33fa3b0 May 21, 2024
UPDATES
Issues addressed in this release:
- #2044 - PR test of #2037 cilium update
- #2037 - Update: Cilium version update
- #2015 - [BUG] cni_compatible test failing due to outdated Cilium
Artifact info:
- Commit: main-2024-05-21-003415-b33fa3b0
- SHA256SUM: 7dd8911758220967d935157f6dc9e2493390a99fcefd4cc6b8344da84957d6df cnf-testsuite-main-2024-05-21-003415-b33fa3b0.tar.gz
main-2024-05-20-171857-56256e7c May 20, 2024
UPDATES
Issues addressed in this release:
Artifact info:
- Commit: main-2024-05-20-171857-56256e7c
- SHA256SUM: 0f03394de5534f5c2aec3df59581e898424afbf21331c849eb4ab9e67a90d88a cnf-testsuite-main-2024-05-20-171857-56256e7c.tar.gz