Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

🧑‍🌾 test_cli_remapping flaky test #511

Open
Crola1702 opened this issue Jan 19, 2023 · 0 comments
Open

🧑‍🌾 test_cli_remapping flaky test #511

Crola1702 opened this issue Jan 19, 2023 · 0 comments

Comments

@Crola1702
Copy link

Crola1702 commented Jan 19, 2023

Bug report

Required Info:

  • Operating System:
    • Windows (and sometimes Ubuntu 20.04)
  • Installation type:
    • Source
  • Version or commit hash:
    • Rolling / Foxy

Steps to reproduce issue

  • Run a build in nightly windows or nightly repeated jobs
  • See test_cli_remapping fail if you're lucky

Expected behavior

  • test_cli_remapping should pass

Actual behavior

  • test_cli_remapping is failing sometimes

Additional information

Log output:
Although most of the tests have different names, the log output is very similar in all of them:

Traceback (most recent call last):
  File "C:\ci\ws\src\ros2\system_tests\test_cli_remapping\test\test_cli_remapping.py", line 149, in test_topic_and_service_replacement
    self.assertIn(topic_and_service_replacement, self.get_topics())
AssertionError: '/remapped/ts5907_00_20_08' not found in ['/fully/qualified/name', '/ns/s5749_00_20_08/original_node_name/private/name', '/ns/s5749_00_20_08/relative/name', '/original/namespace/node_6563_00_20_08/private/name', '/original/namespace/original_node_name/private/name', '/original/namespace/relative/name', '/parameter_events', '/remapped/t1668_00_20_08', '/rosout']

Reference builds:

Buildfarmer stats

Flakiness ratio in the last 30 days:

  • Job: Fci__nightly-connext_ubuntu_focal_amd64
    • Last 30 builds: 3 builds failed, 10% with error
    • Last 7 builds: 1 builds failed, 14.28% with error
  • Job: nightly_win_rel
    • Last 30 builds: 5 builds failed, 16.66% with error
    • Last 7 builds: 1 builds failed, 14.28% with error
  • Job: nightly_win_rep
    • Last 30 builds: 10 builds failed, 33.33% with error
    • Last 7 builds: 3 builds failed, 42.85% with error

This test has failed on the following jobs:

Job Last time it happened First time it happened
nightly_win_rep 2023-01-16 2022-01-26
Fci__nightly-connext_ubuntu_focal_amd64 2023-01-14 2021-06-05
nightly_linux-rhel_repeated 2022-12-14 2022-02-05
nightly_linux-aarch64_repeated 2022-11-12 2022-02-01
nightly_linux_repeated 2022-11-12 2022-02-13
nightly_win_deb 2022-10-15 2022-10-15
nightly_win_rel 2022-07-10 2022-03-08

They're mostly Repeated and windows jobs

@Crola1702 Crola1702 changed the title test_cli_remapping flaky test 🧑‍🌾 test_cli_remapping flaky test Jan 31, 2023
@clalancette clalancette moved this to Todo in Jazzy Jalisco Apr 15, 2024
@clalancette clalancette moved this to Todo in Kilted Kaiju May 23, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: Todo
Development

No branches or pull requests

1 participant