Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Buildfarmer log 2024/07/15 - 2024/07/22 #67

Closed
github-actions bot opened this issue Jul 15, 2024 · 15 comments
Closed

Buildfarmer log 2024/07/15 - 2024/07/22 #67

github-actions bot opened this issue Jul 15, 2024 · 15 comments
Labels
buildfarmer-log Log of issues in the buildfarm

Comments

@github-actions
Copy link
Contributor

Previous log #66

@github-actions github-actions bot added the buildfarmer-log Log of issues in the buildfarm label Jul 15, 2024
Copy link
Contributor Author

Jul 15

Build regressions
job_name|build_number|build_datetime|failure_reason|last_section
nightly_linux_coverage|2460|2024-07-15 04:00:56.950000|Early fail|No last section
nightly_linux_humble_coverage|862|2024-07-15 04:01:11.480000|Early fail|No last section
nightly_linux_iron_coverage|496|2024-07-15 04:01:26.326000|Early fail|No last section
nightly_linux_release|3139|2024-07-15 04:02:11.777000|Early fail|No last section
nightly_linux_repeated|3519|2024-07-15 04:02:33.796000|Early fail|No last section
packaging_linux|3504|2024-07-15 04:03:23.237000|Early fail|No last section
nightly_linux-aarch64_repeated|2820|2024-07-15 04:00:01.448000|Jenkins channel closing down (Agent disconnected)|test
nightly_linux-rhel_release|1957|2024-07-15 04:00:01.458000|Early fail|No last section
packaging_linux-rhel|2005|2024-07-15 04:03:35.504000|Early fail|No last section
nightly_win_rep|3416|2024-07-15 04:00:01.480000|Number of failed test exceeds the threshold|test
Test regressions
Excluding 'performance, connext, fastrtps-dynamic' jobs
Issue #1 in nightly_linux-rhel_repeated
- Failing 43.75% in 7 out of 16 builds
	  (also in: "nightly_linux-aarch64_repeated" job)
	  (also in: "nightly_linux-rhel_repeated" job)
	  (also in: "nightly_linux_repeated" job)
	  (also in: "nightly_win_rep" job)
	test_launch_ros.test.test_launch_ros.actions.test_ros_timer.test_timer_uses_sim_time[2-3]
	test_launch_ros.test.test_launch_ros.actions.test_ros_timer.test_timer_uses_sim_time[3-3]

Issue #2 in Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64
- Failing 100.0% in 5 out of 5 builds
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64" job)
	  (also in: "Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64" job)
	  (also in: "Rci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "nightly_linux-rhel_debug" job)
	  (also in: "nightly_linux-rhel_release" job)
	  (also in: "nightly_linux-rhel_repeated" job)
	  (also in: "nightly_linux_repeated" job)
	test_tracetools.test_tracetools.test.test_pub_sub.TestPubSub.test_all

Issue #3 in Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64
- Failing 100.0% in 5 out of 5 builds
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job) (known issue in: https://github.com/ros2/system_tests/issues/496 - CLOSED)
	  (also in: "Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64" job) (known issue in: https://github.com/ros2/system_tests/issues/496 - CLOSED)
	  (also in: "Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64" job) (known issue in: https://github.com/ros2/system_tests/issues/496 - CLOSED)
	  (also in: "nightly_win_rep" job) (known issue in: https://github.com/ros2/system_tests/issues/496 - CLOSED)
	projectroot.test_publisher (known issue in: https://github.com/ros2/system_tests/issues/496 - CLOSED)
	projectroot.test_subscription

Issue #4 in Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64
- Failing 100.0% in 5 out of 5 builds
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64" job)
	  (also in: "Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64" job)
	projectroot.test_pub_sub
	test_tracetools.test_tracetools.test.test_publisher.TestPublisher.test_all
	test_tracetools.test_tracetools.test.test_subscription.TestSubscription.test_all

Issue #5 in nightly_win_deb
- Failing 35.71% in 5 out of 14 builds
	  (also in: "nightly_win_rep" job)
	projectroot.test_tutorial_use_logger_service__rmw_connextdds

Issue #6 in Hci__nightly-connext_ubuntu_jammy_amd64
- Failing 60.0% in 3 out of 5 builds
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "nightly_linux-aarch64_repeated" job)
	test_tf2.BufferClientTestAfterShutdown.test_exit_code

Issue #7 in Hci__nightly-connext_ubuntu_jammy_amd64
- Failing 100.0% in 3 out of 3 builds
	projectroot.test.rclcpp.test_qos_event
	rclcpp.TestQosEvent.test_invalid_on_new_event_callback
	rclcpp.TestQosEvent.test_on_new_event_callback

Issue #8 in Ici__nightly-connext_ubuntu_jammy_amd64
- Failing 100.0% in 3 out of 3 builds
	  (also in: "Hci__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "nightly_linux-aarch64_repeated" job)
	  (also in: "nightly_win_rep" job)
	launch_testing_ros.test.examples.check_node_launch_test.check_node_launch_test

Issue #9 in Ici__nightly-connext_ubuntu_jammy_amd64
- Failing 100.0% in 3 out of 3 builds
	  (also in: "Hci__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)
	launch_testing_examples.launch_testing_examples.set_param_launch_test.launch_testing_examples.set_param_launch_test

Issue #10 in Ici__nightly-connext_ubuntu_jammy_amd64
- Failing 100.0% in 3 out of 3 builds
	  (also in: "Hci__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "nightly_linux-aarch64_debug" job)
	  (also in: "nightly_linux-aarch64_repeated" job)
	  (also in: "nightly_linux-rhel_repeated" job)
	  (also in: "nightly_linux_repeated" job)
	launch_testing_examples.launch_testing_examples.check_node_launch_test.launch_testing_examples.check_node_launch_test

Issue #11 in Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64
- Failing 100.0% in 3 out of 3 builds
	projectroot.test_generic_subscription
	test_tracetools.test_tracetools.test.test_generic_subscription.TestGenericSubscription.test_all

Issue #12 in Jci__nightly-release_ubuntu_noble_amd64
- Failing 100.0% in 3 out of 3 builds
	1 clang-tidy warnings
	1 gcc warnings

Issue #13 in Rci__nightly-connext_ubuntu_noble_amd64
- Failing 100.0% in 3 out of 3 builds
	  (also in: "Jci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "Rci__nightly-connext_ubuntu_noble_amd64" job)
	rclcpp.TestSubscriptionTopicStatisticsFixture.test_receive_stats_for_message_no_header
	rclcpp.TestSubscriptionTopicStatisticsFixture.test_receive_stats_include_window_reset

Issue #14 in Rci__nightly-connext_ubuntu_noble_amd64
- Failing 100.0% in 3 out of 3 builds
	  (also in: "Jci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "Rci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "nightly_win_rep" job)
	projectroot.test.rclcpp.test_subscription_topic_statistics

Issue #15 in gz_transport-ci-gz-transport12-homebrew-amd64
- Failing 60.0% in 3 out of 5 builds
	UNIT_gz_TEST.xml.[failed-to-read]

Issue #16 in Hci__nightly-connext_ubuntu_jammy_amd64
- Failing 40.0% in 2 out of 5 builds
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)
	projectroot.test_buffer_client_tester.launch.py

Issue #17 in Ici__nightly-performance_ubuntu_jammy_amd64
- Failing 100.0% in 2 out of 2 builds
	  (also in: "Hci__nightly-performance_ubuntu_jammy_amd64" job)
	  (also in: "Ici__nightly-performance_ubuntu_jammy_amd64" job)
	4 cmake warnings
	performance_test.lint_cmake.linelength (src/idlgen/opendds/CMakeLists.txt:102)
	performance_test.lint_cmake.linelength (src/idlgen/opendds/CMakeLists.txt:22)
	performance_test.lint_cmake.linelength (src/idlgen/opendds/CMakeLists.txt:23)
	projectroot.lint_cmake

Issue #18 in Jci__nightly-connext_ubuntu_noble_amd64
- Failing 40.0% in 2 out of 5 builds
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "Rci__nightly-connext_ubuntu_noble_amd64" job)
	projectroot.test.rclcpp.test_service_introspection
	rclcpp.TestServiceIntrospection.service_introspection_enable_disable_events

Issue #19 in Rci__benchmark_ubuntu_noble_amd64
- Failing 100.0% in 2 out of 2 builds
	  (also in: "Jci__benchmark_ubuntu_noble_amd64" job)
	projectroot.benchmark_string_conversions

Issue #20 in Rci__nightly-performance_ubuntu_noble_amd64
- Failing 100.0% in 2 out of 2 builds
	  (also in: "Hci__nightly-performance_ubuntu_jammy_amd64" job)
	  (also in: "Ici__nightly-performance_ubuntu_jammy_amd64" job)
	  (also in: "Jci__nightly-performance_ubuntu_noble_amd64" job)
	  (also in: "Rci__nightly-performance_ubuntu_noble_amd64" job)
	projectroot.test.test_performance_CycloneDDS_sync_PointCloud8m

Issue #21 in Rci__nightly-performance_ubuntu_noble_amd64
- Failing 100.0% in 2 out of 2 builds
	  (also in: "Hci__nightly-performance_ubuntu_jammy_amd64" job)
	  (also in: "Ici__nightly-performance_ubuntu_jammy_amd64" job)
	  (also in: "Jci__nightly-performance_ubuntu_noble_amd64" job)
	  (also in: "Rci__nightly-performance_ubuntu_noble_amd64" job)
	projectroot.test.test_performance_CycloneDDS_sync_Array8m

Issue #22 in Rci__nightly-performance_ubuntu_noble_amd64
- Failing 100.0% in 2 out of 2 builds
	  (also in: "Hci__nightly-performance_ubuntu_jammy_amd64" job)
	  (also in: "Ici__nightly-performance_ubuntu_jammy_amd64" job)
	  (also in: "Jci__nightly-performance_ubuntu_noble_amd64" job)
	  (also in: "Rci__nightly-performance_ubuntu_noble_amd64" job)
	buildfarm_perf_tests.PerformanceTestResults.test_results_CycloneDDS

Issue #23 in Rci__nightly-performance_ubuntu_noble_amd64
- Failing 100.0% in 2 out of 2 builds
	  (also in: "Jci__nightly-performance_ubuntu_noble_amd64" job)
	2 cmake warnings

Issue #24 in Rci__nightly-performance_ubuntu_noble_amd64
- Failing 100.0% in 2 out of 2 builds
	  (also in: "Hci__nightly-performance_ubuntu_jammy_amd64" job)
	  (also in: "Ici__nightly-performance_ubuntu_jammy_amd64" job)
	  (also in: "Jci__nightly-performance_ubuntu_noble_amd64" job)
	  (also in: "Rci__nightly-performance_ubuntu_noble_amd64" job)
	2 clang-tidy warnings
	30 gcc warnings
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/resource_manager.hpp:48)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/resource_manager.hpp:49)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/resource_manager.hpp:50)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_callback_communicator.hpp:20)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_callback_communicator.hpp:21)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_communicator.hpp:21)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_communicator.hpp:22)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:20)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:21)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:22)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:23)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/data_running/data_runner_base.hpp:19)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/data_running/data_runner_factory.cpp:19)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/data_running/data_runner_factory.cpp:20)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:18)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:20)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:21)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:22)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:23)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:21)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:22)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:23)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:24)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/external_info_storage.hpp:21)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/external_info_storage.hpp:22)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:15)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:16)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:17)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:18)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:19)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:20)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:21)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:29)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:30)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/utilities/cpu_usage_tracker.hpp:19)
	performance_test.uncrustify.src/communication_abstractions/connext_dds_micro_communicator.hpp
	projectroot.cpplint (known issue in: https://github.com/ros2/rosidl/issues/790 - CLOSED)
	projectroot.uncrustify

Issue #25 in gz_transport-ci-ign-transport11-homebrew-amd64
- Failing 40.0% in 2 out of 5 builds
	ignTest.TopicInfo

Issue #26 in nightly_linux-rhel_repeated
- Failing 12.5% in 2 out of 16 builds
	  (also in: "nightly_win_rel" job)
	rclcpp.TestAddCallbackGroupsToExecutorStable/SingleThreadedExecutor.subscriber_triggered_to_receive_message

Issue #27 in Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64
- Failing 33.33% in 1 out of 3 builds
	  (also in: "Jci__nightly-connext_ubuntu_noble_amd64" job) (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED)
	  (also in: "Rci__nightly-connext_ubuntu_noble_amd64" job) (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED)
	  (also in: "nightly_linux-rhel_debug" job) (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED)
	  (also in: "nightly_linux-rhel_release" job) (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED)
	  (also in: "nightly_linux-rhel_repeated" job) (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED)
	  (also in: "nightly_linux_coverage" job) (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED)
	  (also in: "nightly_linux_debug" job) (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED)
	  (also in: "nightly_linux_release" job) (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED)
	  (also in: "nightly_linux_repeated" job) (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED)
	test_tracetools.test_tracetools.test.test_generic_pub_sub.TestGenericPubSub.test_all (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED)

Issue #28 in Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64
- Failing 33.33% in 1 out of 3 builds
	  (also in: "Jci__nightly-connext_ubuntu_noble_amd64" job) (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED)
	projectroot.test_generic_pub_sub (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED)

Issue #29 in Rci__nightly-connext_ubuntu_noble_amd64
- Failing 20.0% in 1 out of 5 builds
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "Jci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "Rci__nightly-connext_ubuntu_noble_amd64" job)
	rclpy.rclpy.test.test_client.TestClient.test_service_timestamps

Issue #30 in Rci__nightly-connext_ubuntu_noble_amd64
- Failing 20.0% in 1 out of 5 builds
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "Jci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "Rci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "nightly_win_deb" job)
	  (also in: "nightly_win_rep" job)
	projectroot.test_client

Issue #31 in gz_gui-ci-ign-gui6-focal-amd64
- Failing 25.0% in 1 out of 4 builds
	UNIT_Publisher_TEST.test_ran
	UNIT_Screenshot_TEST.test_ran
	UNIT_ShutdownButton_TEST.test_ran

Issue #32 in gz_sensors-ci-main-homebrew-amd64
- Failing 14.29% in 1 out of 7 builds
	DopplerVelocityLogTests/DopplerVelocityLogTest.BottomTrackingWhileInMotion/ogre

Issue #33 in gz_sim-ci-main-homebrew-amd64
- Failing 16.67% in 1 out of 6 builds
	  (also in: "gz_sim-main-win" job)
	INTEGRATION_mesh_inertia_calculation.test_ran

Issue #34 in gz_sim-ci-main-homebrew-amd64
- Failing 16.67% in 1 out of 6 builds
	INTEGRATION_ackermann_steering_system.test_ran (known issue in: https://github.com/gazebosim/gz-sim/issues/2204 - CLOSED)
	INTEGRATION_acoustic_comms.test_ran
	INTEGRATION_battery_plugin.test_ran
	INTEGRATION_breadcrumbs.test_ran (known issue in: https://github.com/gazebosim/gz-sim/issues/2204 - CLOSED)
	INTEGRATION_buoyancy.test_ran
	INTEGRATION_environment_preload_system.test_ran
	INTEGRATION_force_torque_system.test_ran
	INTEGRATION_joint_controller_system.test_ran (known issue in: https://github.com/gazebosim/gz-sim/issues/2204 - CLOSED)
	INTEGRATION_joint_position_controller_system.test_ran
	INTEGRATION_joint_trajectory_controller_system.test_ran
	INTEGRATION_level_manager.test_ran
	INTEGRATION_level_manager_runtime_performers.test_ran
	INTEGRATION_multicopter.test_ran (known issue in: https://github.com/gazebosim/gz-sim/issues/2204 - CLOSED)
	INTEGRATION_physics_system.test_ran (known issue in: https://github.com/gazebosim/gz-sim/issues/2204 - CLOSED)
	INTEGRATION_recreate_entities.test_ran
	INTEGRATION_scene_broadcaster_system.test_ran
	INTEGRATION_sdf_frame_semantics.test_ran
	INTEGRATION_thermal_system.test_ran
	INTEGRATION_thruster.test_ran
	INTEGRATION_touch_plugin.test_ran (known issue in: https://github.com/gazebosim/gz-sim/issues/2204 - CLOSED)
	INTEGRATION_tracked_vehicle_system.test_ran
	INTEGRATION_user_commands.test_ran
	INTEGRATION_wheel_slip.test_ran
	PERFORMANCE_level_manager.test_ran
	UNIT_ModelCommandAPI_TEST.test_ran
	UNIT_Server_TEST.test_ran (known issue in: https://github.com/gazebosim/gz-sim/issues/2282 - CLOSED)
	UNIT_SimulationRunner_TEST.test_ran

Issue #35 in gz_sim-ign-gazebo6-win
- Failing 20.0% in 1 out of 5 builds
	3 msbuild warnings

Issue #36 in nightly_linux-rhel_repeated
- Failing 6.25% in 1 out of 16 builds
	  (also in: "nightly_win_rel" job)
	rclcpp.TestAddCallbackGroupsToExecutorStable/EventsExecutor.subscriber_triggered_to_receive_message

Issue #37 in nightly_linux-rhel_repeated
- Failing 7.69% in 1 out of 13 builds
	  (also in: "nightly_linux_repeated" job)
	  (also in: "nightly_win_rel" job)
	projectroot.test.rclcpp.test_add_callback_groups_to_executor__rmw_connextdds

Issue #38 in sdformat-ci-main-homebrew-amd64
- Failing 20.0% in 1 out of 5 builds
	7 clang warnings

@Crola1702
Copy link
Contributor

Sdformat Main | Warnings | Investigating 🕵️

Reference build: https://build.osrfoundation.org/job/sdformat-ci-main-homebrew-amd64/187/

Warnings:

Makes reference to this file: https://github.com/gazebosim/sdformat/blob/main/src/FrameSemantics.cc.

Should be fixed after: gazebosim/sdformat#1458

Copy link
Contributor Author

Jul 16

Build regressions
job_name|build_number|build_datetime|failure_reason|last_section
nightly_linux_humble_coverage|863|2024-07-16 06:45:59.644000|Number of failed test exceeds the threshold|ccache stats (after)
nightly_win_rep|3417|2024-07-16 04:00:02.003000|Number of failed test exceeds the threshold|test
Rci__nightly-fastrtps-dynamic_ubuntu_noble_amd64|81|2024-07-15 14:16:50.757000|Jenkins channel closing down (Agent disconnected)|build workspace in isolation
Rci__nightly-release_ubuntu_noble_amd64|82|2024-07-15 14:16:50.764000|Jenkins channel closing down (Agent disconnected)|run tests
Test regressions
Excluding 'performance, connext, fastrtps-dynamic' jobs
Issue #1 in nightly_linux-rhel_repeated
- Failing 50.0% in 8 out of 16 builds
	  (also in: "nightly_linux-aarch64_repeated" job)
	  (also in: "nightly_linux-rhel_repeated" job)
	  (also in: "nightly_linux_repeated" job)
	  (also in: "nightly_win_rep" job)
	test_launch_ros.test.test_launch_ros.actions.test_ros_timer.test_timer_uses_sim_time[2-3]
	test_launch_ros.test.test_launch_ros.actions.test_ros_timer.test_timer_uses_sim_time[3-3]

Issue #2 in nightly_linux_iron_coverage
- Failing 42.86% in 6 out of 14 builds
	test_tracetools.test_tracetools.test.test_timer.TestTimer.test_all

Issue #3 in nightly_win_rel
- Failing 42.86% in 6 out of 14 builds
	  (also in: "nightly_linux_iron_coverage" job)
	  (also in: "nightly_win_rel" job)
	  (also in: "nightly_win_rep" job)
	projectroot.test_timer

Issue #4 in Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64
- Failing 100.0% in 5 out of 5 builds
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64" job)
	  (also in: "Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64" job)
	  (also in: "Rci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "nightly_linux-rhel_debug" job)
	  (also in: "nightly_linux-rhel_release" job)
	  (also in: "nightly_linux-rhel_repeated" job)
	  (also in: "nightly_linux_repeated" job)
	test_tracetools.test_tracetools.test.test_pub_sub.TestPubSub.test_all

Issue #5 in Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64
- Failing 100.0% in 5 out of 5 builds
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job) (known issue in: https://github.com/ros2/system_tests/issues/496 - CLOSED)
	  (also in: "Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64" job) (known issue in: https://github.com/ros2/system_tests/issues/496 - CLOSED)
	  (also in: "Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64" job) (known issue in: https://github.com/ros2/system_tests/issues/496 - CLOSED)
	  (also in: "nightly_win_rep" job) (known issue in: https://github.com/ros2/system_tests/issues/496 - CLOSED)
	projectroot.test_publisher (known issue in: https://github.com/ros2/system_tests/issues/496 - CLOSED)

Issue #6 in Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64
- Failing 100.0% in 5 out of 5 builds
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64" job)
	  (also in: "Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64" job)
	projectroot.test_pub_sub
	test_tracetools.test_tracetools.test.test_publisher.TestPublisher.test_all
	test_tracetools.test_tracetools.test.test_subscription.TestSubscription.test_all

Issue #7 in nightly_win_rel
- Failing 100.0% in 5 out of 5 builds
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64" job)
	  (also in: "Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64" job)
	  (also in: "nightly_win_rel" job)
	  (also in: "nightly_win_rep" job)
	projectroot.test_subscription

Issue #8 in gz_transport-ci-gz-transport12-homebrew-amd64
- Failing 66.67% in 4 out of 6 builds
	UNIT_gz_TEST.xml.[failed-to-read]

Issue #9 in Hci__nightly-connext_ubuntu_jammy_amd64
- Failing 60.0% in 3 out of 5 builds
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "nightly_linux-aarch64_repeated" job)
	test_tf2.BufferClientTestAfterShutdown.test_exit_code

Issue #10 in Hci__nightly-connext_ubuntu_jammy_amd64
- Failing 100.0% in 3 out of 3 builds
	projectroot.test.rclcpp.test_qos_event
	rclcpp.TestQosEvent.test_invalid_on_new_event_callback
	rclcpp.TestQosEvent.test_on_new_event_callback

Issue #11 in Ici__nightly-connext_ubuntu_jammy_amd64
- Failing 100.0% in 3 out of 3 builds
	  (also in: "Hci__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)
	launch_testing_examples.launch_testing_examples.set_param_launch_test.launch_testing_examples.set_param_launch_test

Issue #12 in Ici__nightly-connext_ubuntu_jammy_amd64
- Failing 100.0% in 3 out of 3 builds
	  (also in: "Hci__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "nightly_linux-aarch64_debug" job)
	  (also in: "nightly_linux-aarch64_repeated" job)
	  (also in: "nightly_linux-rhel_repeated" job)
	  (also in: "nightly_linux_repeated" job)
	launch_testing_examples.launch_testing_examples.check_node_launch_test.launch_testing_examples.check_node_launch_test

Issue #13 in Ici__nightly-performance_ubuntu_jammy_amd64
- Failing 100.0% in 3 out of 3 builds
	  (also in: "Hci__nightly-performance_ubuntu_jammy_amd64" job)
	  (also in: "Ici__nightly-performance_ubuntu_jammy_amd64" job)
	4 cmake warnings
	performance_test.lint_cmake.linelength (src/idlgen/opendds/CMakeLists.txt:102)
	performance_test.lint_cmake.linelength (src/idlgen/opendds/CMakeLists.txt:22)
	performance_test.lint_cmake.linelength (src/idlgen/opendds/CMakeLists.txt:23)
	projectroot.lint_cmake

Issue #14 in Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64
- Failing 100.0% in 3 out of 3 builds
	projectroot.test_generic_subscription
	test_tracetools.test_tracetools.test.test_generic_subscription.TestGenericSubscription.test_all

Issue #15 in Rci__nightly-connext_ubuntu_noble_amd64
- Failing 100.0% in 3 out of 3 builds
	  (also in: "Jci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "Rci__nightly-connext_ubuntu_noble_amd64" job)
	rclcpp.TestSubscriptionTopicStatisticsFixture.test_receive_stats_for_message_no_header
	rclcpp.TestSubscriptionTopicStatisticsFixture.test_receive_stats_include_window_reset

Issue #16 in Rci__nightly-connext_ubuntu_noble_amd64
- Failing 100.0% in 3 out of 3 builds
	  (also in: "Jci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "Rci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "nightly_win_rep" job)
	projectroot.test.rclcpp.test_subscription_topic_statistics

Issue #17 in Rci__nightly-performance_ubuntu_noble_amd64
- Failing 100.0% in 3 out of 3 builds
	  (also in: "Hci__nightly-performance_ubuntu_jammy_amd64" job)
	  (also in: "Ici__nightly-performance_ubuntu_jammy_amd64" job)
	  (also in: "Jci__nightly-performance_ubuntu_noble_amd64" job)
	  (also in: "Rci__nightly-performance_ubuntu_noble_amd64" job)
	2 clang-tidy warnings
	30 gcc warnings
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/resource_manager.hpp:48)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/resource_manager.hpp:49)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/resource_manager.hpp:50)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_callback_communicator.hpp:20)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_callback_communicator.hpp:21)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_communicator.hpp:21)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_communicator.hpp:22)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:20)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:21)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:22)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:23)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/data_running/data_runner_base.hpp:19)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/data_running/data_runner_factory.cpp:19)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/data_running/data_runner_factory.cpp:20)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:18)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:20)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:21)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:22)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:23)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:21)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:22)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:23)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:24)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/external_info_storage.hpp:21)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/external_info_storage.hpp:22)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:15)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:16)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:17)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:18)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:19)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:20)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:21)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:29)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:30)
	performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/utilities/cpu_usage_tracker.hpp:19)
	performance_test.uncrustify.src/communication_abstractions/connext_dds_micro_communicator.hpp
	projectroot.cpplint (known issue in: https://github.com/ros2/rosidl/issues/790 - CLOSED)
	projectroot.uncrustify

Issue #18 in gz_sim-ci-main-homebrew-amd64
- Failing 42.86% in 3 out of 7 builds
	INTEGRATION_ackermann_steering_system.test_ran (known issue in: https://github.com/gazebosim/gz-sim/issues/2204 - CLOSED)
	INTEGRATION_acoustic_comms.test_ran
	INTEGRATION_battery_plugin.test_ran
	INTEGRATION_breadcrumbs.test_ran (known issue in: https://github.com/gazebosim/gz-sim/issues/2204 - CLOSED)
	INTEGRATION_buoyancy.test_ran
	INTEGRATION_environment_preload_system.test_ran
	INTEGRATION_force_torque_system.test_ran
	INTEGRATION_joint_controller_system.test_ran (known issue in: https://github.com/gazebosim/gz-sim/issues/2204 - CLOSED)
	INTEGRATION_joint_position_controller_system.test_ran
	INTEGRATION_joint_trajectory_controller_system.test_ran
	INTEGRATION_level_manager.test_ran
	INTEGRATION_level_manager_runtime_performers.test_ran
	INTEGRATION_multicopter.test_ran (known issue in: https://github.com/gazebosim/gz-sim/issues/2204 - CLOSED)
	INTEGRATION_physics_system.test_ran (known issue in: https://github.com/gazebosim/gz-sim/issues/2204 - CLOSED)
	INTEGRATION_recreate_entities.test_ran
	INTEGRATION_scene_broadcaster_system.test_ran
	INTEGRATION_sdf_frame_semantics.test_ran
	INTEGRATION_thermal_system.test_ran
	INTEGRATION_thruster.test_ran
	INTEGRATION_touch_plugin.test_ran (known issue in: https://github.com/gazebosim/gz-sim/issues/2204 - CLOSED)
	INTEGRATION_tracked_vehicle_system.test_ran
	INTEGRATION_user_commands.test_ran
	INTEGRATION_wheel_slip.test_ran
	PERFORMANCE_level_manager.test_ran
	UNIT_ModelCommandAPI_TEST.test_ran
	UNIT_Server_TEST.test_ran (known issue in: https://github.com/gazebosim/gz-sim/issues/2282 - CLOSED)
	UNIT_SimulationRunner_TEST.test_ran

Issue #19 in gz_transport-ci-ign-transport11-homebrew-amd64
- Failing 60.0% in 3 out of 5 builds
	ignTest.TopicInfo

Issue #20 in nightly_linux-aarch64_repeated
- Failing 18.75% in 3 out of 16 builds
	projectroot.test_transport_py
	rosbag2_py.test_transport_py.xunit.missing_result

Issue #21 in nightly_linux-aarch64_repeated
- Failing 100.0% in 3 out of 3 builds
	  (also in: "Hci__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "nightly_linux-aarch64_repeated" job)
	  (also in: "nightly_win_rep" job)
	launch_testing_ros.test.examples.check_node_launch_test.check_node_launch_test

Issue #22 in nightly_linux_release
- Failing 100.0% in 3 out of 3 builds
	  (also in: "Jci__nightly-release_ubuntu_noble_amd64" job)
	  (also in: "Rci__nightly-release_ubuntu_noble_amd64" job)
	  (also in: "nightly_linux-aarch64_release" job)
	  (also in: "nightly_linux_release" job)
	1 clang-tidy warnings
	1 gcc warnings

Issue #23 in Hci__nightly-connext_ubuntu_jammy_amd64
- Failing 40.0% in 2 out of 5 builds
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)
	projectroot.test_buffer_client_tester.launch.py

Issue #24 in Rci__benchmark_ubuntu_noble_amd64
- Failing 100.0% in 2 out of 2 builds
	  (also in: "Jci__benchmark_ubuntu_noble_amd64" job)
	projectroot.benchmark_string_conversions

Issue #25 in Rci__nightly-connext_ubuntu_noble_amd64
- Failing 66.67% in 2 out of 3 builds
	  (also in: "Jci__nightly-connext_ubuntu_noble_amd64" job)
	rclcpp.TestServiceIntrospection.service_introspection_enable_disable_event_content

Issue #26 in Rci__nightly-connext_ubuntu_noble_amd64
- Failing 40.0% in 2 out of 5 builds
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "Jci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "Rci__nightly-connext_ubuntu_noble_amd64" job)
	projectroot.test.rclcpp.test_service_introspection
	rclcpp.TestServiceIntrospection.service_introspection_enable_disable_events

Issue #27 in Rci__nightly-performance_ubuntu_noble_amd64
- Failing 66.67% in 2 out of 3 builds
	  (also in: "Hci__nightly-performance_ubuntu_jammy_amd64" job)
	  (also in: "Ici__nightly-performance_ubuntu_jammy_amd64" job)
	  (also in: "Jci__nightly-performance_ubuntu_noble_amd64" job)
	  (also in: "Rci__nightly-performance_ubuntu_noble_amd64" job)
	projectroot.test.test_performance_CycloneDDS_sync_Array8m

Issue #28 in Rci__nightly-performance_ubuntu_noble_amd64
- Failing 66.67% in 2 out of 3 builds
	  (also in: "Hci__nightly-performance_ubuntu_jammy_amd64" job)
	  (also in: "Ici__nightly-performance_ubuntu_jammy_amd64" job)
	  (also in: "Jci__nightly-performance_ubuntu_noble_amd64" job)
	  (also in: "Rci__nightly-performance_ubuntu_noble_amd64" job)
	buildfarm_perf_tests.PerformanceTestResults.test_results_CycloneDDS
	projectroot.test.test_performance_CycloneDDS_sync_PointCloud8m

Issue #29 in Rci__nightly-performance_ubuntu_noble_amd64
- Failing 100.0% in 2 out of 2 builds
	  (also in: "Jci__nightly-performance_ubuntu_noble_amd64" job)
	2 cmake warnings

Issue #30 in nightly_linux-rhel_repeated
- Failing 12.5% in 2 out of 16 builds
	test_cli_remapping.TestCLIRemapping.test_node_name_replacement[/home/jenkins-agent/workspace/nightly_linux-rhel_repeated/ws/build/test_cli_remapping/name_maker_rclcpp]

Issue #31 in nightly_linux-rhel_repeated
- Failing 12.5% in 2 out of 16 builds
	projectroot.test_record__rmw_fastrtps_cpp
	rosbag2_transport.RecordIntegrationTestFixture.can_record_again_after_stop

Issue #32 in Jci__nightly-connext_ubuntu_noble_amd64
- Failing 20.0% in 1 out of 5 builds
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "Rci__nightly-connext_ubuntu_noble_amd64" job)
	rclpy.rclpy.test.test_client.TestClient.test_service_timestamps

Issue #33 in Jci__nightly-connext_ubuntu_noble_amd64
- Failing 20.0% in 1 out of 5 builds
	  (also in: "Ici__nightly-connext_ubuntu_jammy_amd64" job)
	  (also in: "Rci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "nightly_win_deb" job)
	  (also in: "nightly_win_rep" job)
	projectroot.test_client

Issue #34 in Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64
- Failing 33.33% in 1 out of 3 builds
	  (also in: "Jci__nightly-connext_ubuntu_noble_amd64" job) (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED)
	  (also in: "Rci__nightly-connext_ubuntu_noble_amd64" job) (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED)
	  (also in: "nightly_linux-rhel_debug" job) (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED)
	  (also in: "nightly_linux-rhel_release" job) (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED)
	  (also in: "nightly_linux-rhel_repeated" job) (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED)
	  (also in: "nightly_linux_coverage" job) (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED)
	  (also in: "nightly_linux_repeated" job) (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED)
	test_tracetools.test_tracetools.test.test_generic_pub_sub.TestGenericPubSub.test_all (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED)

Issue #35 in Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64
- Failing 33.33% in 1 out of 3 builds
	  (also in: "Jci__nightly-connext_ubuntu_noble_amd64" job) (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED)
	projectroot.test_generic_pub_sub (known issue in: https://github.com/ros2/ros2_tracing/issues/124 - CLOSED)

Issue #36 in gz_sim-8-win
- Failing 20.0% in 1 out of 5 builds
	ServerRepeat/MultipleServers.TwoServersMixedBlocking/0

Issue #37 in gz_sim-ci-gz-sim7-homebrew-amd64
- Failing 20.0% in 1 out of 5 builds
	ServerRepeat/OdometryPublisherTest.MovementCustomTopic/0

Issue #38 in gz_sim-ci-main-homebrew-amd64
- Failing 20.0% in 1 out of 5 builds
	  (also in: "gz_sim-main-win" job)
	INTEGRATION_mesh_inertia_calculation.test_ran

Issue #39 in gz_sim-ci-main-noble-amd64
- Failing 20.0% in 1 out of 5 builds
	<init>.ResetFixture
	ResetFixture.HandleReset

Issue #40 in nightly_linux-aarch64_repeated
- Failing 6.25% in 1 out of 16 builds
	  (also in: "nightly_linux-rhel_repeated" job)
	  (also in: "nightly_linux_repeated" job)
	projectroot.test_node_name__rmw_fastrtps_cpp
	test_rclcpp.test_node_name__rmw_fastrtps_cpp.xunit.missing_result

Issue #41 in nightly_linux-rhel_repeated
- Failing 6.25% in 1 out of 16 builds
	test_tracetools.test_pub_sub__rmw_connextdds.xunit.missing_result

Issue #42 in nightly_linux-rhel_repeated
- Failing 6.25% in 1 out of 16 builds
	  (also in: "nightly_linux-aarch64_repeated" job)
	  (also in: "nightly_win_rep" job)
	ros2cli.ros2cli.test.test_strategy.test_with_daemon_spawn[1-3]

Issue #43 in nightly_linux-rhel_repeated
- Failing 9.09% in 1 out of 11 builds
	  (also in: "Rci__nightly-connext_ubuntu_noble_amd64" job)
	  (also in: "nightly_linux-rhel_debug" job)
	  (also in: "nightly_linux-rhel_release" job)
	  (also in: "nightly_linux_repeated" job)
	projectroot.test_pub_sub__rmw_connextdds

Issue #44 in nightly_linux-rhel_repeated
- Failing 6.25% in 1 out of 16 builds
	  (also in: "nightly_win_rel" job)
	  (also in: "nightly_win_rep" job)
	projectroot.test_cli_remapping

Issue #45 in nightly_linux_release
- Failing 6.25% in 1 out of 16 builds
	  (also in: "nightly_linux-aarch64_release" job)
	  (also in: "nightly_linux_release" job)
	1 clang warnings

Issue #46 in nightly_win_deb
- Failing 7.69% in 1 out of 13 builds
	projectroot.test.test_timer__rmw_cyclonedds_cpp
	projectroot.test.test_timer__rmw_fastrtps_cpp
	rcl.TestPreInitTimer.test_timer_info
	rcl.TestPreInitTimer.test_timer_info_detect_overrun

Issue #47 in nightly_win_rel
- Failing 7.69% in 1 out of 13 builds
	  (also in: "nightly_win_deb" job)
	  (also in: "nightly_win_rep" job)
	test_rclcpp.test_multithreaded.multi_access_publisher

Issue #48 in nightly_win_rel
- Failing 6.25% in 1 out of 16 builds
	ros2cli.ros2cli.test.test_strategy.test_with_daemon_running

Issue #49 in nightly_win_rel
- Failing 7.69% in 1 out of 13 builds
	  (also in: "nightly_win_rep" job)
	projectroot.test_time_source
	projectroot.test_wait_for_message
	projectroot.test_waitable
	rclpy.test_subscription.xunit.missing_result
	rclpy.test_time_source.xunit.missing_result
	rclpy.test_timer.xunit.missing_result
	rclpy.test_wait_for_message.xunit.missing_result
	rclpy.test_waitable.xunit.missing_result

Issue #50 in nightly_win_rel
- Failing 6.25% in 1 out of 16 builds
	  (also in: "nightly_linux-rhel_repeated" job)
	  (also in: "nightly_win_deb" job)
	  (also in: "nightly_win_rep" job)
	projectroot.gtest_multithreaded__rmw_connextdds

@Crola1702
Copy link
Contributor

Nightly Windows Repeated | Build regression | Investigating 🕵️

Reference build: https://ci.ros2.org/view/nightly/job/nightly_win_rep/3417/

Log output:

Windows fatal exception: access violation
...
unknown file: error: SEH exception with code 0xc0000005 thrown in the test body.

There are three consistent failures in windows repeated by today. The output appears in different parts of the log for all three failures.

@Crola1702
Copy link
Contributor

Crola1702 commented Jul 16, 2024

Linux release nightlies | Warning | Reported 📚

Reference builds:

One warning stl_algobase.h:437 (array-bounds=):

‘void* __builtin_memmove(void*, const void*, long unsigned int)’ forming offset 8 is out of the bounds [0, 8] [-Warray-bounds=] 437 | __builtin_memmove(__result, __first, sizeof(_Tp) * _Num); | ~~~~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Full compilation output:
In file included from ^[[01m^[[K/usr/include/c++/13/bits/specfun.h:43^[[m^[[K,^M                                                                                                              
                 from ^[[01m^[[K/usr/include/c++/13/cmath:3699^[[m^[[K,^M
                 from ^[[01m^[[K/home/jenkins-agent/workspace/nightly_linux_release/ws/build/rviz_assimp_vendor/assimp_vendor-prefix/src/assimp_vendor/include/assimp/vector2.h:53^[[m^[[K,^M
                 from ^[[01m^[[K/home/jenkins-agent/workspace/nightly_linux_release/ws/build/rviz_assimp_vendor/assimp_vendor-prefix/src/assimp_vendor/include/assimp/types.h:64^[[m^[[K,^M
                 from ^[[01m^[[K/home/jenkins-agent/workspace/nightly_linux_release/ws/build/rviz_assimp_vendor/assimp_vendor-prefix/src/assimp_vendor/include/assimp/IOStream.hpp:53^[[m^[[K,
                 from ^[[01m^[[K/home/jenkins-agent/workspace/nightly_linux_release/ws/build/rviz_assimp_vendor/assimp_vendor-prefix/src/assimp_vendor/include/assimp/DefaultIOStream.h:55^[[m
                 from ^[[01m^[[K/home/jenkins-agent/workspace/nightly_linux_release/ws/build/rviz_assimp_vendor/assimp_vendor-prefix/src/assimp_vendor/include/assimp/Exceptional.h:49^[[m^[[K
                 from ^[[01m^[[K/home/jenkins-agent/workspace/nightly_linux_release/ws/build/rviz_assimp_vendor/assimp_vendor-prefix/src/assimp_vendor/include/assimp/BaseImporter.h:52^[[m^[[
                 from ^[[01m^[[K/home/jenkins-agent/workspace/nightly_linux_release/ws/build/rviz_assimp_vendor/assimp_vendor-prefix/src/assimp_vendor/code/AssetLib/MDL/MDLLoader.h:50^[[m^[[
                 from ^[[01m^[[K/home/jenkins-agent/workspace/nightly_linux_release/ws/build/rviz_assimp_vendor/assimp_vendor-prefix/src/assimp_vendor/code/AssetLib/MDL/MDLLoader.cpp:51^[[m^
In static member function ‘^[[01m^[[Kstatic _Up* std::__copy_move<_IsMove, true, std::random_access_iterator_tag>::^[[01;32m^[[K__copy_m^[[m^[[K(_Tp*, _Tp*, _Up*) ^[[35m^[[K[with _Tp = long
    inlined from ‘^[[01m^[[K_OI std::^[[01;32m^[[K__copy_move_a2^[[m^[[K(_II, _II, _OI) ^[[35m^[[K[with bool _IsMove = false; _II = long unsigned int*; _OI = long unsigned int*]^[[m^[[K^[[m^
    inlined from ‘^[[01m^[[K_OI std::^[[01;32m^[[K__copy_move_a1^[[m^[[K(_II, _II, _OI) ^[[35m^[[K[with bool _IsMove = false; _II = long unsigned int*; _OI = long unsigned int*]^[[m^[[K^[[m^
    inlined from ‘^[[01m^[[K_OI std::^[[01;32m^[[K__copy_move_a^[[m^[[K(_II, _II, _OI) ^[[35m^[[K[with bool _IsMove = false; _II = long unsigned int*; _OI = long unsigned int*]^[[m^[[K^[[m^[
    inlined from ‘^[[01m^[[K_OI std::^[[01;32m^[[Kcopy^[[m^[[K(_II, _II, _OI) ^[[35m^[[K[with _II = long unsigned int*; _OI = long unsigned int*]^[[m^[[K^[[m^[[K’ at ^[[01m^[[K/usr/include/c
    inlined from ‘^[[01m^[[Kstd::vector<bool, _Alloc>::iterator std::vector<bool, _Alloc>::^[[01;32m^[[K_M_copy_aligned^[[m^[[K(const_iterator, const_iterator, iterator) ^[[35m^[[K[with _All
    inlined from ‘^[[01m^[[Kvoid std::vector<bool, _Alloc>::^[[01;32m^[[K_M_reallocate^[[m^[[K(size_type) ^[[35m^[[K[with _Alloc = std::allocator<bool>]^[[m^[[K^[[m^[[K’ at ^[[01m^[[K/usr/in
    inlined from ‘^[[01m^[[Kvoid std::vector<bool, _Alloc>::^[[01;32m^[[Kreserve^[[m^[[K(size_type) ^[[35m^[[K[with _Alloc = std::allocator<bool>]^[[m^[[K^[[m^[[K’ at ^[[01m^[[K/usr/include/
    inlined from ‘^[[01m^[[KAssimp::MDL::IntSharedData_MDL7::^[[01;32m^[[KIntSharedData_MDL7^[[m^[[K()^[[m^[[K’ at ^[[01m^[[K/home/jenkins-agent/workspace/nightly_linux_release/ws/build/rviz
    inlined from ‘^[[01m^[[Kvoid Assimp::MDLImporter::^[[01;32m^[[KInternReadFile_3DGS_MDL7^[[m^[[K()^[[m^[[K’ at ^[[01m^[[K/home/jenkins-agent/workspace/nightly_linux_release/ws/build/rviz_
^[[01m^[[K/usr/include/c++/13/bits/stl_algobase.h:437:30:^[[m^[[K ^[[01;35m^[[Kwarning: ^[[m^[[K‘^[[01m^[[Kvoid*^[[01;32m^[[K __builtin_memmove^[[m^[[K(void*, const void*, long unsigned int)
  437 |             ^[[01;35m^[[K__builtin_memmove(__result, __first, sizeof(_Tp) * _Num)^[[m^[[K;^M
      |             ^[[01;35m^[[K~~~~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^[[m^[[K^M

As the full log says, this is happening in rviz/assimp_vendor package

Reported in: ros2/rviz#1240

@scpeters
Copy link
Member

there are 28 test failures on gz-sim9 on macOS / homebrew since build 68. The failures don't occur on gz-sim8 and have been consistently failing. I posted about my debugging attempts in gazebosim/gz-sim#2232 (comment)

@Crola1702
Copy link
Contributor

Gz-sim8-windows | Flaky test regressions | Keeping track 👀

Running it multiple times to check what errors are actually happening

Copy link
Contributor Author

Jul 17

Urgent

Test regressions consecutive

Test regressions

Reference build Age Failure DateTime Errors Reports
Hci__nightly-performance_ubuntu_jammy_amd64#245 235 2024-07-16 06:05:11.472000
39 errors
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/resource_manager.hpp:48)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/resource_manager.hpp:49)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/resource_manager.hpp:50)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_callback_communicator.hpp:20)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_callback_communicator.hpp:21)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_communicator.hpp:21)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_communicator.hpp:22)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:20)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:21)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:22)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:23)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/data_running/data_runner_base.hpp:19)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/data_running/data_runner_factory.cpp:19)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/data_running/data_runner_factory.cpp:20)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:18)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:20)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:21)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:22)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:23)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:21)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:22)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:23)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:24)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/external_info_storage.hpp:21)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/external_info_storage.hpp:22)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:15)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:16)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:17)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:18)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:19)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:20)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:21)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:29)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:30)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/utilities/cpu_usage_tracker.hpp:19)
  • performance_test.lint_cmake.linelength (src/idlgen/opendds/CMakeLists.txt:102)
  • performance_test.lint_cmake.linelength (src/idlgen/opendds/CMakeLists.txt:22)
  • performance_test.lint_cmake.linelength (src/idlgen/opendds/CMakeLists.txt:23)
  • performance_test.uncrustify.src/communication_abstractions/connext_dds_micro_communicator.hpp
No reports found!
Ici__nightly-connext_ubuntu_jammy_amd64#147 147 2024-07-16 16:38:26.438000
  • projectroot.test.rclcpp.test_executors
  • projectroot.test_pub_sub
  • rclcpp.TestClient.client_qos
  • rclcpp.TestIntraprocessExecutors/EventsExecutor.testIntraprocessRetrigger
  • test_tracetools.test_tracetools.test.test_pub_sub.TestPubSub.test_all
  • test_tracetools.test_tracetools.test.test_publisher.TestPublisher.test_all
  • test_tracetools.test_tracetools.test.test_subscription.TestSubscription.test_all
  • https://github.com/ros2/rclcpp/issues/2502 (Closed)
Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64#145 110 2024-07-17 00:16:52.091000
  • projectroot.test_pub_sub
  • test_tracetools.test_tracetools.test.test_pub_sub.TestPubSub.test_all
  • test_tracetools.test_tracetools.test.test_publisher.TestPublisher.test_all
  • test_tracetools.test_tracetools.test.test_subscription.TestSubscription.test_all
No reports found!
Ici__nightly-performance_ubuntu_jammy_amd64#109 108 2024-07-17 04:43:17.848000
39 errors
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/resource_manager.hpp:48)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/resource_manager.hpp:49)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/resource_manager.hpp:50)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_callback_communicator.hpp:20)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_callback_communicator.hpp:21)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_communicator.hpp:21)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_communicator.hpp:22)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:20)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:21)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:22)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:23)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/data_running/data_runner_base.hpp:19)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/data_running/data_runner_factory.cpp:19)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/data_running/data_runner_factory.cpp:20)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:18)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:20)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:21)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:22)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:23)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:21)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:22)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:23)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:24)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/external_info_storage.hpp:21)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/external_info_storage.hpp:22)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:15)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:16)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:17)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:18)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:19)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:20)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:21)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:29)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:30)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/utilities/cpu_usage_tracker.hpp:19)
  • performance_test.lint_cmake.linelength (src/idlgen/opendds/CMakeLists.txt:102)
  • performance_test.lint_cmake.linelength (src/idlgen/opendds/CMakeLists.txt:22)
  • performance_test.lint_cmake.linelength (src/idlgen/opendds/CMakeLists.txt:23)
  • performance_test.uncrustify.src/communication_abstractions/connext_dds_micro_communicator.hpp
No reports found!
Rci__nightly-connext_ubuntu_noble_amd64#88 88 2024-07-16 07:20:43.334000
  • projectroot.test.rclcpp.test_subscription_topic_statistics
  • rclcpp.TestSubscriptionTopicStatisticsFixture.test_receive_stats_for_message_no_header
  • rclcpp.TestSubscriptionTopicStatisticsFixture.test_receive_stats_include_window_reset
No reports found!
Rci__benchmark_ubuntu_noble_amd64#53 53 2024-07-16 16:57:22.673000
  • projectroot.benchmark_string_conversions
  • projectroot.benchmark_string_conversions
No reports found!
Ici__nightly-connext_ubuntu_jammy_amd64#147 48 2024-07-16 16:38:26.438000
  • launch_testing_ros.test.examples.check_node_launch_test.check_node_launch_test
No reports found!
gz_rendering-8-win#70 42 2024-07-17 01:06:14.271000
  • MeshTest.NormalMapWithoutTexCoord
No reports found!
gz_rendering-7-win#63 35 2024-07-17 00:06:12.601000
  • MeshTest.NormalMapWithoutTexCoord
No reports found!
gz_rendering-main-win#62 33 2024-07-17 02:06:14.849000
  • MeshTest.NormalMapWithoutTexCoord
No reports found!
Jci__nightly-connext_ubuntu_noble_amd64#33 33 2024-07-17 06:15:00.217000
  • projectroot.test.rclcpp.test_subscription_topic_statistics
  • rclcpp.TestSubscriptionTopicStatisticsFixture.test_receive_stats_for_message_no_header
  • rclcpp.TestSubscriptionTopicStatisticsFixture.test_receive_stats_include_window_reset
No reports found!
Rci__nightly-performance_ubuntu_noble_amd64#56 31 2024-07-16 18:09:22.800000
36 errors
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/resource_manager.hpp:48)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/resource_manager.hpp:49)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/resource_manager.hpp:50)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_callback_communicator.hpp:20)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_callback_communicator.hpp:21)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_communicator.hpp:21)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_communicator.hpp:22)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:20)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:21)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:22)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:23)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/data_running/data_runner_base.hpp:19)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/data_running/data_runner_factory.cpp:19)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/data_running/data_runner_factory.cpp:20)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:18)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:20)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:21)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:22)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:23)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:21)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:22)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:23)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:24)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/external_info_storage.hpp:21)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/external_info_storage.hpp:22)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:15)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:16)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:17)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:18)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:19)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:20)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:21)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:29)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:30)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/utilities/cpu_usage_tracker.hpp:19)
  • performance_test.uncrustify.src/communication_abstractions/connext_dds_micro_communicator.hpp
No reports found!
Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64#31 31 2024-07-14 10:28:24.694000
  • projectroot.test_generic_pub_sub
  • projectroot.test_generic_subscription
  • projectroot.test_pub_sub
  • test_tracetools.test_tracetools.test.test_generic_pub_sub.TestGenericPubSub.test_all
  • test_tracetools.test_tracetools.test.test_generic_subscription.TestGenericSubscription.test_all
  • test_tracetools.test_tracetools.test.test_pub_sub.TestPubSub.test_all
  • test_tracetools.test_tracetools.test.test_publisher.TestPublisher.test_all
  • test_tracetools.test_tracetools.test.test_subscription.TestSubscription.test_all
  • https://github.com/ros2/ros2_tracing/issues/124 (Closed)
Hci__nightly-connext_ubuntu_jammy_amd64#254 23 2024-07-15 06:15:01.077000
  • launch_testing_examples.launch_testing_examples.check_node_launch_test.launch_testing_examples.check_node_launch_test
  • launch_testing_examples.launch_testing_examples.set_param_launch_test.launch_testing_examples.set_param_launch_test
No reports found!
nightly_linux-aarch64_repeated#2823 11 2024-07-17 04:00:01.178000
  • test_launch_ros.test.test_launch_ros.actions.test_ros_timer.test_timer_uses_sim_time[2-3]
  • test_launch_ros.test.test_launch_ros.actions.test_ros_timer.test_timer_uses_sim_time[3-3]
No reports found!
nightly_linux-rhel_repeated#1967 9 2024-07-17 04:00:01.198000
  • test_launch_ros.test.test_launch_ros.actions.test_ros_timer.test_timer_uses_sim_time[2-3]
  • test_launch_ros.test.test_launch_ros.actions.test_ros_timer.test_timer_uses_sim_time[3-3]
No reports found!
nightly_linux_repeated#3520 8 2024-07-16 08:27:07.033000
  • test_launch_ros.test.test_launch_ros.actions.test_ros_timer.test_timer_uses_sim_time[2-3]
  • test_launch_ros.test.test_launch_ros.actions.test_ros_timer.test_timer_uses_sim_time[3-3]
No reports found!
Hci__nightly-connext_ubuntu_jammy_amd64#254 8 2024-07-15 06:15:01.077000
  • launch_testing_ros.test.examples.check_node_launch_test.check_node_launch_test
No reports found!
Ici__nightly-performance_ubuntu_jammy_amd64#109 7 2024-07-17 04:43:17.848000
  • projectroot.cpplint
  • projectroot.lint_cmake
  • projectroot.uncrustify
  • https://github.com/ros2/rosidl/issues/790 (Closed)
nightly_win_rep#3418 5 2024-07-17 04:00:01.218000
  • projectroot.gtest_multithreaded__rmw_connextdds
  • test_rclcpp.gtest_multithreaded__rmw_connextdds.gtest.missing_result
No reports found!
gz_sim-ci-main-homebrew-amd64#71 4 2024-07-16 17:28:58.697000
28 errors
  • INTEGRATION_ackermann_steering_system.test_ran
  • INTEGRATION_acoustic_comms.test_ran
  • INTEGRATION_battery_plugin.test_ran
  • INTEGRATION_breadcrumbs.test_ran
  • INTEGRATION_buoyancy.test_ran
  • INTEGRATION_environment_preload_system.test_ran
  • INTEGRATION_force_torque_system.test_ran
  • INTEGRATION_joint_controller_system.test_ran
  • INTEGRATION_joint_position_controller_system.test_ran
  • INTEGRATION_joint_trajectory_controller_system.test_ran
  • INTEGRATION_level_manager.test_ran
  • INTEGRATION_level_manager_runtime_performers.test_ran
  • INTEGRATION_mesh_inertia_calculation.test_ran
  • INTEGRATION_multicopter.test_ran
  • INTEGRATION_physics_system.test_ran
  • INTEGRATION_recreate_entities.test_ran
  • INTEGRATION_scene_broadcaster_system.test_ran
  • INTEGRATION_sdf_frame_semantics.test_ran
  • INTEGRATION_thermal_system.test_ran
  • INTEGRATION_thruster.test_ran
  • INTEGRATION_touch_plugin.test_ran
  • INTEGRATION_tracked_vehicle_system.test_ran
  • INTEGRATION_user_commands.test_ran
  • INTEGRATION_wheel_slip.test_ran
  • PERFORMANCE_level_manager.test_ran
  • UNIT_ModelCommandAPI_TEST.test_ran
  • UNIT_Server_TEST.test_ran
  • UNIT_SimulationRunner_TEST.test_ran
  • https://github.com/gazebosim/gz-sim/issues/2204 (Closed)
  • https://github.com/gazebosim/gz-sim/issues/2282 (Closed)
Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64#145 4 2024-07-17 00:16:52.091000
  • projectroot.test_publisher
  • projectroot.test_subscription
  • https://github.com/ros2/system_tests/issues/496 (Closed)
Hci__nightly-performance_ubuntu_jammy_amd64#245 4 2024-07-16 06:05:11.472000
  • projectroot.cpplint
  • projectroot.lint_cmake
  • projectroot.uncrustify
  • https://github.com/ros2/rosidl/issues/790 (Closed)
Ici__nightly-connext_ubuntu_jammy_amd64#147 3 2024-07-16 16:38:26.438000
  • launch_testing_examples.launch_testing_examples.check_node_launch_test.launch_testing_examples.check_node_launch_test
  • launch_testing_examples.launch_testing_examples.set_param_launch_test.launch_testing_examples.set_param_launch_test
No reports found!

Warnings

Reference build Age Failure DateTime Errors Reports
nightly_linux_release#3141 -1 2024-07-17 07:25:42.353000
  • 1 clang warnings
  • 1 clang-tidy warnings
  • 1 gcc warnings
No reports found!
nightly_linux-aarch64_release#2796 -1 2024-07-17 04:00:01.174000
  • 1 clang warnings
  • 1 clang-tidy warnings
  • 1 gcc warnings
No reports found!
gz_rendering-main-win#62 -1 2024-07-17 02:06:14.849000
  • 2 msbuild warnings
No reports found!
gz_rendering-8-win#70 -1 2024-07-17 01:06:14.271000
  • 2 msbuild warnings
No reports found!
gz_rendering-7-win#63 -1 2024-07-17 00:06:12.601000
  • 2 msbuild warnings
No reports found!
Rci__nightly-release_ubuntu_noble_amd64#84 -1 2024-07-16 15:51:42.651000
  • 1 clang-tidy warnings
  • 1 gcc warnings
No reports found!
Rci__nightly-performance_ubuntu_noble_amd64#56 -1 2024-07-16 18:09:22.800000
  • 2 clang-tidy warnings
  • 2 cmake warnings
  • 30 gcc warnings
No reports found!
Jci__nightly-release_ubuntu_noble_amd64#32 -1 2024-07-14 14:17:53.230000
  • 1 clang-tidy warnings
  • 1 gcc warnings
No reports found!
Ici__nightly-performance_ubuntu_jammy_amd64#109 -1 2024-07-17 04:43:17.848000
  • 2 clang-tidy warnings
  • 30 gcc warnings
  • 4 cmake warnings
No reports found!
Hci__nightly-performance_ubuntu_jammy_amd64#245 -1 2024-07-16 06:05:11.472000
  • 2 clang-tidy warnings
  • 30 gcc warnings
  • 4 cmake warnings
No reports found!

Test regressions flaky

Test regressions

Reference builds Errors Flaky report Reports
  • projectroot.test_subscription
  • projectroot.test_subscription
  • projectroot.test_subscription
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd642024-07-172024-07-0555100.0%
Ici__nightly-connext_ubuntu_jammy_amd642024-07-162024-07-0455100.0%
Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd642024-07-142024-07-0233100.0%
nightly_win_rep2024-07-172024-07-1013215.38%
nightly_win_rel2024-07-162024-07-161616.25%
No reports found!
  • launch_testing_examples.launch_testing_examples.check_node_launch_test.launch_testing_examples.check_node_launch_test
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
Hci__nightly-connext_ubuntu_jammy_amd642024-07-152024-07-1133100.0%
Ici__nightly-connext_ubuntu_jammy_amd642024-07-162024-07-045480.0%
nightly_linux-aarch64_repeated2024-07-112024-07-0916318.75%
nightly_linux_repeated2024-07-162024-07-0212216.67%
nightly_linux-rhel_repeated2024-07-142024-07-141616.25%
nightly_linux-aarch64_debug2024-07-042024-07-041616.25%
No reports found!
  • launch_testing_ros.test.examples.check_node_launch_test.check_node_launch_test
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
Ici__nightly-connext_ubuntu_jammy_amd642024-07-162024-07-0455100.0%
Hci__nightly-connext_ubuntu_jammy_amd642024-07-152024-07-1133100.0%
nightly_linux-aarch64_repeated2024-07-172024-07-0416531.25%
nightly_win_rep2024-07-102024-07-101317.69%
No reports found!
  • projectroot.cpplint
  • projectroot.uncrustify
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
Ici__nightly-performance_ubuntu_jammy_amd642024-07-172024-07-0955100.0%
Rci__nightly-performance_ubuntu_noble_amd642024-07-162024-07-0355100.0%
Hci__nightly-performance_ubuntu_jammy_amd642024-07-162024-07-1233100.0%
Jci__nightly-performance_ubuntu_noble_amd642024-07-062024-07-0322100.0%
  • https://github.com/ros2/rosidl/issues/790 (Closed)
  • projectroot.test_publisher
  • projectroot.test_publisher
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd642024-07-172024-07-0555100.0%
Ici__nightly-connext_ubuntu_jammy_amd642024-07-162024-07-0455100.0%
Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd642024-07-142024-07-0233100.0%
nightly_win_rep2024-07-102024-07-101317.69%
  • https://github.com/ros2/system_tests/issues/496 (Closed)
  • projectroot.test_generic_pub_sub
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd642024-07-142024-07-0233100.0%
Jci__nightly-connext_ubuntu_noble_amd642024-07-172024-07-024250.0%
  • https://github.com/ros2/ros2_tracing/issues/124 (Closed)
  • test_tracetools.test_tracetools.test.test_generic_pub_sub.TestGenericPubSub.test_all
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd642024-07-142024-07-0233100.0%
Jci__nightly-connext_ubuntu_noble_amd642024-07-172024-07-024250.0%
nightly_linux-rhel_repeated2024-07-042024-07-0216318.75%
Rci__nightly-connext_ubuntu_noble_amd642024-07-042024-07-0211218.18%
nightly_linux_repeated2024-07-042024-07-0312216.67%
nightly_linux-rhel_release2024-07-042024-07-0215213.33%
nightly_linux_coverage2024-07-032024-07-031516.67%
nightly_linux-rhel_debug2024-07-032024-07-031516.67%
  • https://github.com/ros2/ros2_tracing/issues/124 (Closed)
  • buildfarm_perf_tests.PerformanceTestResults.test_results_CycloneDDS
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
Ici__nightly-performance_ubuntu_jammy_amd642024-07-172024-07-095480.0%
Rci__nightly-performance_ubuntu_noble_amd642024-07-162024-07-035480.0%
Hci__nightly-performance_ubuntu_jammy_amd642024-07-132024-07-123266.67%
Jci__nightly-performance_ubuntu_noble_amd642024-07-032024-07-032150.0%
No reports found!
  • projectroot.test.test_performance_CycloneDDS_sync_Array8m
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
Rci__nightly-performance_ubuntu_noble_amd642024-07-162024-07-035480.0%
Hci__nightly-performance_ubuntu_jammy_amd642024-07-132024-07-123266.67%
Ici__nightly-performance_ubuntu_jammy_amd642024-07-172024-07-115360.0%
Jci__nightly-performance_ubuntu_noble_amd642024-07-032024-07-032150.0%
No reports found!
  • projectroot.gtest_multithreaded__rmw_connextdds
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
nightly_win_rep2024-07-172024-07-03131076.92%
nightly_win_deb2024-07-172024-07-0414642.86%
nightly_win_rel2024-07-162024-07-0616212.5%
nightly_linux-rhel_repeated2024-07-032024-07-031616.25%
No reports found!
  • projectroot.test.rclcpp.test_service_introspection
  • projectroot.test.rclcpp.test_service_introspection
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
Jci__nightly-connext_ubuntu_noble_amd642024-07-142024-07-024375.0%
Rci__nightly-connext_ubuntu_noble_amd642024-07-162024-07-0211654.55%
Ici__nightly-connext_ubuntu_jammy_amd642024-07-162024-07-095240.0%
No reports found!
  • rclcpp.TestServiceIntrospection.service_introspection_enable_disable_events
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
Jci__nightly-connext_ubuntu_noble_amd642024-07-142024-07-024375.0%
Rci__nightly-connext_ubuntu_noble_amd642024-07-152024-07-0211545.45%
Ici__nightly-connext_ubuntu_jammy_amd642024-07-162024-07-095240.0%
No reports found!
  • ros2topic.ros2topic.test.test_use_sim_time.test_use_sim_time
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
nightly_linux_coverage2024-07-172024-07-02151066.67%
nightly_linux_debug2024-07-132024-07-131417.14%
  • https://github.com/ros2/ros2cli/issues/772 (Closed)
  • ros2cli.ros2cli.test.test_strategy.test_with_daemon_spawn[1-3]
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
nightly_linux-rhel_repeated2024-07-172024-07-03161062.5%
nightly_win_rep2024-07-092024-07-091317.69%
nightly_linux-aarch64_repeated2024-07-072024-07-071616.25%
No reports found!
  • projectroot.test_n_nodes__rmw_fastrtps_cpp
  • test_rclcpp.TestNNodesAfterShutdown.test_10_nodes
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
nightly_win_rep2024-07-172024-07-0213861.54%
No reports found!
  • test_rclcpp.gtest_multithreaded__rmw_connextdds.gtest.missing_result
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
nightly_win_rep2024-07-172024-07-0313861.54%
nightly_win_deb2024-07-172024-07-0514535.71%
nightly_win_rel2024-07-062024-07-061616.25%
nightly_linux-rhel_repeated2024-07-032024-07-031616.25%
No reports found!
  • test_launch_ros.test.test_launch_ros.actions.test_ros_timer.test_timer_uses_sim_time[2-3]
  • test_launch_ros.test.test_launch_ros.actions.test_ros_timer.test_timer_uses_sim_time[3-3]
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
nightly_linux-rhel_repeated2024-07-172024-07-0916956.25%
nightly_linux-aarch64_repeated2024-07-172024-07-0916956.25%
nightly_win_rep2024-07-172024-07-0913646.15%
nightly_linux_repeated2024-07-162024-07-0912541.67%
No reports found!
  • rclcpp.TestServiceIntrospection.service_introspection_enable_disable_event_content
  • rclcpp.TestServiceIntrospection.service_introspection_enable_disable_event_content
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
Rci__nightly-connext_ubuntu_noble_amd642024-07-162024-07-0211654.55%
Jci__nightly-connext_ubuntu_noble_amd642024-07-052024-07-024250.0%
Ici__nightly-connext_ubuntu_jammy_amd642024-07-162024-07-165120.0%
No reports found!
  • INTEGRATION_mesh_inertia_calculation.test_ran
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
gz_sim-ci-main-homebrew-amd642024-07-162024-07-158450.0%
gz_sim-8-win2024-07-172024-07-167228.57%
gz_sim-main-win2024-07-112024-07-116116.67%
No reports found!
  • test_rclcpp.test_timeout_subscriber.timeout_subscriber
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
nightly_win_rep2024-07-172024-07-0513538.46%
No reports found!
  • projectroot.test_timer
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
nightly_linux_iron_coverage2024-07-162024-07-0314535.71%
nightly_win_rep2024-07-172024-07-0313323.08%
nightly_win_rel2024-07-162024-07-161616.25%
No reports found!
  • projectroot.test_generic_pub_sub__rmw_connextdds
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
nightly_linux-rhel_repeated2024-07-122024-07-0216531.25%
nightly_linux_repeated2024-07-162024-07-0312325.0%
Rci__nightly-connext_ubuntu_noble_amd642024-07-042024-07-0211218.18%
nightly_linux-rhel_release2024-07-042024-07-0215213.33%
nightly_linux_coverage2024-07-032024-07-031516.67%
nightly_linux-rhel_debug2024-07-032024-07-031516.67%
  • https://github.com/ros2/ros2_tracing/issues/124 (Closed)
  • demo_nodes_cpp.TestExecutablesTutorialAfterShutdown.test_last_process_exit_code
  • demo_nodes_cpp.TestExecutablesTutorialAfterShutdown.test_last_process_exit_code
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
nightly_win_rep2024-07-172024-07-0413430.77%
No reports found!
  • projectroot.gtest_timeout_subscriber__rmw_fastrtps_cpp
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
nightly_win_rep2024-07-172024-07-0513430.77%
No reports found!
  • projectroot.test.rclcpp.test_executor
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
nightly_win_rep2024-07-172024-07-0413430.77%
nightly_win_deb2024-07-062024-07-061417.14%
  • https://github.com/ros2/rclcpp/issues/2502 (Closed)
  • projectroot.test_server
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
nightly_win_rep2024-07-172024-07-0513430.77%
nightly_win_deb2024-07-032024-07-031417.14%
No reports found!
  • projectroot.tf2_ros_test_message_filter
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
Rci__nightly-connext_ubuntu_noble_amd642024-07-122024-07-0511327.27%
Jci__nightly-connext_ubuntu_noble_amd642024-07-172024-07-174125.0%
nightly_win_deb2024-07-032024-07-031417.14%
No reports found!
  • tf2_ros.tf2_ros_test_message_filter.gtest.missing_result
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
Rci__nightly-connext_ubuntu_noble_amd642024-07-122024-07-0511327.27%
Jci__nightly-connext_ubuntu_noble_amd642024-07-172024-07-174125.0%
No reports found!
  • ros2topic.ros2topic.test.test_cli.test_cli
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
nightly_linux_repeated2024-07-102024-07-0212325.0%
Rci__nightly-fastrtps-dynamic_ubuntu_noble_amd642024-07-132024-07-131218.33%
nightly_linux-aarch64_repeated2024-07-172024-07-171616.25%
  • https://github.com/ros2/ros2cli/issues/861 (Closed)
  • projectroot.test_tutorial_add_two_ints_server_add_two_ints_client_async__rmw_fastrtps_cpp
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
nightly_win_rep2024-07-172024-07-0413323.08%
No reports found!
  • rclcpp.test_executor.gtest.missing_result
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
nightly_win_rep2024-07-172024-07-0413323.08%
nightly_win_deb2024-07-062024-07-061417.14%
No reports found!
  • rclcpp_action.TestServer.deferred_execution
  • rclcpp_action.TestServer.get_result
  • rclcpp_action.TestServer.get_result_deferred
  • rclcpp_action.TestServer.publish_feedback
  • rclcpp_action.TestServer.publish_status_aborted
  • rclcpp_action.TestServer.publish_status_succeeded
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
nightly_win_rep2024-07-172024-07-0513323.08%
nightly_win_deb2024-07-032024-07-031417.14%
No reports found!

Maintenance

Pending

Copy link
Contributor Author

Jul 18

Urgent

Build regressions

Reference Build Failure DateTime Failure Reason
nightly_linux-aarch64_repeated#2824 2024-07-18 04:00 Number of failed test exceeds the threshold
nightly_win_rep#3419 2024-07-18 04:00 Number of failed test exceeds the threshold

Test regressions consecutive

Test regressions

Reference build Age Failure DateTime Errors Reports
Hci__nightly-performance_ubuntu_jammy_amd64#245 235 2024-07-16 06:05:11.472000
39 errors
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/resource_manager.hpp:48)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/resource_manager.hpp:49)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/resource_manager.hpp:50)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_callback_communicator.hpp:20)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_callback_communicator.hpp:21)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_communicator.hpp:21)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_communicator.hpp:22)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:20)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:21)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:22)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:23)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/data_running/data_runner_base.hpp:19)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/data_running/data_runner_factory.cpp:19)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/data_running/data_runner_factory.cpp:20)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:18)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:20)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:21)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:22)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:23)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:21)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:22)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:23)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:24)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/external_info_storage.hpp:21)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/external_info_storage.hpp:22)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:15)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:16)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:17)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:18)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:19)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:20)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:21)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:29)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:30)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/utilities/cpu_usage_tracker.hpp:19)
  • performance_test.lint_cmake.linelength (src/idlgen/opendds/CMakeLists.txt:102)
  • performance_test.lint_cmake.linelength (src/idlgen/opendds/CMakeLists.txt:22)
  • performance_test.lint_cmake.linelength (src/idlgen/opendds/CMakeLists.txt:23)
  • performance_test.uncrustify.src/communication_abstractions/connext_dds_micro_communicator.hpp
No reports found!
Ici__nightly-connext_ubuntu_jammy_amd64#147 147 2024-07-16 16:38:26.438000
  • projectroot.test.rclcpp.test_executors
  • projectroot.test_pub_sub
  • rclcpp.TestClient.client_qos
  • rclcpp.TestIntraprocessExecutors/EventsExecutor.testIntraprocessRetrigger
  • test_tracetools.test_tracetools.test.test_pub_sub.TestPubSub.test_all
  • test_tracetools.test_tracetools.test.test_publisher.TestPublisher.test_all
  • test_tracetools.test_tracetools.test.test_subscription.TestSubscription.test_all
  • https://github.com/ros2/rclcpp/issues/2502 (Closed)
Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64#145 110 2024-07-17 00:16:52.091000
  • projectroot.test_pub_sub
  • test_tracetools.test_tracetools.test.test_pub_sub.TestPubSub.test_all
  • test_tracetools.test_tracetools.test.test_publisher.TestPublisher.test_all
  • test_tracetools.test_tracetools.test.test_subscription.TestSubscription.test_all
No reports found!
Ici__nightly-performance_ubuntu_jammy_amd64#109 108 2024-07-17 04:43:17.848000
39 errors
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/resource_manager.hpp:48)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/resource_manager.hpp:49)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/resource_manager.hpp:50)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_callback_communicator.hpp:20)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_callback_communicator.hpp:21)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_communicator.hpp:21)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_communicator.hpp:22)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:20)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:21)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:22)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:23)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/data_running/data_runner_base.hpp:19)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/data_running/data_runner_factory.cpp:19)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/data_running/data_runner_factory.cpp:20)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:18)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:20)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:21)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:22)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:23)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:21)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:22)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:23)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:24)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/external_info_storage.hpp:21)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/external_info_storage.hpp:22)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:15)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:16)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:17)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:18)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:19)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:20)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:21)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:29)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:30)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/utilities/cpu_usage_tracker.hpp:19)
  • performance_test.lint_cmake.linelength (src/idlgen/opendds/CMakeLists.txt:102)
  • performance_test.lint_cmake.linelength (src/idlgen/opendds/CMakeLists.txt:22)
  • performance_test.lint_cmake.linelength (src/idlgen/opendds/CMakeLists.txt:23)
  • performance_test.uncrustify.src/communication_abstractions/connext_dds_micro_communicator.hpp
No reports found!
Rci__nightly-connext_ubuntu_noble_amd64#89 89 2024-07-17 14:27:43.828000
  • projectroot.test.rclcpp.test_subscription_topic_statistics
  • rclcpp.TestSubscriptionTopicStatisticsFixture.test_receive_stats_for_message_no_header
  • rclcpp.TestSubscriptionTopicStatisticsFixture.test_receive_stats_include_window_reset
No reports found!
Rci__benchmark_ubuntu_noble_amd64#54 54 2024-07-18 03:07:55.831000
  • projectroot.benchmark_string_conversions
  • projectroot.benchmark_string_conversions
No reports found!
Ici__nightly-connext_ubuntu_jammy_amd64#147 48 2024-07-16 16:38:26.438000
  • launch_testing_ros.test.examples.check_node_launch_test.check_node_launch_test
No reports found!
gz_rendering-8-win#70 42 2024-07-17 01:06:14.271000
  • MeshTest.NormalMapWithoutTexCoord
No reports found!
gz_rendering-7-win#63 35 2024-07-17 00:06:12.601000
  • MeshTest.NormalMapWithoutTexCoord
No reports found!
gz_rendering-main-win#62 33 2024-07-17 02:06:14.849000
  • MeshTest.NormalMapWithoutTexCoord
No reports found!
Jci__nightly-connext_ubuntu_noble_amd64#33 33 2024-07-17 06:15:00.217000
  • projectroot.test.rclcpp.test_subscription_topic_statistics
  • rclcpp.TestSubscriptionTopicStatisticsFixture.test_receive_stats_for_message_no_header
  • rclcpp.TestSubscriptionTopicStatisticsFixture.test_receive_stats_include_window_reset
No reports found!
Rci__nightly-performance_ubuntu_noble_amd64#57 32 2024-07-18 03:40:00.356000
36 errors
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/resource_manager.hpp:48)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/resource_manager.hpp:49)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/resource_manager.hpp:50)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_callback_communicator.hpp:20)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_callback_communicator.hpp:21)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_communicator.hpp:21)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_communicator.hpp:22)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:20)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:21)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:22)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:23)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/data_running/data_runner_base.hpp:19)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/data_running/data_runner_factory.cpp:19)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/data_running/data_runner_factory.cpp:20)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:18)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:20)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:21)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:22)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:23)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:21)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:22)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:23)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:24)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/external_info_storage.hpp:21)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/external_info_storage.hpp:22)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:15)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:16)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:17)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:18)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:19)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:20)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:21)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:29)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:30)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/utilities/cpu_usage_tracker.hpp:19)
  • performance_test.uncrustify.src/communication_abstractions/connext_dds_micro_communicator.hpp
No reports found!
Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64#32 32 2024-07-17 10:29:32.280000
  • projectroot.test_generic_pub_sub
  • projectroot.test_generic_subscription
  • projectroot.test_pub_sub
  • test_tracetools.test_tracetools.test.test_generic_pub_sub.TestGenericPubSub.test_all
  • test_tracetools.test_tracetools.test.test_generic_subscription.TestGenericSubscription.test_all
  • test_tracetools.test_tracetools.test.test_pub_sub.TestPubSub.test_all
  • test_tracetools.test_tracetools.test.test_publisher.TestPublisher.test_all
  • test_tracetools.test_tracetools.test.test_subscription.TestSubscription.test_all
  • https://github.com/ros2/ros2_tracing/issues/124 (Closed)
Hci__nightly-connext_ubuntu_jammy_amd64#255 24 2024-07-18 06:15:00.322000
  • launch_testing_examples.launch_testing_examples.check_node_launch_test.launch_testing_examples.check_node_launch_test
  • launch_testing_examples.launch_testing_examples.set_param_launch_test.launch_testing_examples.set_param_launch_test
No reports found!
Jci__benchmark_ubuntu_noble_amd64#19 19 2024-07-18 02:21:13.767000
  • projectroot.benchmark_string_conversions
  • projectroot.benchmark_string_conversions
No reports found!
nightly_linux-rhel_repeated#1968 10 2024-07-18 04:00:01.171000
  • test_launch_ros.test.test_launch_ros.actions.test_ros_timer.test_timer_uses_sim_time[2-3]
  • test_launch_ros.test.test_launch_ros.actions.test_ros_timer.test_timer_uses_sim_time[3-3]
No reports found!
nightly_linux_repeated#3521 9 2024-07-17 08:21:14.566000
  • test_launch_ros.test.test_launch_ros.actions.test_ros_timer.test_timer_uses_sim_time[2-3]
  • test_launch_ros.test.test_launch_ros.actions.test_ros_timer.test_timer_uses_sim_time[3-3]
No reports found!
Hci__nightly-connext_ubuntu_jammy_amd64#255 9 2024-07-18 06:15:00.322000
  • launch_testing_ros.test.examples.check_node_launch_test.check_node_launch_test
No reports found!
Jci__nightly-performance_ubuntu_noble_amd64#19 8 2024-07-17 23:57:02.066000
36 errors
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/resource_manager.hpp:48)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/resource_manager.hpp:49)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/resource_manager.hpp:50)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_callback_communicator.hpp:20)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_callback_communicator.hpp:21)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_communicator.hpp:21)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_communicator.hpp:22)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:20)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:21)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:22)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/communication_abstractions/ros2_waitset_communicator.hpp:23)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/data_running/data_runner_base.hpp:19)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/data_running/data_runner_factory.cpp:19)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/data_running/data_runner_factory.cpp:20)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:18)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:20)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:21)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:22)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.cpp:23)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:21)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:22)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:23)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/experiment_configuration.hpp:24)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/external_info_storage.hpp:21)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_configuration/external_info_storage.hpp:22)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:15)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:16)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:17)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:18)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:19)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:20)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:21)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:29)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/experiment_execution/analyze_runner.cpp:30)
  • performance_test.cpplint.build/include_order [4] (/tmp/ws2/src/performance_test/performance_test/src/utilities/cpu_usage_tracker.hpp:19)
  • performance_test.uncrustify.src/communication_abstractions/connext_dds_micro_communicator.hpp
No reports found!
Ici__nightly-performance_ubuntu_jammy_amd64#109 7 2024-07-17 04:43:17.848000
  • projectroot.cpplint
  • projectroot.lint_cmake
  • projectroot.uncrustify
  • https://github.com/ros2/rosidl/issues/790 (Closed)
Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64#145 4 2024-07-17 00:16:52.091000
  • projectroot.test_publisher
  • projectroot.test_subscription
  • https://github.com/ros2/system_tests/issues/496 (Closed)
Hci__nightly-performance_ubuntu_jammy_amd64#245 4 2024-07-16 06:05:11.472000
  • projectroot.cpplint
  • projectroot.lint_cmake
  • projectroot.uncrustify
  • https://github.com/ros2/rosidl/issues/790 (Closed)
nightly_linux-rhel_repeated#1968 3 2024-07-18 04:00:01.171000
  • ros2cli.ros2cli.test.test_strategy.test_with_daemon_spawn[1-3]
No reports found!
Rci__nightly-connext_ubuntu_noble_amd64#89 3 2024-07-17 14:27:43.828000
  • projectroot.test.rclcpp.test_service_introspection
  • rclcpp.TestServiceIntrospection.service_introspection_enable_disable_event_content
No reports found!
Ici__nightly-connext_ubuntu_jammy_amd64#147 3 2024-07-16 16:38:26.438000
  • launch_testing_examples.launch_testing_examples.check_node_launch_test.launch_testing_examples.check_node_launch_test
  • launch_testing_examples.launch_testing_examples.set_param_launch_test.launch_testing_examples.set_param_launch_test
No reports found!

Warnings

Reference build Age Failure DateTime Errors Reports
sdformat-ci-main-noble-amd64#20 -1 2024-07-17 20:48:06.890000
  • 8 gcc warnings
No reports found!
nightly_linux_release#3142 -1 2024-07-18 07:28:35.818000
  • 1 clang warnings
  • 1 clang-tidy warnings
  • 1 gcc warnings
No reports found!
nightly_linux-aarch64_release#2797 -1 2024-07-18 04:00:01.008000
  • 1 clang warnings
  • 1 clang-tidy warnings
  • 1 gcc warnings
No reports found!
gz_rendering-main-win#62 -1 2024-07-17 02:06:14.849000
  • 2 msbuild warnings
No reports found!
gz_rendering-8-win#70 -1 2024-07-17 01:06:14.271000
  • 2 msbuild warnings
No reports found!
gz_rendering-7-win#63 -1 2024-07-17 00:06:12.601000
  • 2 msbuild warnings
No reports found!
Rci__nightly-release_ubuntu_noble_amd64#85 -1 2024-07-17 23:19:47.160000
  • 1 clang-tidy warnings
  • 1 gcc warnings
No reports found!
Rci__nightly-performance_ubuntu_noble_amd64#57 -1 2024-07-18 03:40:00.356000
  • 2 clang-tidy warnings
  • 2 cmake warnings
  • 30 gcc warnings
No reports found!
Jci__nightly-release_ubuntu_noble_amd64#33 -1 2024-07-17 14:21:26.693000
  • 1 clang-tidy warnings
  • 1 gcc warnings
No reports found!
Jci__nightly-performance_ubuntu_noble_amd64#19 -1 2024-07-17 23:57:02.066000
  • 2 clang-tidy warnings
  • 2 cmake warnings
  • 30 gcc warnings
No reports found!
Ici__nightly-performance_ubuntu_jammy_amd64#109 -1 2024-07-17 04:43:17.848000
  • 2 clang-tidy warnings
  • 30 gcc warnings
  • 4 cmake warnings
No reports found!
Hci__nightly-performance_ubuntu_jammy_amd64#245 -1 2024-07-16 06:05:11.472000
  • 2 clang-tidy warnings
  • 30 gcc warnings
  • 4 cmake warnings
No reports found!

Test regressions flaky

Test regressions

Reference builds Errors Flaky report Reports
  • projectroot.test.rclcpp.test_executors
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
Ici__nightly-connext_ubuntu_jammy_amd642024-07-162024-07-0455100.0%
Rci__nightly-cyclonedds_ubuntu_noble_amd642024-07-102024-07-0412650.0%
Jci__nightly-cyclonedds_ubuntu_noble_amd642024-07-052024-07-053133.33%
nightly_win_rep2024-07-062024-07-0512216.67%
nightly_linux_debug2024-07-102024-07-0413215.38%
nightly_win_rel2024-07-182024-07-181616.25%
nightly_linux-rhel_repeated2024-07-042024-07-041616.25%
  • https://github.com/ros2/rclcpp/issues/2502 (Closed)
  • projectroot.test.rclcpp.test_subscription_topic_statistics
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
Rci__nightly-connext_ubuntu_noble_amd642024-07-172024-07-041111100.0%
Jci__nightly-connext_ubuntu_noble_amd642024-07-172024-07-0533100.0%
nightly_win_rep2024-07-052024-07-051218.33%
nightly_win_rel2024-07-182024-07-181616.25%
No reports found!
  • launch_testing_examples.launch_testing_examples.check_node_launch_test.launch_testing_examples.check_node_launch_test
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
Hci__nightly-connext_ubuntu_jammy_amd642024-07-182024-07-1144100.0%
Ici__nightly-connext_ubuntu_jammy_amd642024-07-162024-07-045480.0%
nightly_linux-aarch64_repeated2024-07-112024-07-0915320.0%
nightly_linux_repeated2024-07-172024-07-1612216.67%
nightly_linux-rhel_repeated2024-07-142024-07-141616.25%
nightly_linux-aarch64_debug2024-07-042024-07-041616.25%
No reports found!
  • projectroot.cpplint
  • projectroot.uncrustify
  • projectroot.cpplint
  • projectroot.uncrustify
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
Rci__nightly-performance_ubuntu_noble_amd642024-07-182024-07-0366100.0%
Jci__nightly-performance_ubuntu_noble_amd642024-07-172024-07-0333100.0%
Ici__nightly-performance_ubuntu_jammy_amd642024-07-172024-07-0955100.0%
Hci__nightly-performance_ubuntu_jammy_amd642024-07-162024-07-1233100.0%
  • https://github.com/ros2/rosidl/issues/790 (Closed)
  • projectroot.test_publisher
  • projectroot.test_publisher
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd642024-07-172024-07-0533100.0%
Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd642024-07-172024-07-0555100.0%
Ici__nightly-connext_ubuntu_jammy_amd642024-07-162024-07-0455100.0%
nightly_win_rep2024-07-102024-07-101218.33%
  • https://github.com/ros2/system_tests/issues/496 (Closed)
  • projectroot.test_subscription
  • projectroot.test_subscription
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd642024-07-172024-07-0533100.0%
Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd642024-07-172024-07-0555100.0%
Ici__nightly-connext_ubuntu_jammy_amd642024-07-162024-07-0455100.0%
nightly_win_rep2024-07-172024-07-1012216.67%
nightly_win_rel2024-07-162024-07-161616.25%
No reports found!
  • projectroot.test_generic_pub_sub
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd642024-07-172024-07-0533100.0%
Jci__nightly-connext_ubuntu_noble_amd642024-07-172024-07-173133.33%
  • https://github.com/ros2/ros2_tracing/issues/124 (Closed)
  • test_tracetools.test_tracetools.test.test_generic_pub_sub.TestGenericPubSub.test_all
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd642024-07-172024-07-0533100.0%
Jci__nightly-connext_ubuntu_noble_amd642024-07-172024-07-173133.33%
nightly_linux_repeated2024-07-042024-07-0312216.67%
nightly_linux-rhel_repeated2024-07-042024-07-0316212.5%
Rci__nightly-connext_ubuntu_noble_amd642024-07-042024-07-041119.09%
nightly_linux-rhel_release2024-07-042024-07-041516.67%
nightly_linux_coverage2024-07-032024-07-031516.67%
nightly_linux-rhel_debug2024-07-032024-07-031516.67%
  • https://github.com/ros2/ros2_tracing/issues/124 (Closed)
  • buildfarm_perf_tests.PerformanceTestResults.test_results_CycloneDDS
  • buildfarm_perf_tests.PerformanceTestResults.test_results_CycloneDDS
  • buildfarm_perf_tests.PerformanceTestResults.test_results_CycloneDDS
  • buildfarm_perf_tests.PerformanceTestResults.test_results_CycloneDDS
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
Rci__nightly-performance_ubuntu_noble_amd642024-07-182024-07-036583.33%
Ici__nightly-performance_ubuntu_jammy_amd642024-07-172024-07-095480.0%
Jci__nightly-performance_ubuntu_noble_amd642024-07-172024-07-033266.67%
Hci__nightly-performance_ubuntu_jammy_amd642024-07-132024-07-123266.67%
No reports found!
  • projectroot.test.test_performance_CycloneDDS_sync_Array8m
  • projectroot.test.test_performance_CycloneDDS_sync_Array8m
  • projectroot.test.test_performance_CycloneDDS_sync_Array8m
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
Rci__nightly-performance_ubuntu_noble_amd642024-07-182024-07-036583.33%
Jci__nightly-performance_ubuntu_noble_amd642024-07-172024-07-033266.67%
Hci__nightly-performance_ubuntu_jammy_amd642024-07-132024-07-123266.67%
Ici__nightly-performance_ubuntu_jammy_amd642024-07-172024-07-115360.0%
No reports found!
  • projectroot.test.test_performance_CycloneDDS_sync_PointCloud8m
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
Rci__nightly-performance_ubuntu_noble_amd642024-07-182024-07-036583.33%
Hci__nightly-performance_ubuntu_jammy_amd642024-07-132024-07-123266.67%
Ici__nightly-performance_ubuntu_jammy_amd642024-07-142024-07-095360.0%
Jci__nightly-performance_ubuntu_noble_amd642024-07-032024-07-033133.33%
No reports found!
  • projectroot.test.rclcpp.test_service_introspection
  • projectroot.test.rclcpp.test_service_introspection
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
Jci__nightly-connext_ubuntu_noble_amd642024-07-142024-07-053266.67%
Rci__nightly-connext_ubuntu_noble_amd642024-07-172024-07-0411654.55%
Ici__nightly-connext_ubuntu_jammy_amd642024-07-162024-07-095240.0%
nightly_win_rel2024-07-182024-07-181616.25%
No reports found!
  • rclcpp.TestServiceIntrospection.service_introspection_enable_disable_events
  • rclcpp.TestServiceIntrospection.service_introspection_enable_disable_events
  • rclcpp.TestServiceIntrospection.service_introspection_enable_disable_events
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
Jci__nightly-connext_ubuntu_noble_amd642024-07-142024-07-053266.67%
Rci__nightly-connext_ubuntu_noble_amd642024-07-172024-07-0411545.45%
Ici__nightly-connext_ubuntu_jammy_amd642024-07-162024-07-095240.0%
nightly_win_rel2024-07-182024-07-181616.25%
No reports found!
  • ros2topic.ros2topic.test.test_use_sim_time.test_use_sim_time
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
nightly_linux_coverage2024-07-182024-07-03151066.67%
nightly_linux_debug2024-07-132024-07-131317.69%
  • https://github.com/ros2/ros2cli/issues/772 (Closed)
  • projectroot.test_client
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
Jci__nightly-connext_ubuntu_noble_amd642024-07-142024-07-053266.67%
Rci__nightly-connext_ubuntu_noble_amd642024-07-172024-07-0411545.45%
nightly_win_rep2024-07-092024-07-0412325.0%
nightly_win_deb2024-07-112024-07-0315213.33%
No reports found!
  • rclpy.rclpy.test.test_client.TestClient.test_service_timestamps
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
Jci__nightly-connext_ubuntu_noble_amd642024-07-142024-07-053266.67%
Rci__nightly-connext_ubuntu_noble_amd642024-07-172024-07-0411545.45%
No reports found!
  • rclcpp.TestServiceIntrospection.service_introspection_enable_disable_event_content
  • rclcpp.TestServiceIntrospection.service_introspection_enable_disable_event_content
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
Rci__nightly-connext_ubuntu_noble_amd642024-07-172024-07-0411654.55%
Jci__nightly-connext_ubuntu_noble_amd642024-07-052024-07-053133.33%
Ici__nightly-connext_ubuntu_jammy_amd642024-07-162024-07-165120.0%
nightly_win_rel2024-07-182024-07-181616.25%
No reports found!
  • projectroot.test.rclcpp.test_executors_busy_waiting
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
Rci__nightly-cyclonedds_ubuntu_noble_amd642024-07-102024-07-0412650.0%
nightly_win_rep2024-07-122024-07-0512433.33%
nightly_linux-aarch64_repeated2024-07-062024-07-061516.67%
nightly_win_rel2024-07-182024-07-181616.25%
No reports found!
  • rclcpp.TestBusyWaiting/SingleThreadedExecutor.test_spin_all
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
Rci__nightly-cyclonedds_ubuntu_noble_amd642024-07-102024-07-0412650.0%
Jci__nightly-cyclonedds_ubuntu_noble_amd642024-07-052024-07-053133.33%
nightly_win_rep2024-07-052024-07-051218.33%
nightly_win_rel2024-07-182024-07-181616.25%
  • https://github.com/ros2/rclcpp/issues/2502 (Closed)
  • sros2.test.sros2.commands.security.verbs.test_generate_policy.test_generate_policy
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
nightly_win_rel2024-07-182024-07-0316637.5%
nightly_win_deb2024-07-122024-07-0515533.33%
nightly_win_rep2024-07-052024-07-051218.33%
No reports found!
  • projectroot.test.rclcpp.test_clock
  • rclcpp.TestClockWakeup.multiple_threads_wait_on_one_clock
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
nightly_linux_repeated2024-07-122024-07-0412433.33%
nightly_win_rep2024-07-112024-07-0712433.33%
nightly_linux-rhel_repeated2024-07-132024-07-1216212.5%
nightly_win_rel2024-07-182024-07-181616.25%
No reports found!
  • projectroot.test.rclcpp.test_executor
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
nightly_win_rep2024-07-172024-07-0412433.33%
nightly_win_deb2024-07-062024-07-061516.67%
nightly_win_rel2024-07-182024-07-181616.25%
  • https://github.com/ros2/rclcpp/issues/2502 (Closed)
  • projectroot.test_generic_pub_sub__rmw_connextdds
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
nightly_linux_repeated2024-07-172024-07-0312433.33%
nightly_linux-rhel_repeated2024-07-122024-07-0316425.0%
Rci__nightly-connext_ubuntu_noble_amd642024-07-042024-07-041119.09%
nightly_linux-rhel_release2024-07-042024-07-041516.67%
nightly_linux_coverage2024-07-032024-07-031516.67%
nightly_linux-rhel_debug2024-07-032024-07-031516.67%
  • https://github.com/ros2/ros2_tracing/issues/124 (Closed)
  • projectroot.tf2_ros_test_message_filter
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
Jci__nightly-connext_ubuntu_noble_amd642024-07-172024-07-173133.33%
Rci__nightly-connext_ubuntu_noble_amd642024-07-122024-07-0511327.27%
nightly_win_deb2024-07-032024-07-031516.67%
No reports found!
  • tf2_ros.tf2_ros_test_message_filter.gtest.missing_result
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
Jci__nightly-connext_ubuntu_noble_amd642024-07-172024-07-173133.33%
Rci__nightly-connext_ubuntu_noble_amd642024-07-122024-07-0511327.27%
No reports found!
  • rclcpp.test_executor.gtest.missing_result
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
nightly_win_rep2024-07-172024-07-0412325.0%
nightly_win_deb2024-07-062024-07-061516.67%
nightly_win_rel2024-07-182024-07-181616.25%
No reports found!
  • projectroot.test_client_scope_cpp__rmw_cyclonedds_cpp
  • test_rclcpp.TestTwoExecutablesAfterShutdown.test_client_scope_cpp
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
nightly_linux_repeated2024-07-172024-07-1012325.0%
nightly_linux-rhel_repeated2024-07-132024-07-131616.25%
No reports found!
  • projectroot.test_pub_sub__rmw_connextdds
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
nightly_linux-rhel_repeated2024-07-182024-07-0316425.0%
nightly_linux_repeated2024-07-042024-07-0312216.67%
nightly_linux-rhel_release2024-07-032024-07-031516.67%
No reports found!
  • projectroot.copyright
  • rviz_default_plugins.copyright.xunit.missing_result
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
nightly_win_deb2024-07-182024-07-1215320.0%
No reports found!

Maintenance

Pending

@Crola1702
Copy link
Contributor

Crola1702 commented Jul 18, 2024

Ros2 Performance Tests | Test regressions | Reported 📚

Reference builds:

Most of the test regressions are related to cpplint include_order

Test regressions:
Affected files:
  • resource_manager.hpp:48
  • resource_manager.hpp:49
  • resource_manager.hpp:50
  • ros2_callback_communicator.hpp:20
  • ros2_callback_communicator.hpp:21
  • ros2_communicator.hpp:21
  • ros2_communicator.hpp:22
  • ros2_waitset_communicator.hpp:20
  • ros2_waitset_communicator.hpp:21
  • ros2_waitset_communicator.hpp:22
  • ros2_waitset_communicator.hpp:23
  • data_runner_base.hpp:19
  • data_runner_factory.cpp:19
  • data_runner_factory.cpp:20
  • experiment_configuration.cpp:18
  • experiment_configuration.cpp:20
  • experiment_configuration.cpp:21
  • experiment_configuration.cpp:22
  • experiment_configuration.cpp:23
  • experiment_configuration.hpp:21
  • experiment_configuration.hpp:22
  • experiment_configuration.hpp:23
  • experiment_configuration.hpp:24
  • external_info_storage.hpp:21
  • external_info_storage.hpp:22
  • analyze_runner.cpp:15
  • analyze_runner.cpp:16
  • analyze_runner.cpp:17
  • analyze_runner.cpp:18
  • analyze_runner.cpp:19
  • analyze_runner.cpp:20
  • analyze_runner.cpp:21
  • analyze_runner.cpp:29
  • analyze_runner.cpp:30
  • cpu_usage_tracker.hpp:19

Reported in: ros2/performance_test#48

Copy link
Contributor Author

Jul 19

Urgent

Test regressions consecutive

Test regressions

Reference build Age Failure DateTime Errors Reports
Hci__nightly-performance_ubuntu_jammy_amd64#245 235 2024-07-16 06:05:11.472000
  • performance_test.lint_cmake.linelength (src/idlgen/opendds/CMakeLists.txt:102)
  • performance_test.lint_cmake.linelength (src/idlgen/opendds/CMakeLists.txt:22)
  • performance_test.lint_cmake.linelength (src/idlgen/opendds/CMakeLists.txt:23)
  • performance_test.uncrustify.src/communication_abstractions/connext_dds_micro_communicator.hpp
No reports found!
Ici__nightly-connext_ubuntu_jammy_amd64#147 147 2024-07-16 16:38:26.438000
  • projectroot.test.rclcpp.test_executors
  • projectroot.test_pub_sub
  • rclcpp.TestClient.client_qos
  • rclcpp.TestIntraprocessExecutors/EventsExecutor.testIntraprocessRetrigger
  • test_tracetools.test_tracetools.test.test_pub_sub.TestPubSub.test_all
  • test_tracetools.test_tracetools.test.test_publisher.TestPublisher.test_all
  • test_tracetools.test_tracetools.test.test_subscription.TestSubscription.test_all
  • https://github.com/ros2/rclcpp/issues/2502 (Closed)
Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64#145 110 2024-07-17 00:16:52.091000
  • projectroot.test_pub_sub
  • test_tracetools.test_tracetools.test.test_pub_sub.TestPubSub.test_all
  • test_tracetools.test_tracetools.test.test_publisher.TestPublisher.test_all
  • test_tracetools.test_tracetools.test.test_subscription.TestSubscription.test_all
No reports found!
Ici__nightly-performance_ubuntu_jammy_amd64#109 108 2024-07-17 04:43:17.848000
  • performance_test.lint_cmake.linelength (src/idlgen/opendds/CMakeLists.txt:102)
  • performance_test.lint_cmake.linelength (src/idlgen/opendds/CMakeLists.txt:22)
  • performance_test.lint_cmake.linelength (src/idlgen/opendds/CMakeLists.txt:23)
  • performance_test.uncrustify.src/communication_abstractions/connext_dds_micro_communicator.hpp
No reports found!
Rci__nightly-connext_ubuntu_noble_amd64#89 89 2024-07-17 14:27:43.828000
  • projectroot.test.rclcpp.test_subscription_topic_statistics
  • rclcpp.TestSubscriptionTopicStatisticsFixture.test_receive_stats_for_message_no_header
  • rclcpp.TestSubscriptionTopicStatisticsFixture.test_receive_stats_include_window_reset
No reports found!
Rci__benchmark_ubuntu_noble_amd64#54 54 2024-07-18 03:07:55.831000
  • projectroot.benchmark_string_conversions
  • projectroot.benchmark_string_conversions
No reports found!
Ici__nightly-connext_ubuntu_jammy_amd64#147 48 2024-07-16 16:38:26.438000
  • launch_testing_ros.test.examples.check_node_launch_test.check_node_launch_test
No reports found!
gz_rendering-8-win#70 42 2024-07-17 01:06:14.271000
  • MeshTest.NormalMapWithoutTexCoord
No reports found!
gz_rendering-7-win#63 35 2024-07-17 00:06:12.601000
  • MeshTest.NormalMapWithoutTexCoord
No reports found!
gz_rendering-main-win#62 33 2024-07-17 02:06:14.849000
  • MeshTest.NormalMapWithoutTexCoord
No reports found!
Jci__nightly-connext_ubuntu_noble_amd64#33 33 2024-07-17 06:15:00.217000
  • projectroot.test.rclcpp.test_subscription_topic_statistics
  • rclcpp.TestSubscriptionTopicStatisticsFixture.test_receive_stats_for_message_no_header
  • rclcpp.TestSubscriptionTopicStatisticsFixture.test_receive_stats_include_window_reset
No reports found!
Rci__nightly-performance_ubuntu_noble_amd64#57 32 2024-07-18 03:40:00.356000
  • performance_test.uncrustify.src/communication_abstractions/connext_dds_micro_communicator.hpp
No reports found!
Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64#32 32 2024-07-17 10:29:32.280000
  • projectroot.test_generic_pub_sub
  • projectroot.test_generic_subscription
  • projectroot.test_pub_sub
  • test_tracetools.test_tracetools.test.test_generic_pub_sub.TestGenericPubSub.test_all
  • test_tracetools.test_tracetools.test.test_generic_subscription.TestGenericSubscription.test_all
  • test_tracetools.test_tracetools.test.test_pub_sub.TestPubSub.test_all
  • test_tracetools.test_tracetools.test.test_publisher.TestPublisher.test_all
  • test_tracetools.test_tracetools.test.test_subscription.TestSubscription.test_all
  • https://github.com/ros2/ros2_tracing/issues/124 (Closed)
Hci__nightly-connext_ubuntu_jammy_amd64#255 24 2024-07-18 06:15:00.322000
  • launch_testing_examples.launch_testing_examples.check_node_launch_test.launch_testing_examples.check_node_launch_test
  • launch_testing_examples.launch_testing_examples.set_param_launch_test.launch_testing_examples.set_param_launch_test
No reports found!
Jci__benchmark_ubuntu_noble_amd64#19 19 2024-07-18 02:21:13.767000
  • projectroot.benchmark_string_conversions
  • projectroot.benchmark_string_conversions
No reports found!
nightly_linux-rhel_repeated#1968 10 2024-07-18 04:00:01.171000
  • test_launch_ros.test.test_launch_ros.actions.test_ros_timer.test_timer_uses_sim_time[2-3]
  • test_launch_ros.test.test_launch_ros.actions.test_ros_timer.test_timer_uses_sim_time[3-3]
No reports found!
nightly_linux_repeated#3521 9 2024-07-17 08:21:14.566000
  • test_launch_ros.test.test_launch_ros.actions.test_ros_timer.test_timer_uses_sim_time[2-3]
  • test_launch_ros.test.test_launch_ros.actions.test_ros_timer.test_timer_uses_sim_time[3-3]
No reports found!
Hci__nightly-connext_ubuntu_jammy_amd64#255 9 2024-07-18 06:15:00.322000
  • launch_testing_ros.test.examples.check_node_launch_test.check_node_launch_test
No reports found!
Jci__nightly-performance_ubuntu_noble_amd64#19 8 2024-07-17 23:57:02.066000
  • performance_test.uncrustify.src/communication_abstractions/connext_dds_micro_communicator.hpp
No reports found!
Ici__nightly-performance_ubuntu_jammy_amd64#109 7 2024-07-17 04:43:17.848000
  • projectroot.lint_cmake
  • projectroot.uncrustify
No reports found!
Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64#145 4 2024-07-17 00:16:52.091000
  • projectroot.test_publisher
  • projectroot.test_subscription
  • https://github.com/ros2/system_tests/issues/496 (Closed)
Hci__nightly-performance_ubuntu_jammy_amd64#245 4 2024-07-16 06:05:11.472000
  • projectroot.lint_cmake
  • projectroot.uncrustify
No reports found!
nightly_linux-rhel_repeated#1968 3 2024-07-18 04:00:01.171000
  • ros2cli.ros2cli.test.test_strategy.test_with_daemon_spawn[1-3]
No reports found!
Rci__nightly-connext_ubuntu_noble_amd64#89 3 2024-07-17 14:27:43.828000
  • projectroot.test.rclcpp.test_service_introspection
  • rclcpp.TestServiceIntrospection.service_introspection_enable_disable_event_content
No reports found!
Ici__nightly-connext_ubuntu_jammy_amd64#147 3 2024-07-16 16:38:26.438000
  • launch_testing_examples.launch_testing_examples.check_node_launch_test.launch_testing_examples.check_node_launch_test
  • launch_testing_examples.launch_testing_examples.set_param_launch_test.launch_testing_examples.set_param_launch_test
No reports found!

Warnings

Reference build Age Failure DateTime Errors Reports
sdformat-ci-main-noble-amd64#20 -1 2024-07-17 20:48:06.890000
  • 8 gcc warnings
No reports found!
nightly_linux_release#3142 -1 2024-07-18 07:28:35.818000
  • 1 clang warnings
  • 1 clang-tidy warnings
  • 1 gcc warnings
No reports found!
nightly_linux-aarch64_release#2797 -1 2024-07-18 04:00:01.008000
  • 1 clang warnings
  • 1 clang-tidy warnings
  • 1 gcc warnings
No reports found!
gz_rendering-main-win#62 -1 2024-07-17 02:06:14.849000
  • 2 msbuild warnings
No reports found!
gz_rendering-8-win#70 -1 2024-07-17 01:06:14.271000
  • 2 msbuild warnings
No reports found!
gz_rendering-7-win#63 -1 2024-07-17 00:06:12.601000
  • 2 msbuild warnings
No reports found!
Rci__nightly-release_ubuntu_noble_amd64#85 -1 2024-07-17 23:19:47.160000
  • 1 clang-tidy warnings
  • 1 gcc warnings
No reports found!
Rci__nightly-performance_ubuntu_noble_amd64#57 -1 2024-07-18 03:40:00.356000
  • 2 clang-tidy warnings
  • 2 cmake warnings
  • 30 gcc warnings
No reports found!
Jci__nightly-release_ubuntu_noble_amd64#33 -1 2024-07-17 14:21:26.693000
  • 1 clang-tidy warnings
  • 1 gcc warnings
No reports found!
Jci__nightly-performance_ubuntu_noble_amd64#19 -1 2024-07-17 23:57:02.066000
  • 2 clang-tidy warnings
  • 2 cmake warnings
  • 30 gcc warnings
No reports found!
Ici__nightly-performance_ubuntu_jammy_amd64#109 -1 2024-07-17 04:43:17.848000
  • 2 clang-tidy warnings
  • 30 gcc warnings
  • 4 cmake warnings
No reports found!
Hci__nightly-performance_ubuntu_jammy_amd64#245 -1 2024-07-16 06:05:11.472000
  • 2 clang-tidy warnings
  • 30 gcc warnings
  • 4 cmake warnings
No reports found!

Test regressions flaky

Test regressions

Reference builds Errors Flaky report Reports
  • projectroot.test.rclcpp.test_executors
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
Ici__nightly-connext_ubuntu_jammy_amd642024-07-162024-07-0455100.0%
Rci__nightly-cyclonedds_ubuntu_noble_amd642024-07-102024-07-0412650.0%
Jci__nightly-cyclonedds_ubuntu_noble_amd642024-07-052024-07-053133.33%
nightly_win_rep2024-07-062024-07-0511218.18%
nightly_linux_debug2024-07-102024-07-0412216.67%
nightly_win_rel2024-07-182024-07-181516.67%
nightly_linux-rhel_repeated2024-07-042024-07-041516.67%
  • https://github.com/ros2/rclcpp/issues/2502 (Closed)
  • projectroot.test.rclcpp.test_subscription_topic_statistics
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
Rci__nightly-connext_ubuntu_noble_amd642024-07-172024-07-041111100.0%
Jci__nightly-connext_ubuntu_noble_amd642024-07-172024-07-0533100.0%
nightly_win_rep2024-07-052024-07-051119.09%
nightly_win_rel2024-07-182024-07-181516.67%
No reports found!
  • launch_testing_examples.launch_testing_examples.check_node_launch_test.launch_testing_examples.check_node_launch_test
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
Hci__nightly-connext_ubuntu_jammy_amd642024-07-182024-07-1144100.0%
Ici__nightly-connext_ubuntu_jammy_amd642024-07-162024-07-045480.0%
nightly_linux-aarch64_repeated2024-07-112024-07-0914321.43%
nightly_linux_repeated2024-07-172024-07-1611218.18%
nightly_linux-rhel_repeated2024-07-142024-07-141516.67%
nightly_linux-aarch64_debug2024-07-042024-07-041516.67%
No reports found!
  • projectroot.uncrustify
  • projectroot.uncrustify
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
Rci__nightly-performance_ubuntu_noble_amd642024-07-182024-07-0755100.0%
Jci__nightly-performance_ubuntu_noble_amd642024-07-172024-07-0622100.0%
Ici__nightly-performance_ubuntu_jammy_amd642024-07-172024-07-0955100.0%
Hci__nightly-performance_ubuntu_jammy_amd642024-07-162024-07-1233100.0%
No reports found!
  • projectroot.test_publisher
  • projectroot.test_publisher
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd642024-07-172024-07-0533100.0%
Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd642024-07-172024-07-0555100.0%
Ici__nightly-connext_ubuntu_jammy_amd642024-07-162024-07-0455100.0%
nightly_win_rep2024-07-102024-07-101119.09%
  • https://github.com/ros2/system_tests/issues/496 (Closed)
  • projectroot.test_subscription
  • projectroot.test_subscription
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd642024-07-172024-07-0533100.0%
Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd642024-07-172024-07-0555100.0%
Ici__nightly-connext_ubuntu_jammy_amd642024-07-162024-07-0455100.0%
nightly_win_rep2024-07-172024-07-1011218.18%
nightly_win_rel2024-07-162024-07-161516.67%
No reports found!
  • projectroot.test_generic_pub_sub
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd642024-07-172024-07-0533100.0%
Jci__nightly-connext_ubuntu_noble_amd642024-07-172024-07-173133.33%
  • https://github.com/ros2/ros2_tracing/issues/124 (Closed)
  • test_tracetools.test_tracetools.test.test_generic_pub_sub.TestGenericPubSub.test_all
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd642024-07-172024-07-0533100.0%
Jci__nightly-connext_ubuntu_noble_amd642024-07-172024-07-173133.33%
nightly_linux_repeated2024-07-042024-07-041119.09%
Rci__nightly-connext_ubuntu_noble_amd642024-07-042024-07-041119.09%
nightly_linux-rhel_release2024-07-042024-07-041417.14%
nightly_linux-rhel_repeated2024-07-042024-07-041516.67%
  • https://github.com/ros2/ros2_tracing/issues/124 (Closed)
  • buildfarm_perf_tests.PerformanceTestResults.test_results_CycloneDDS
  • buildfarm_perf_tests.PerformanceTestResults.test_results_CycloneDDS
  • buildfarm_perf_tests.PerformanceTestResults.test_results_CycloneDDS
  • buildfarm_perf_tests.PerformanceTestResults.test_results_CycloneDDS
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
Rci__nightly-performance_ubuntu_noble_amd642024-07-182024-07-075480.0%
Ici__nightly-performance_ubuntu_jammy_amd642024-07-172024-07-095480.0%
Hci__nightly-performance_ubuntu_jammy_amd642024-07-132024-07-123266.67%
Jci__nightly-performance_ubuntu_noble_amd642024-07-172024-07-172150.0%
No reports found!
  • projectroot.test.test_performance_CycloneDDS_sync_Array8m
  • projectroot.test.test_performance_CycloneDDS_sync_Array8m
  • projectroot.test.test_performance_CycloneDDS_sync_Array8m
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
Rci__nightly-performance_ubuntu_noble_amd642024-07-182024-07-075480.0%
Hci__nightly-performance_ubuntu_jammy_amd642024-07-132024-07-123266.67%
Ici__nightly-performance_ubuntu_jammy_amd642024-07-172024-07-115360.0%
Jci__nightly-performance_ubuntu_noble_amd642024-07-172024-07-172150.0%
No reports found!
  • projectroot.test.test_performance_CycloneDDS_sync_PointCloud8m
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
Rci__nightly-performance_ubuntu_noble_amd642024-07-182024-07-075480.0%
Hci__nightly-performance_ubuntu_jammy_amd642024-07-132024-07-123266.67%
Ici__nightly-performance_ubuntu_jammy_amd642024-07-142024-07-095360.0%
No reports found!
  • projectroot.test.rclcpp.test_service_introspection
  • projectroot.test.rclcpp.test_service_introspection
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
Jci__nightly-connext_ubuntu_noble_amd642024-07-142024-07-053266.67%
Rci__nightly-connext_ubuntu_noble_amd642024-07-172024-07-0411654.55%
Ici__nightly-connext_ubuntu_jammy_amd642024-07-162024-07-095240.0%
nightly_win_rel2024-07-182024-07-181516.67%
No reports found!
  • rclcpp.TestServiceIntrospection.service_introspection_enable_disable_events
  • rclcpp.TestServiceIntrospection.service_introspection_enable_disable_events
  • rclcpp.TestServiceIntrospection.service_introspection_enable_disable_events
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
Jci__nightly-connext_ubuntu_noble_amd642024-07-142024-07-053266.67%
Rci__nightly-connext_ubuntu_noble_amd642024-07-172024-07-0411545.45%
Ici__nightly-connext_ubuntu_jammy_amd642024-07-162024-07-095240.0%
nightly_win_rel2024-07-182024-07-181516.67%
No reports found!
  • projectroot.test_client
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
Jci__nightly-connext_ubuntu_noble_amd642024-07-142024-07-053266.67%
Rci__nightly-connext_ubuntu_noble_amd642024-07-172024-07-0411545.45%
nightly_win_rep2024-07-092024-07-0411327.27%
nightly_win_deb2024-07-112024-07-111417.14%
No reports found!
  • rclpy.rclpy.test.test_client.TestClient.test_service_timestamps
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
Jci__nightly-connext_ubuntu_noble_amd642024-07-142024-07-053266.67%
Rci__nightly-connext_ubuntu_noble_amd642024-07-172024-07-0411545.45%
No reports found!
  • ros2topic.ros2topic.test.test_use_sim_time.test_use_sim_time
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
nightly_linux_coverage2024-07-182024-07-0414964.29%
nightly_linux_debug2024-07-132024-07-131218.33%
  • https://github.com/ros2/ros2cli/issues/772 (Closed)
  • rclcpp.TestServiceIntrospection.service_introspection_enable_disable_event_content
  • rclcpp.TestServiceIntrospection.service_introspection_enable_disable_event_content
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
Rci__nightly-connext_ubuntu_noble_amd642024-07-172024-07-0411654.55%
Jci__nightly-connext_ubuntu_noble_amd642024-07-052024-07-053133.33%
Ici__nightly-connext_ubuntu_jammy_amd642024-07-162024-07-165120.0%
nightly_win_rel2024-07-182024-07-181516.67%
No reports found!
  • projectroot.test.rclcpp.test_executors_busy_waiting
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
Rci__nightly-cyclonedds_ubuntu_noble_amd642024-07-102024-07-0412650.0%
nightly_win_rep2024-07-122024-07-0511436.36%
nightly_linux-aarch64_repeated2024-07-062024-07-061417.14%
nightly_win_rel2024-07-182024-07-181516.67%
No reports found!
  • rclcpp.TestBusyWaiting/SingleThreadedExecutor.test_spin_all
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
Rci__nightly-cyclonedds_ubuntu_noble_amd642024-07-102024-07-0412650.0%
Jci__nightly-cyclonedds_ubuntu_noble_amd642024-07-052024-07-053133.33%
nightly_win_rep2024-07-052024-07-051119.09%
nightly_win_rel2024-07-182024-07-181516.67%
  • https://github.com/ros2/rclcpp/issues/2502 (Closed)
  • projectroot.test.rclcpp.test_clock
  • rclcpp.TestClockWakeup.multiple_threads_wait_on_one_clock
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
nightly_linux_repeated2024-07-122024-07-0411436.36%
nightly_win_rep2024-07-112024-07-0711436.36%
nightly_linux-rhel_repeated2024-07-132024-07-1215213.33%
nightly_win_rel2024-07-182024-07-181516.67%
No reports found!
  • projectroot.test.rclcpp.test_executor
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
nightly_win_rep2024-07-172024-07-0411436.36%
nightly_win_deb2024-07-062024-07-061417.14%
nightly_win_rel2024-07-182024-07-181516.67%
  • https://github.com/ros2/rclcpp/issues/2502 (Closed)
  • sros2.test.sros2.commands.security.verbs.test_generate_policy.test_generate_policy
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
nightly_win_deb2024-07-122024-07-0514535.71%
nightly_win_rel2024-07-182024-07-0415533.33%
nightly_win_rep2024-07-052024-07-051119.09%
No reports found!
  • projectroot.tf2_ros_test_message_filter
  • tf2_ros.tf2_ros_test_message_filter.gtest.missing_result
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
Jci__nightly-connext_ubuntu_noble_amd642024-07-172024-07-173133.33%
Rci__nightly-connext_ubuntu_noble_amd642024-07-122024-07-0511327.27%
No reports found!
  • rclcpp.test_executor.gtest.missing_result
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
nightly_win_rep2024-07-172024-07-0411327.27%
nightly_win_deb2024-07-062024-07-061417.14%
nightly_win_rel2024-07-182024-07-181516.67%
No reports found!
  • projectroot.test_client_scope_cpp__rmw_cyclonedds_cpp
  • test_rclcpp.TestTwoExecutablesAfterShutdown.test_client_scope_cpp
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
nightly_linux_repeated2024-07-172024-07-1011327.27%
nightly_linux-rhel_repeated2024-07-132024-07-131516.67%
No reports found!
  • projectroot.test_generic_pub_sub__rmw_connextdds
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
nightly_linux_repeated2024-07-172024-07-0411327.27%
nightly_linux-rhel_repeated2024-07-122024-07-0415320.0%
Rci__nightly-connext_ubuntu_noble_amd642024-07-042024-07-041119.09%
nightly_linux-rhel_release2024-07-042024-07-041417.14%
  • https://github.com/ros2/ros2_tracing/issues/124 (Closed)
  • projectroot.copyright
  • rviz_default_plugins.copyright.xunit.missing_result
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
nightly_win_deb2024-07-182024-07-1214321.43%
No reports found!
  • projectroot.test_pub_sub__rmw_connextdds
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
nightly_linux-rhel_repeated2024-07-182024-07-0415320.0%
nightly_linux_repeated2024-07-042024-07-041119.09%
No reports found!

Maintenance

Pending

@claraberendsen
Copy link
Contributor

claraberendsen commented Jul 19, 2024

🟡 Jul 19th buildfarm Urgent test regressions

Buildfarmer: @claraberendsen

ROS

Performance regressions

Linux repeated regressions

Benchmark regressions

Gazebo

ACTION ITEM: Verify locally if the vcpkg port works and add it to the machine.

Follow up question: @Crola1702 do we have a way to link an existing error to the report.

@claraberendsen
Copy link
Contributor

There are a lot of errors related to the PR on rclpy ros2/rclpy#1280. I was not able to track all of them down, but they seem to be related to connext primarily
See for example
https://build.ros2.org/job/Ici__nightly-connext_ubuntu_jammy_amd64/145/testReport/junit/launch_testing_examples.launch_testing_examples/check_node_launch_test/launch_testing_examples_check_node_launch_test/

Copy link
Contributor Author

Jul 20

Urgent

Test regressions consecutive

Test regressions

Reference build Age Failure DateTime Errors Reports
Ici__nightly-connext_ubuntu_jammy_amd64#147 147 2024-07-16 16:38:26.438000
  • projectroot.test.rclcpp.test_executors
  • projectroot.test_pub_sub
  • rclcpp.TestClient.client_qos
  • rclcpp.TestIntraprocessExecutors/EventsExecutor.testIntraprocessRetrigger
  • test_tracetools.test_tracetools.test.test_pub_sub.TestPubSub.test_all
  • test_tracetools.test_tracetools.test.test_publisher.TestPublisher.test_all
  • test_tracetools.test_tracetools.test.test_subscription.TestSubscription.test_all
  • https://github.com/ros2/rclcpp/issues/2502 (Closed)
Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64#145 110 2024-07-17 00:16:52.091000
  • projectroot.test_pub_sub
  • test_tracetools.test_tracetools.test.test_pub_sub.TestPubSub.test_all
  • test_tracetools.test_tracetools.test.test_publisher.TestPublisher.test_all
  • test_tracetools.test_tracetools.test.test_subscription.TestSubscription.test_all
No reports found!
Ici__nightly-performance_ubuntu_jammy_amd64#109 108 2024-07-17 04:43:17.848000
  • performance_test.lint_cmake.linelength (src/idlgen/opendds/CMakeLists.txt:102)
  • performance_test.lint_cmake.linelength (src/idlgen/opendds/CMakeLists.txt:22)
  • performance_test.lint_cmake.linelength (src/idlgen/opendds/CMakeLists.txt:23)
  • performance_test.uncrustify.src/communication_abstractions/connext_dds_micro_communicator.hpp
No reports found!
Rci__nightly-connext_ubuntu_noble_amd64#89 89 2024-07-17 14:27:43.828000
  • projectroot.test.rclcpp.test_subscription_topic_statistics
  • rclcpp.TestSubscriptionTopicStatisticsFixture.test_receive_stats_for_message_no_header
  • rclcpp.TestSubscriptionTopicStatisticsFixture.test_receive_stats_include_window_reset
No reports found!
Rci__benchmark_ubuntu_noble_amd64#54 54 2024-07-18 03:07:55.831000
  • projectroot.benchmark_string_conversions
  • projectroot.benchmark_string_conversions
No reports found!
Ici__nightly-connext_ubuntu_jammy_amd64#147 48 2024-07-16 16:38:26.438000
  • launch_testing_ros.test.examples.check_node_launch_test.check_node_launch_test
No reports found!
gz_rendering-8-win#70 42 2024-07-17 01:06:14.271000
  • MeshTest.NormalMapWithoutTexCoord
No reports found!
gz_rendering-7-win#63 35 2024-07-17 00:06:12.601000
  • MeshTest.NormalMapWithoutTexCoord
No reports found!
gz_rendering-main-win#62 33 2024-07-17 02:06:14.849000
  • MeshTest.NormalMapWithoutTexCoord
No reports found!
Jci__nightly-connext_ubuntu_noble_amd64#33 33 2024-07-17 06:15:00.217000
  • projectroot.test.rclcpp.test_subscription_topic_statistics
  • rclcpp.TestSubscriptionTopicStatisticsFixture.test_receive_stats_for_message_no_header
  • rclcpp.TestSubscriptionTopicStatisticsFixture.test_receive_stats_include_window_reset
No reports found!
Rci__nightly-performance_ubuntu_noble_amd64#57 32 2024-07-18 03:40:00.356000
  • performance_test.uncrustify.src/communication_abstractions/connext_dds_micro_communicator.hpp
No reports found!
Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64#32 32 2024-07-17 10:29:32.280000
  • projectroot.test_generic_pub_sub
  • projectroot.test_generic_subscription
  • projectroot.test_pub_sub
  • test_tracetools.test_tracetools.test.test_generic_pub_sub.TestGenericPubSub.test_all
  • test_tracetools.test_tracetools.test.test_generic_subscription.TestGenericSubscription.test_all
  • test_tracetools.test_tracetools.test.test_pub_sub.TestPubSub.test_all
  • test_tracetools.test_tracetools.test.test_publisher.TestPublisher.test_all
  • test_tracetools.test_tracetools.test.test_subscription.TestSubscription.test_all
  • https://github.com/ros2/ros2_tracing/issues/124 (Closed)
Hci__nightly-connext_ubuntu_jammy_amd64#255 24 2024-07-18 06:15:00.322000
  • launch_testing_examples.launch_testing_examples.check_node_launch_test.launch_testing_examples.check_node_launch_test
  • launch_testing_examples.launch_testing_examples.set_param_launch_test.launch_testing_examples.set_param_launch_test
No reports found!
Jci__benchmark_ubuntu_noble_amd64#19 19 2024-07-18 02:21:13.767000
  • projectroot.benchmark_string_conversions
  • projectroot.benchmark_string_conversions
No reports found!
nightly_linux-rhel_repeated#1968 10 2024-07-18 04:00:01.171000
  • test_launch_ros.test.test_launch_ros.actions.test_ros_timer.test_timer_uses_sim_time[2-3]
  • test_launch_ros.test.test_launch_ros.actions.test_ros_timer.test_timer_uses_sim_time[3-3]
No reports found!
nightly_linux_repeated#3521 9 2024-07-17 08:21:14.566000
  • test_launch_ros.test.test_launch_ros.actions.test_ros_timer.test_timer_uses_sim_time[2-3]
  • test_launch_ros.test.test_launch_ros.actions.test_ros_timer.test_timer_uses_sim_time[3-3]
No reports found!
Hci__nightly-connext_ubuntu_jammy_amd64#255 9 2024-07-18 06:15:00.322000
  • launch_testing_ros.test.examples.check_node_launch_test.check_node_launch_test
No reports found!
Jci__nightly-performance_ubuntu_noble_amd64#19 8 2024-07-17 23:57:02.066000
  • performance_test.uncrustify.src/communication_abstractions/connext_dds_micro_communicator.hpp
No reports found!
Ici__nightly-performance_ubuntu_jammy_amd64#109 7 2024-07-17 04:43:17.848000
  • projectroot.lint_cmake
  • projectroot.uncrustify
No reports found!
Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd64#145 4 2024-07-17 00:16:52.091000
  • projectroot.test_publisher
  • projectroot.test_subscription
  • https://github.com/ros2/system_tests/issues/496 (Closed)
nightly_linux-rhel_repeated#1968 3 2024-07-18 04:00:01.171000
  • ros2cli.ros2cli.test.test_strategy.test_with_daemon_spawn[1-3]
No reports found!
Rci__nightly-connext_ubuntu_noble_amd64#89 3 2024-07-17 14:27:43.828000
  • projectroot.test.rclcpp.test_service_introspection
  • rclcpp.TestServiceIntrospection.service_introspection_enable_disable_event_content
No reports found!
Ici__nightly-connext_ubuntu_jammy_amd64#147 3 2024-07-16 16:38:26.438000
  • launch_testing_examples.launch_testing_examples.check_node_launch_test.launch_testing_examples.check_node_launch_test
  • launch_testing_examples.launch_testing_examples.set_param_launch_test.launch_testing_examples.set_param_launch_test
No reports found!

Warnings

Reference build Age Failure DateTime Errors Reports
sdformat-ci-main-noble-amd64#20 -1 2024-07-17 20:48:06.890000
  • 8 gcc warnings
No reports found!
nightly_linux_release#3142 -1 2024-07-18 07:28:35.818000
  • 1 clang warnings
  • 1 clang-tidy warnings
  • 1 gcc warnings
No reports found!
nightly_linux-aarch64_release#2797 -1 2024-07-18 04:00:01.008000
  • 1 clang warnings
  • 1 clang-tidy warnings
  • 1 gcc warnings
No reports found!
gz_rendering-main-win#62 -1 2024-07-17 02:06:14.849000
  • 2 msbuild warnings
No reports found!
gz_rendering-8-win#70 -1 2024-07-17 01:06:14.271000
  • 2 msbuild warnings
No reports found!
gz_rendering-7-win#63 -1 2024-07-17 00:06:12.601000
  • 2 msbuild warnings
No reports found!
Rci__nightly-release_ubuntu_noble_amd64#85 -1 2024-07-17 23:19:47.160000
  • 1 clang-tidy warnings
  • 1 gcc warnings
No reports found!
Rci__nightly-performance_ubuntu_noble_amd64#57 -1 2024-07-18 03:40:00.356000
  • 2 clang-tidy warnings
  • 2 cmake warnings
  • 30 gcc warnings
No reports found!
Jci__nightly-release_ubuntu_noble_amd64#33 -1 2024-07-17 14:21:26.693000
  • 1 clang-tidy warnings
  • 1 gcc warnings
No reports found!
Jci__nightly-performance_ubuntu_noble_amd64#19 -1 2024-07-17 23:57:02.066000
  • 2 clang-tidy warnings
  • 2 cmake warnings
  • 30 gcc warnings
No reports found!
Ici__nightly-performance_ubuntu_jammy_amd64#109 -1 2024-07-17 04:43:17.848000
  • 2 clang-tidy warnings
  • 30 gcc warnings
  • 4 cmake warnings
No reports found!

Test regressions flaky

Test regressions

Reference builds Errors Flaky report Reports
  • projectroot.test.rclcpp.test_executors
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
Ici__nightly-connext_ubuntu_jammy_amd642024-07-162024-07-0944100.0%
Rci__nightly-cyclonedds_ubuntu_noble_amd642024-07-102024-07-0611545.45%
Jci__nightly-cyclonedds_ubuntu_noble_amd642024-07-052024-07-053133.33%
nightly_win_rep2024-07-062024-07-0510220.0%
nightly_linux_debug2024-07-102024-07-101119.09%
nightly_win_rel2024-07-182024-07-181417.14%
  • https://github.com/ros2/rclcpp/issues/2502 (Closed)
  • projectroot.test.rclcpp.test_subscription_topic_statistics
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
Rci__nightly-connext_ubuntu_noble_amd642024-07-172024-07-051010100.0%
Jci__nightly-connext_ubuntu_noble_amd642024-07-172024-07-0533100.0%
nightly_win_rep2024-07-052024-07-0510110.0%
nightly_win_rel2024-07-182024-07-181417.14%
No reports found!
  • launch_testing_examples.launch_testing_examples.check_node_launch_test.launch_testing_examples.check_node_launch_test
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
Hci__nightly-connext_ubuntu_jammy_amd642024-07-182024-07-1144100.0%
Ici__nightly-connext_ubuntu_jammy_amd642024-07-162024-07-104375.0%
nightly_linux-aarch64_repeated2024-07-112024-07-0913323.08%
nightly_linux_repeated2024-07-172024-07-1610220.0%
nightly_linux-rhel_repeated2024-07-142024-07-141417.14%
No reports found!
  • projectroot.uncrustify
  • projectroot.uncrustify
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
Rci__nightly-performance_ubuntu_noble_amd642024-07-182024-07-0755100.0%
Jci__nightly-performance_ubuntu_noble_amd642024-07-172024-07-0622100.0%
Ici__nightly-performance_ubuntu_jammy_amd642024-07-172024-07-0955100.0%
Hci__nightly-performance_ubuntu_jammy_amd642024-07-162024-07-1233100.0%
No reports found!
  • projectroot.test_publisher
  • projectroot.test_publisher
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd642024-07-172024-07-0533100.0%
Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd642024-07-172024-07-0555100.0%
Ici__nightly-connext_ubuntu_jammy_amd642024-07-162024-07-0944100.0%
nightly_win_rep2024-07-102024-07-1010110.0%
  • https://github.com/ros2/system_tests/issues/496 (Closed)
  • projectroot.test_subscription
  • projectroot.test_subscription
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd642024-07-172024-07-0533100.0%
Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd642024-07-172024-07-0555100.0%
Ici__nightly-connext_ubuntu_jammy_amd642024-07-162024-07-0944100.0%
nightly_win_rep2024-07-172024-07-1010220.0%
nightly_win_rel2024-07-162024-07-161417.14%
No reports found!
  • projectroot.test_generic_pub_sub
  • test_tracetools.test_tracetools.test.test_generic_pub_sub.TestGenericPubSub.test_all
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd642024-07-172024-07-0533100.0%
Jci__nightly-connext_ubuntu_noble_amd642024-07-172024-07-173133.33%
  • https://github.com/ros2/ros2_tracing/issues/124 (Closed)
  • buildfarm_perf_tests.PerformanceTestResults.test_results_CycloneDDS
  • buildfarm_perf_tests.PerformanceTestResults.test_results_CycloneDDS
  • buildfarm_perf_tests.PerformanceTestResults.test_results_CycloneDDS
  • buildfarm_perf_tests.PerformanceTestResults.test_results_CycloneDDS
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
Rci__nightly-performance_ubuntu_noble_amd642024-07-182024-07-075480.0%
Ici__nightly-performance_ubuntu_jammy_amd642024-07-172024-07-095480.0%
Hci__nightly-performance_ubuntu_jammy_amd642024-07-132024-07-123266.67%
Jci__nightly-performance_ubuntu_noble_amd642024-07-172024-07-172150.0%
No reports found!
  • projectroot.test.test_performance_CycloneDDS_sync_Array8m
  • projectroot.test.test_performance_CycloneDDS_sync_Array8m
  • projectroot.test.test_performance_CycloneDDS_sync_Array8m
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
Rci__nightly-performance_ubuntu_noble_amd642024-07-182024-07-075480.0%
Hci__nightly-performance_ubuntu_jammy_amd642024-07-132024-07-123266.67%
Ici__nightly-performance_ubuntu_jammy_amd642024-07-172024-07-115360.0%
Jci__nightly-performance_ubuntu_noble_amd642024-07-172024-07-172150.0%
No reports found!
  • projectroot.test.test_performance_CycloneDDS_sync_PointCloud8m
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
Rci__nightly-performance_ubuntu_noble_amd642024-07-182024-07-075480.0%
Hci__nightly-performance_ubuntu_jammy_amd642024-07-132024-07-123266.67%
Ici__nightly-performance_ubuntu_jammy_amd642024-07-142024-07-095360.0%
No reports found!
  • projectroot.test.rclcpp.test_service_introspection
  • projectroot.test.rclcpp.test_service_introspection
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
Jci__nightly-connext_ubuntu_noble_amd642024-07-142024-07-053266.67%
Rci__nightly-connext_ubuntu_noble_amd642024-07-172024-07-0610550.0%
Ici__nightly-connext_ubuntu_jammy_amd642024-07-162024-07-094250.0%
nightly_win_rel2024-07-182024-07-181417.14%
No reports found!
  • rclcpp.TestServiceIntrospection.service_introspection_enable_disable_events
  • rclcpp.TestServiceIntrospection.service_introspection_enable_disable_events
  • rclcpp.TestServiceIntrospection.service_introspection_enable_disable_events
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
Jci__nightly-connext_ubuntu_noble_amd642024-07-142024-07-053266.67%
Ici__nightly-connext_ubuntu_jammy_amd642024-07-162024-07-094250.0%
Rci__nightly-connext_ubuntu_noble_amd642024-07-172024-07-0610440.0%
nightly_win_rel2024-07-182024-07-181417.14%
No reports found!
  • projectroot.test_client
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
Jci__nightly-connext_ubuntu_noble_amd642024-07-142024-07-053266.67%
Rci__nightly-connext_ubuntu_noble_amd642024-07-172024-07-0610440.0%
nightly_win_rep2024-07-092024-07-0710220.0%
nightly_win_deb2024-07-112024-07-111317.69%
No reports found!
  • rclpy.rclpy.test.test_client.TestClient.test_service_timestamps
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
Jci__nightly-connext_ubuntu_noble_amd642024-07-142024-07-053266.67%
Rci__nightly-connext_ubuntu_noble_amd642024-07-172024-07-0610440.0%
No reports found!
  • ros2topic.ros2topic.test.test_use_sim_time.test_use_sim_time
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
nightly_linux_coverage2024-07-182024-07-0513861.54%
nightly_linux_debug2024-07-132024-07-131119.09%
  • https://github.com/ros2/ros2cli/issues/772 (Closed)
  • rclcpp.TestServiceIntrospection.service_introspection_enable_disable_event_content
  • rclcpp.TestServiceIntrospection.service_introspection_enable_disable_event_content
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
Rci__nightly-connext_ubuntu_noble_amd642024-07-172024-07-0610550.0%
Jci__nightly-connext_ubuntu_noble_amd642024-07-052024-07-053133.33%
Ici__nightly-connext_ubuntu_jammy_amd642024-07-162024-07-164125.0%
nightly_win_rel2024-07-182024-07-181417.14%
No reports found!
  • projectroot.test.rclcpp.test_executors_busy_waiting
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
Rci__nightly-cyclonedds_ubuntu_noble_amd642024-07-102024-07-0611545.45%
nightly_win_rep2024-07-122024-07-0510440.0%
nightly_linux-aarch64_repeated2024-07-062024-07-061317.69%
nightly_win_rel2024-07-182024-07-181417.14%
No reports found!
  • rclcpp.TestBusyWaiting/SingleThreadedExecutor.test_spin_all
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
Rci__nightly-cyclonedds_ubuntu_noble_amd642024-07-102024-07-0611545.45%
Jci__nightly-cyclonedds_ubuntu_noble_amd642024-07-052024-07-053133.33%
nightly_win_rep2024-07-052024-07-0510110.0%
nightly_win_rel2024-07-182024-07-181417.14%
  • https://github.com/ros2/rclcpp/issues/2502 (Closed)
  • projectroot.test.rclcpp.test_clock
  • rclcpp.TestClockWakeup.multiple_threads_wait_on_one_clock
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
nightly_win_rep2024-07-112024-07-0710440.0%
nightly_linux_repeated2024-07-122024-07-0710330.0%
nightly_linux-rhel_repeated2024-07-132024-07-1214214.29%
nightly_win_rel2024-07-182024-07-181417.14%
No reports found!
  • sros2.test.sros2.commands.security.verbs.test_generate_policy.test_generate_policy
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
nightly_win_deb2024-07-122024-07-0513538.46%
nightly_win_rel2024-07-182024-07-0514428.57%
nightly_win_rep2024-07-052024-07-0510110.0%
No reports found!
  • projectroot.tf2_ros_test_message_filter
  • tf2_ros.tf2_ros_test_message_filter.gtest.missing_result
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
Jci__nightly-connext_ubuntu_noble_amd642024-07-172024-07-173133.33%
Rci__nightly-connext_ubuntu_noble_amd642024-07-122024-07-0510330.0%
No reports found!
  • projectroot.test.rclcpp.test_executor
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
nightly_win_rep2024-07-172024-07-0510330.0%
nightly_win_deb2024-07-062024-07-061317.69%
nightly_win_rel2024-07-182024-07-181417.14%
  • https://github.com/ros2/rclcpp/issues/2502 (Closed)
  • projectroot.test_client_scope_cpp__rmw_cyclonedds_cpp
  • test_rclcpp.TestTwoExecutablesAfterShutdown.test_client_scope_cpp
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
nightly_linux_repeated2024-07-172024-07-1010330.0%
nightly_linux-rhel_repeated2024-07-132024-07-131417.14%
No reports found!
  • projectroot.copyright
  • rviz_default_plugins.copyright.xunit.missing_result
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
nightly_win_deb2024-07-182024-07-1213323.08%
No reports found!

Maintenance

Pending

Copy link
Contributor Author

Jul 21

Urgent

Build regressions

Reference Build Failure DateTime Failure Reason
nightly_linux_coverage#2466 2024-07-21 04:00 Early fail
nightly_linux_debug#3124 2024-07-21 04:00 Early fail
nightly_linux_humble_coverage#868 2024-07-21 04:01 Early fail
nightly_linux_iron_coverage#502 2024-07-21 04:01 Early fail
nightly_linux_release#3145 2024-07-21 04:01 Early fail
nightly_linux_repeated#3525 2024-07-21 04:02 Early fail
packaging_linux#3510 2024-07-21 04:02 Early fail
nightly_linux-rhel_repeated#1971 2024-07-21 04:00 Early fail
packaging_linux-rhel#2011 2024-07-21 04:03 Early fail

Test regressions consecutive

Test regressions

Reference build Age Failure DateTime Errors Reports
Hci__nightly-performance_ubuntu_jammy_amd64#246 236 2024-07-19 02:33:12.420000
  • performance_test.lint_cmake.linelength (src/idlgen/opendds/CMakeLists.txt:102)
  • performance_test.lint_cmake.linelength (src/idlgen/opendds/CMakeLists.txt:22)
  • performance_test.lint_cmake.linelength (src/idlgen/opendds/CMakeLists.txt:23)
  • performance_test.uncrustify.src/communication_abstractions/connext_dds_micro_communicator.hpp
No reports found!
Ici__nightly-connext_ubuntu_jammy_amd64#148 148 2024-07-19 06:15:00.326000
  • projectroot.test.rclcpp.test_executors
  • projectroot.test_pub_sub
  • rclcpp.TestClient.client_qos
  • rclcpp.TestIntraprocessExecutors/EventsExecutor.testIntraprocessRetrigger
  • test_tracetools.test_tracetools.test.test_pub_sub.TestPubSub.test_all
  • test_tracetools.test_tracetools.test.test_publisher.TestPublisher.test_all
  • test_tracetools.test_tracetools.test.test_subscription.TestSubscription.test_all
  • https://github.com/ros2/rclcpp/issues/2502 (Closed)
Rci__nightly-connext_ubuntu_noble_amd64#92 92 2024-07-20 14:12:04.439000
  • projectroot.test.rclcpp.test_subscription_topic_statistics
  • rclcpp.TestSubscriptionTopicStatisticsFixture.test_receive_stats_for_message_no_header
  • rclcpp.TestSubscriptionTopicStatisticsFixture.test_receive_stats_include_window_reset
No reports found!
Rci__benchmark_ubuntu_noble_amd64#56 56 2024-07-21 03:08:58.899000
  • projectroot.benchmark_string_conversions
  • projectroot.benchmark_string_conversions
No reports found!
Ici__nightly-connext_ubuntu_jammy_amd64#148 49 2024-07-19 06:15:00.326000
  • launch_testing_ros.test.examples.check_node_launch_test.check_node_launch_test
No reports found!
gz_rendering-8-win#71 43 2024-07-19 19:27:32.266000
  • MeshTest.NormalMapWithoutTexCoord
No reports found!
gz_rendering-7-win#64 36 2024-07-21 01:06:18.052000
  • MeshTest.NormalMapWithoutTexCoord
No reports found!
Jci__nightly-connext_ubuntu_noble_amd64#35 35 2024-07-20 23:00:35.778000
  • projectroot.test.rclcpp.test_subscription_topic_statistics
  • rclcpp.TestSubscriptionTopicStatisticsFixture.test_receive_stats_for_message_no_header
  • rclcpp.TestSubscriptionTopicStatisticsFixture.test_receive_stats_include_window_reset
No reports found!
gz_rendering-main-win#63 34 2024-07-21 03:06:19.669000
  • MeshTest.NormalMapWithoutTexCoord
No reports found!
Rci__nightly-performance_ubuntu_noble_amd64#59 34 2024-07-21 03:17:33.956000
  • performance_test.uncrustify.src/communication_abstractions/connext_dds_micro_communicator.hpp
No reports found!
Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd64#33 33 2024-07-20 09:43:36.477000
  • projectroot.test_generic_pub_sub
  • projectroot.test_generic_subscription
  • projectroot.test_pub_sub
  • test_tracetools.test_tracetools.test.test_generic_pub_sub.TestGenericPubSub.test_all
  • test_tracetools.test_tracetools.test.test_generic_subscription.TestGenericSubscription.test_all
  • test_tracetools.test_tracetools.test.test_pub_sub.TestPubSub.test_all
  • test_tracetools.test_tracetools.test.test_publisher.TestPublisher.test_all
  • test_tracetools.test_tracetools.test.test_subscription.TestSubscription.test_all
  • https://github.com/ros2/ros2_tracing/issues/124 (Closed)
Hci__nightly-connext_ubuntu_jammy_amd64#256 25 2024-07-21 06:15:00.915000
  • launch_testing_examples.launch_testing_examples.check_node_launch_test.launch_testing_examples.check_node_launch_test
  • launch_testing_examples.launch_testing_examples.set_param_launch_test.launch_testing_examples.set_param_launch_test
No reports found!
Jci__benchmark_ubuntu_noble_amd64#20 20 2024-07-20 23:43:07.833000
  • projectroot.benchmark_string_conversions
  • projectroot.benchmark_string_conversions
No reports found!
nightly_linux-aarch64_repeated#2827 15 2024-07-21 04:00:00.958000
  • test_launch_ros.test.test_launch_ros.actions.test_ros_timer.test_timer_uses_sim_time[2-3]
  • test_launch_ros.test.test_launch_ros.actions.test_ros_timer.test_timer_uses_sim_time[3-3]
No reports found!
Hci__nightly-connext_ubuntu_jammy_amd64#256 10 2024-07-21 06:15:00.915000
  • launch_testing_ros.test.examples.check_node_launch_test.check_node_launch_test
No reports found!
nightly_win_rep#3422 9 2024-07-21 04:00:01.342000
  • projectroot.gtest_multithreaded__rmw_connextdds
No reports found!
Jci__nightly-performance_ubuntu_noble_amd64#20 9 2024-07-21 00:24:31.952000
  • performance_test.uncrustify.src/communication_abstractions/connext_dds_micro_communicator.hpp
No reports found!
Rci__nightly-connext_ubuntu_noble_amd64#92 6 2024-07-20 14:12:04.439000
  • projectroot.test.rclcpp.test_service_introspection
  • rclcpp.TestServiceIntrospection.service_introspection_enable_disable_event_content
No reports found!
Hci__nightly-performance_ubuntu_jammy_amd64#246 5 2024-07-19 02:33:12.420000
  • projectroot.lint_cmake
  • projectroot.uncrustify
No reports found!
Rci__nightly-connext_ubuntu_noble_amd64#92 4 2024-07-20 14:12:04.439000
  • rclcpp.TestServiceIntrospection.service_introspection_enable_disable_events
  • rclpy.rclpy.test.test_client.TestClient.test_service_timestamps
No reports found!
Ici__nightly-connext_ubuntu_jammy_amd64#148 4 2024-07-19 06:15:00.326000
  • launch_testing_examples.launch_testing_examples.check_node_launch_test.launch_testing_examples.check_node_launch_test
  • launch_testing_examples.launch_testing_examples.set_param_launch_test.launch_testing_examples.set_param_launch_test
No reports found!
Hci__nightly-connext_ubuntu_jammy_amd64#256 3 2024-07-21 06:15:00.915000
  • projectroot.test_buffer_client_tester.launch.py
  • test_tf2.BufferClientTestAfterShutdown.test_exit_code
No reports found!

Warnings

Reference build Age Failure DateTime Errors Reports
sdformat-ci-main-noble-amd64#20 -1 2024-07-17 20:48:06.890000
  • 8 gcc warnings
No reports found!
nightly_linux-aarch64_release#2800 -1 2024-07-21 04:00:00.953000
  • 1 clang warnings
  • 1 clang-tidy warnings
  • 1 gcc warnings
No reports found!
gz_rendering-main-win#63 -1 2024-07-21 03:06:19.669000
  • 2 msbuild warnings
No reports found!
gz_rendering-8-win#71 -1 2024-07-19 19:27:32.266000
  • 2 msbuild warnings
No reports found!
gz_rendering-7-win#64 -1 2024-07-21 01:06:18.052000
  • 2 msbuild warnings
No reports found!
Rci__nightly-release_ubuntu_noble_amd64#88 -1 2024-07-20 22:07:13.532000
  • 1 clang-tidy warnings
  • 1 gcc warnings
No reports found!
Rci__nightly-performance_ubuntu_noble_amd64#59 -1 2024-07-21 03:17:33.956000
  • 2 clang-tidy warnings
  • 2 cmake warnings
  • 30 gcc warnings
No reports found!
Jci__nightly-release_ubuntu_noble_amd64#34 -1 2024-07-20 13:27:55.774000
  • 1 clang-tidy warnings
  • 1 gcc warnings
No reports found!
Jci__nightly-performance_ubuntu_noble_amd64#20 -1 2024-07-21 00:24:31.952000
  • 2 clang-tidy warnings
  • 2 cmake warnings
  • 30 gcc warnings
No reports found!
Hci__nightly-performance_ubuntu_jammy_amd64#246 -1 2024-07-19 02:33:12.420000
  • 2 clang-tidy warnings
  • 30 gcc warnings
  • 4 cmake warnings
No reports found!

Test regressions flaky

Test regressions

Reference builds Errors Flaky report Reports
  • projectroot.uncrustify
  • projectroot.uncrustify
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
Rci__nightly-performance_ubuntu_noble_amd642024-07-212024-07-0777100.0%
Jci__nightly-performance_ubuntu_noble_amd642024-07-212024-07-0633100.0%
Hci__nightly-performance_ubuntu_jammy_amd642024-07-192024-07-1244100.0%
Ici__nightly-performance_ubuntu_jammy_amd642024-07-172024-07-0955100.0%
No reports found!
  • projectroot.test_publisher
  • projectroot.test_publisher
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd642024-07-202024-07-1433100.0%
Ici__nightly-connext_ubuntu_jammy_amd642024-07-192024-07-0955100.0%
Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd642024-07-172024-07-1044100.0%
nightly_win_rep2024-07-102024-07-101119.09%
  • https://github.com/ros2/system_tests/issues/496 (Closed)
  • projectroot.test_subscription
  • projectroot.test_subscription
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
Jci__nightly-fastrtps-dynamic_ubuntu_noble_amd642024-07-202024-07-1433100.0%
Ici__nightly-connext_ubuntu_jammy_amd642024-07-192024-07-0955100.0%
Ici__nightly-fastrtps-dynamic_ubuntu_jammy_amd642024-07-172024-07-1044100.0%
nightly_win_rep2024-07-172024-07-1011218.18%
nightly_win_rel2024-07-162024-07-161417.14%
No reports found!
  • projectroot.gtest_multithreaded__rmw_connextdds
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
nightly_win_rep2024-07-212024-07-0611981.82%
nightly_win_deb2024-07-212024-07-0614535.71%
nightly_win_rel2024-07-162024-07-0614214.29%
No reports found!
  • test_launch_ros.test.test_launch_ros.actions.test_ros_timer.test_timer_uses_sim_time[2-3]
  • test_launch_ros.test.test_launch_ros.actions.test_ros_timer.test_timer_uses_sim_time[3-3]
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
nightly_linux-aarch64_repeated2024-07-212024-07-09151280.0%
nightly_linux-rhel_repeated2024-07-202024-07-09151280.0%
nightly_win_rep2024-07-212024-07-0911872.73%
nightly_linux_repeated2024-07-182024-07-0910770.0%
No reports found!
  • buildfarm_perf_tests.PerformanceTestResults.test_results_CycloneDDS
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
Ici__nightly-performance_ubuntu_jammy_amd642024-07-172024-07-095480.0%
Rci__nightly-performance_ubuntu_noble_amd642024-07-212024-07-077571.43%
Hci__nightly-performance_ubuntu_jammy_amd642024-07-132024-07-124250.0%
Jci__nightly-performance_ubuntu_noble_amd642024-07-172024-07-173133.33%
No reports found!
  • projectroot.test.test_performance_CycloneDDS_sync_PointCloud8m
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
Rci__nightly-performance_ubuntu_noble_amd642024-07-212024-07-077571.43%
Ici__nightly-performance_ubuntu_jammy_amd642024-07-142024-07-095360.0%
Hci__nightly-performance_ubuntu_jammy_amd642024-07-132024-07-124250.0%
No reports found!
  • projectroot.test_client
  • projectroot.test_client
  • projectroot.test_client
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
Jci__nightly-connext_ubuntu_noble_amd642024-07-202024-07-143266.67%
Rci__nightly-connext_ubuntu_noble_amd642024-07-202024-07-0612758.33%
Hci__nightly-connext_ubuntu_jammy_amd642024-07-212024-07-215120.0%
nightly_win_rep2024-07-092024-07-0711218.18%
nightly_win_deb2024-07-112024-07-111417.14%
No reports found!
  • projectroot.test.rclcpp.test_service_introspection
  • projectroot.test.rclcpp.test_service_introspection
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
Rci__nightly-connext_ubuntu_noble_amd642024-07-202024-07-0612866.67%
Jci__nightly-connext_ubuntu_noble_amd642024-07-202024-07-143266.67%
Ici__nightly-connext_ubuntu_jammy_amd642024-07-192024-07-095360.0%
nightly_win_rel2024-07-182024-07-181417.14%
No reports found!
  • rclcpp.TestServiceIntrospection.service_introspection_enable_disable_event_content
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
Rci__nightly-connext_ubuntu_noble_amd642024-07-202024-07-0612866.67%
Jci__nightly-connext_ubuntu_noble_amd642024-07-202024-07-203133.33%
Ici__nightly-connext_ubuntu_jammy_amd642024-07-162024-07-165120.0%
nightly_win_rel2024-07-182024-07-181417.14%
No reports found!
  • rclcpp.TestServiceIntrospection.service_introspection_enable_disable_events
  • rclcpp.TestServiceIntrospection.service_introspection_enable_disable_events
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
Jci__nightly-connext_ubuntu_noble_amd642024-07-202024-07-143266.67%
Ici__nightly-connext_ubuntu_jammy_amd642024-07-192024-07-095360.0%
Rci__nightly-connext_ubuntu_noble_amd642024-07-202024-07-0612758.33%
nightly_win_rel2024-07-182024-07-181417.14%
No reports found!
  • rclpy.rclpy.test.test_client.TestClient.test_service_timestamps
  • rclpy.rclpy.test.test_client.TestClient.test_service_timestamps
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
Jci__nightly-connext_ubuntu_noble_amd642024-07-202024-07-143266.67%
Rci__nightly-connext_ubuntu_noble_amd642024-07-202024-07-0612758.33%
Hci__nightly-connext_ubuntu_jammy_amd642024-07-212024-07-215120.0%
No reports found!
  • test_tf2.BufferClientTestAfterShutdown.test_exit_code
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
Hci__nightly-connext_ubuntu_jammy_amd642024-07-212024-07-155360.0%
Ici__nightly-connext_ubuntu_jammy_amd642024-07-102024-07-095240.0%
No reports found!
  • test_rclcpp.gtest_multithreaded__rmw_connextdds.gtest.missing_result
  • test_rclcpp.gtest_multithreaded__rmw_connextdds.gtest.missing_result
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
nightly_win_rep2024-07-212024-07-0611654.55%
nightly_win_deb2024-07-212024-07-0614535.71%
nightly_win_rel2024-07-062024-07-061417.14%
No reports found!
  • projectroot.test_tutorial_use_logger_service__rmw_connextdds
  • projectroot.test_tutorial_use_logger_service__rmw_connextdds
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
nightly_win_deb2024-07-212024-07-0614535.71%
nightly_win_rep2024-07-212024-07-211119.09%
No reports found!
  • projectroot.copyright
  • rviz_default_plugins.copyright.xunit.missing_result
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
nightly_win_deb2024-07-212024-07-1214428.57%
No reports found!
  • projectroot.test.rclcpp.test_executor
Job NameLast FailFirst FailBuild CountFailure CountFailure Percentage
nightly_win_rep2024-07-212024-07-0711327.27%
nightly_win_rel2024-07-182024-07-181417.14%
nightly_win_deb2024-07-062024-07-061417.14%
  • https://github.com/ros2/rclcpp/issues/2502 (Closed)

Maintenance

Pending

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
buildfarmer-log Log of issues in the buildfarm
Projects
None yet
Development

No branches or pull requests

3 participants