Code

Added Unit Tests for CI Codes#2581

Code

Closed

TerrenceMcGuinness-NOAA wants to merge 174 commits intoNOAA-EMC:developNOAA-EMC/global-workflow:developfrom TerrenceMcGuinness-NOAA:ci_unit-testsTerrenceMcGuinness-NOAA/global-workflow:ci_unit-testsCopy head branch name to clipboard

+292-3

Commits

Commits on May 6, 2024

• added development Jenkninsfile for dispatching from GitHub Actions

  

  tmcguinness

  committed
  a62a9f0

Commits on May 8, 2024

• Merge branch 'NOAA-EMC:develop' into feature/jenkins-dispatch

  TerrenceMcGuinness-NOAA

  authored
  959edf5

• updated method for counting status cases from rocotostat

  

  tmcguinness

  committed
  002c985

• started a unit test for rocotostat

  

  tmcguinness

  committed
  0243294

• added more moc args

  

  tmcguinness

  committed
  233c614

• updated third arg to moc

  

  tmcguinness

  committed
  eb3589c

• removed moc stuff from test

  

  tmcguinness

  committed
  060f2a8

• added data for unit testing rocotostat

  

  Terry McGuinness

  committed
  2f9662d

• moved tests dir for ci unit tests under scripts

  

  tmcguinness

  committed
  b01504d

• added ci unit tests using pytest

  

  tmcguinness

  committed
  a6508f5

• chris H has install.h spelled INSTALL

  

  tmcguinness

  committed
  ce9af99

• added path to rocotostat in GitHub runner

  

  tmcguinness

  committed
  060aed6

• added path relative to sript for input data

  

  tmcguinness

  committed
  336cbc4

• did not put in path for artifacts on success to unittess

  

  tmcguinness

  committed
  0a3561d

• details for artifacts and new actions file

  

  tmcguinness

  committed
  c36ef99

• syntax errors in ci unit tests actions yaml file

  

  tmcguinness

  committed
  4e89645

• added report in UI

  

  tmcguinness

  committed
  c59c997

• trying another reportor

  

  tmcguinness

  committed
  cb3c3e5

• needed update permitions for report

  

  tmcguinness

  committed
  2dfe779

• added conclution to pytest ci

  

  tmcguinness

  committed
  ed29a28

• indetation error in ci-pyunit acdtion file

  

  tmcguinness

  committed
  b22801a

• removed conclution in messages

  

  tmcguinness

  committed
  f868628

• job_summary did not work

  

  tmcguinness

  committed
  dfdcf7a

• more publish and config report

  

  tmcguinness

  committed
  ca60b13

• more publish and config report path update

  

  tmcguinness

  committed
  c29acdf

• added full path to xml output

  

  tmcguinness

  committed
  74fe7ee

• needed space for name

  

  tmcguinness

  committed
  10b0489

• needed space for name

  

  tmcguinness

  committed
  58ad853

• had name wrong was file name up upload

  

  tmcguinness

  committed
  ca985a2

• took out upload

  

  tmcguinness

  committed
  316d2ee

• added docstrings to functions

  

  tmcguinness

  committed
  0cb4a6d

• removing Jenkins dispatch file

  

  tmcguinness

  committed
  2534fed

• added verbose in the pytest argument to list each test

  

  tmcguinness

  committed
  89d6058

Commits on May 9, 2024

• Merge branch 'NOAA-EMC:develop' into ci_unit-tests

  TerrenceMcGuinness-NOAA

  authored
  100c893

Commits on May 10, 2024

• Merge branch 'NOAA-EMC:develop' into ci_unit-tests

  TerrenceMcGuinness-NOAA

  authored
  d540011

• moved test data specfic to rocotostat tests in test directory and neutered XML file

  

  tmcguinness

  committed
  a53445b

• Merge branch 'ci_unit-tests' of github.com:TerrenceMcGuinness-NOAA/global-workflow into ci_unit-tests

  

  tmcguinness

  committed
  6fc76b2

• cashed install of Rocoto in actions runner

  

  tmcguinness

  committed
  eafc6cc

• update cashe action to version 4

  

  tmcguinness

  committed
  6ed8e71

• added test data for rocotocheck stalled case

  

  Terry McGuinness

  committed
  e81512b

• added stalled and done as functions and added two more unit tests for each in rocotostatus

  

  tmcguinness

  committed
  14b1622

• added doctrings to new functions in rocotstat

  

  tmcguinness

  committed
  5901d51

• updated pynorm spaces

  

  tmcguinness

  committed
  9fe4f62

• do not need to assert is set to true, it just is

  

  tmcguinness

  committed
  2f3cd87

• Merge pull request #286 from TerrenceMcGuinness-NOAA/ci_unit-tests_stalled

  Show description for 9bb3b24
  TerrenceMcGuinness-NOAA

  authored
  9bb3b24

• cashe after intall or Rocoto silly

  

  tmcguinness

  committed
  7f7f705

Commits on May 13, 2024

• Merge branch 'ci_unit-tests' of github.com:TerrenceMcGuinness-NOAA/global-workflow into ci_unit-tests

  

  tmcguinness

  committed
  b201a6e

• removded all rocoto test data and put them in S3 bucket and have them downloaded using curl when not present

  

  tmcguinness

  committed
  4566503

• fix pynorms and install wget in runner to download test data

  

  tmcguinness

  committed
  2ad0c1c

• removed stub files and added .gitkeep and correspondingly update uint test

  

  tmcguinness

  committed
  6659215

• pycodestyle indenetation fix

  

  tmcguinness

  committed
  33de358

• cd into the ci test dir and run pytest there to resolve paths correctly

  

  tmcguinness

  committed
  2b4e774

• update path to test results for them to be published

  

  tmcguinness

  committed
  12ee2db

• put in full path to test resultes because the weill not read and moved cashe save off of Rotoco to after it is installed

  

  tmcguinness

  committed
  73b0f11

• trying to debug output test results xml file

  

  tmcguinness

  committed
  0fc0ec8

• using relative path in Pub reslutes and updated test for cashed Rocoto install

  

  tmcguinness

  committed
  4ed0fa6

• the cached section has to come before the install of Rocoto because it also servese as the restore set

  

  tmcguinness

  committed
  7282787

• moved Cache to before install of Rocoto because it had a duel purpose of restoring caches that have been created

  

  tmcguinness

  committed
  b63adea

Commits on May 14, 2024

• Update .github/workflows/ci-unit_tests.yaml

  Show description for 92971b0
  

  TerrenceMcGuinness-NOAA

  and

  WalterKolczynski-NOAA

  authored
  92971b0

• Update .github/workflows/ci-unit_tests.yaml

  Show description for 8c5dbd6
  

  TerrenceMcGuinness-NOAA

  and

  WalterKolczynski-NOAA

  authored
  8c5dbd6

• removed caps in docstrings and testing write permissions to pr in actions

  

  tmcguinness

  committed
  0d68041

• made deep copies of objects in calls to --all and --summary are distinct and only -w ane -d are re-used

  

  tmcguinness

  committed
  6425410

Commits on May 15, 2024

• Update .github/workflows/ci-unit_tests.yaml

  Show description for b5cbcda
  

  TerrenceMcGuinness-NOAA

  and

  WalterKolczynski-NOAA

  authored
  b5cbcda

Commits on May 20, 2024

• Update .github/workflows/ci-unit_tests.yaml

  Show description for 4ae1854
  

  TerrenceMcGuinness-NOAA

  and

  WalterKolczynski-NOAA

  authored
  4ae1854

Commits on May 21, 2024

• added a attempt_multiple_times routine to the python rocotostat utility for robustness

  

  tmcguinness

  committed
  fc7549e

• it is workflow_dispatch not dispatch

  

  tmcguinness

  committed
  e6ad4fa

Commits on May 29, 2024

• merged develop

  

  tmcguinness

  committed
  9581a14

• merged in changes to rocoto check from develop

  

  tmcguinness

  committed
  9ee2e6a

• added docstring to attempt_multiple_times in the rocoso stat code

  

  tmcguinness

  committed
  656eb92

• use wxflow on disk and added link_workflow and removed pip install wxflow

  

  tmcguinness

  committed
  2adbcac

• misspelled link_workflow.sh

  

  tmcguinness

  committed
  d5f4103

• add link up wxflow because virt env was not current

  

  tmcguinness

  committed
  553404b

• moved making of wxflow links into test section

  

  tmcguinness

  committed
  05797cd

• removed pytest junit install

  

  tmcguinness

  committed
  2cc2fe2

• added PYTHONPATH for tests

  

  tmcguinness

  committed
  7407f4e

• added redundent wxflow as a pip install

  

  tmcguinness

  committed
  a9de59d

• no comma seperator in pip install

  

  tmcguinness

  committed
  1363144

• pip install wxflow from develop branch

  

  tmcguinness

  committed
  242f8b7

Commits on May 30, 2024

• Merge branch 'develop' into ci_unit-tests

  

  tmcguinness

  committed
  bd7ca33

• added unit test to test setup_expt and setup_xml

  

  tmcguinness

  committed
  5dc1dc9

• added /work/noaa dir on running to make pass Host() as oroin

  

  terrance.mcguinness

  committed
  e81e260

• remove env from setup xml

  

  tmcguinness

  committed
  6fd980d

• Merge branch 'ci_unit-tests' of github.com:TerrenceMcGuinness-NOAA/global-workflow into ci_unit-tests

  

  tmcguinness

  committed
  62576d6

• pynorms and unset EXPDR in runner shell

  

  tmcguinness

  committed
  b3dff2c

• added more pynorms

  

  tmcguinness

  committed
  c7809b4

• shortend path to PSLOT

  

  tmcguinness

  committed
  28278ba

• removed push and made full paths to test data for tesgint setups

  

  tmcguinness

  committed
  b20137b

• trying to remove EXPDIR from env

  

  tmcguinness

  committed
  06ef59e

• trying to remove EXPDIR from runner env

  

  tmcguinness

  committed
  01d2295

• added wxflow update to runner for test setups

  

  tmcguinness

  committed
  848e220

• Update ci/scripts/utils/rocotostat.py

  Show description for 2f7f1a2
  

  TerrenceMcGuinness-NOAA

  and

  WalterKolczynski-NOAA

  authored
  2f7f1a2

• Update ci/scripts/utils/rocotostat.py

  Show description for f90eab1
  

  TerrenceMcGuinness-NOAA

  and

  WalterKolczynski-NOAA

  authored
  f90eab1

• use updated wxflow config in this test pr

  

  tmcguinness

  committed
  f0c907a

• Merge branch 'ci_unit-tests' of github.com:TerrenceMcGuinness-NOAA/global-workflow into ci_unit-tests

  

  tmcguinness

  committed
  c432eda

• added ACCOUT to env for testing updates

  

  tmcguinness

  committed
  1aa135c

• checklut output from setup exp in runner

  

  tmcguinness

  committed
  cfc85d7

Commits on May 31, 2024

• echo EXPDIR and cat config.bas in runner

  

  tmcguinness

  committed
  d4d3933

• cleaned up path to RUNDIR data to PSLOT

  

  tmcguinness

  committed
  fc44f85

• made one function and added a pause just to see if it is ot on dixk yet or wtf

  

  tmcguinness

  committed
  bb76df3

• added debug outputs in setup xml

  

  tmcguinness

  committed
  4132ee9

• use develop wxflow

  

  tmcguinness

  committed
  99f9ada

• narrowing in on issue that we are not getting base with my update

  

  tmcguinness

  committed
  30b074d

• more dubugging outputs

  

  tmcguinness

  committed
  4100aad

• more dubugging outputs againZ

  

  tmcguinness

  committed
  46d52bf

• test if EXPDIR is in base

  

  tmcguinness

  committed
  eba677e

• added checkout of wxflow and running lit link on the runner

  

  tmcguinness

  committed
  e846040

• misspelled update in git command

  

  tmcguinness

  committed
  788ef8c

• needed ./ for runnign link in sorc

  

  tmcguinness

  committed
  b9cb187

• add checkout of gfs_utils for detect machine

  

  tmcguinness

  committed
  ada04dd

• added extra ln for wxflow import in test dir

  

  tmcguinness

  committed
  2d01f6a

• added the pip intall bit for wxflow from forked branch with updates for xor

  

  tmcguinness

  committed
  7ca0a7a

• did a full init submodule in the runner

  

  tmcguinness

  committed
  366c381

• print config object in setup xml on running

  

  tmcguinness

  committed
  257c033

• revert to wxflow develop and pip install wxflow

  

  tmcguinness

  committed
  3502963

• mud hurling with python 3.7.16 and bash in runner

  

  tmcguinness

  committed
  205d367

• add directive to use bash in running tests in runner

  

  tmcguinness

  committed
  07f9c31

• comment out setup xml line

  

  tmcguinness

  committed
  8285280

• remove extra clons and python leader to exp code

  

  tmcguinness

  committed
  f45caca

• trying to submodule only wxflow and gsi_utils

  

  tmcguinness

  committed
  b457a9f

• added code for bash in config

  

  tmcguinness

  committed
  e1b4907

• updated pip clone from forked wxflow and removed some smack

  

  tmcguinness

  committed
  a3ff0b6

• restored setup xml

  

  tmcguinness

  committed
  5c726dd

• condenced the test themselfs

  

  tmcguinness

  committed
  75f44b4

• just removed line for extra var to setup_expt

  

  tmcguinness

  committed
  1cad3a2

• updated HPC_ACCOUNT to ACCOUNT in bash config of ci platforms to test updates to wxflow configuration.py

  

  tmcguinness

  committed
  92d2208

• Delete ci/scripts/tests/wxflow

  Show description for 08b7b9f
  TerrenceMcGuinness-NOAA

  authored
  08b7b9f

Commits on Jun 3, 2024

• Merge branch 'develop' into ci_unit-tests

  

  tmcguinness

  committed
  e48fedd

Commits on Jun 4, 2024

• added addtional check to make sure the Configure object is getting popululated correctly after config parms are in place

  

  tmcguinness

  committed
  65343f9

Commits on Jun 5, 2024

• added more details to testing Configuration updates and consolidation of paths

  

  tmcguinness

  committed
  3c9bb58

• few shell norms

  

  tmcguinness

  committed
  c7282dc

• pynorm spaces in test codes

  

  tmcguinness

  committed
  c1adce8

• moved shell script that performs the export to the test code and added a check for the users value not in the parm

  

  tmcguinness

  committed
  3e256dc

• single pynorm white space

  

  tmcguinness

  committed
  55c28f4

• added HOMEgfs and checked for no UNKNOWN

  

  tmcguinness

  committed
  d0bfa61

• removed {} from script string

  

  tmcguinness

  committed
  df915d4

• removed gsi_utils from Runner

  

  tmcguinness

  committed
  1387d78

• did not need detect machine in gsi utils

  

  tmcguinness

  committed
  5da70e4

• udate wxflow updates to the PR

  

  tmcguinness

  committed
  b7eeae8

Commits on Jun 6, 2024

• hardened the test to include the corner case when a user sets an enviroment varialble to the same value that is the par name space

  

  tmcguinness

  committed
  526e6f4

• update to latest update of configuration.py in wxflow (using grep for KEY= in parm files)

  

  tmcguinness

  committed
  494690d

Commits on Jun 11, 2024

• Merge branch 'NOAA-EMC:develop' into ci_unit-tests

  TerrenceMcGuinness-NOAA

  authored
  d30d11f

Commits on Jun 24, 2024

• Merge branch 'NOAA-EMC:develop' into ci_unit-tests

  TerrenceMcGuinness-NOAA

  authored
  4e882f7

• added fix to rocotostat for stalled case and remove dependances to updates to wxflow

  

  Terry McGuinness

  committed
  fc15469

• update to current gitmodules without wxflow updates

  

  Terry McGuinness

  committed
  892ece9

• update to default wxflow

  

  Terry McGuinness

  committed
  236e5f6

• needed pynorms space after :

  

  Terry McGuinness

  committed
  f553a33

• still need to do the pip install of wxflow to get all the Jinja stuff too

  

  Terry McGuinness

  committed
  9d329bb

Commits on Jun 25, 2024

• Merge branch 'NOAA-EMC:develop' into ci_unit-tests

  TerrenceMcGuinness-NOAA

  authored
  371d532

• Update ci/scripts/tests/test_setup.py

  Show description for 8b527c8
  

  TerrenceMcGuinness-NOAA

  and

  aerorahul

  authored
  8b527c8

• Update ci/scripts/tests/test_setup.py

  Show description for acc8d3c
  

  TerrenceMcGuinness-NOAA

  and

  aerorahul

  authored
  acc8d3c

• updated to python wget and renamed github action control file

  

  tmcguinness

  committed
  6bcc3b5

• removed other yaml action file

  

  tmcguinness

  committed
  8d638ee

• added mkdir -p to full path to testdata

  

  Terry.McGuinness

  authored and

  Terry.McGuinness

  committed
  fd4aa91

• updated python install in runner to 3.13.0

  

  tmcguinness

  committed
  fab6843

• updated python install in runner to 3.12.3 for x64 Ubu

  

  tmcguinness

  committed
  c511207

• updated pytest to version 8.2.2

  

  tmcguinness

  committed
  c25dda8

• removed verson of pytest got get latest for pythohn 3.13.3

  

  tmcguinness

  committed
  6d3a462

• removed verson of wxflow

  

  tmcguinness

  committed
  c52bfc2

• downgraded to python 3.11.8 because distutils was depretiated from 3.12

  

  tmcguinness

  committed
  dd5e58c

• took out shell wrapper that was exporting env vars

  

  tmcguinness

  committed
  01bc144

• added extra subdir for pysdo hera file system

  

  Terry McGuinness

  committed
  f59819d

• investigating EXPDIR

  

  Terry McGuinness

  committed
  7102f0d

• investigating EXPDIR

  

  Terry McGuinness

  committed
  7c14d55

• still trying to debug EXPDIR key error

  

  Terry McGuinness

  committed
  1f599e3

• still trying to debug EXPDIR key error still

  

  Terry McGuinness

  committed
  d2db0be

• adding in the other tests

  

  Terry McGuinness

  committed
  7965a9b

• adding in the other tests crap

  

  Terry McGuinness

  committed
  e18ee96

• outputing EXPDIR before running Config in setup xml

  

  Terry McGuinness

  committed
  8b8fe34

• outputing EXPDIR before running Config in setup xml 2

  

  Terry McGuinness

  committed
  2b3a122

• tring env unclaching wxflow repo to see if it is solving the EXPDIR problem with setup_xml

  

  Terry McGuinness

  committed
  f6d5dd6

• try test with updated wxflow (if works then get to that fix)

  

  Terry McGuinness

  committed
  69b226e

Commits on Jun 26, 2024

• added corner case for checking expected fail for when name snapces are irreconcilable when set to same vaule in config file

  

  Terry McGuinness

  committed
  5300dc2

• Merge branch 'NOAA-EMC:develop' into ci_unit-tests

  TerrenceMcGuinness-NOAA

  authored
  c5b6386

Commits on Jun 27, 2024

• Merge branch 'NOAA-EMC:develop' into ci_unit-tests

  TerrenceMcGuinness-NOAA

  authored
  f513eeb