Skip to content

Commit

Permalink
test: add script to test all implementations
Browse files Browse the repository at this point in the history
The script tests all implementations and prints PASS or FAIL status.
In case of failure it also prints implementation output to stderr.

This will be handy for adding new test samples.

Show test statuses and omit failing output:
```sh
$ ./test_all.sh 2>/dev/null
PASS artsiomkorzun
PASS baseline
PASS bjhara
PASS criccomini
FAIL ddimtirov
FAIL ebarlas
PASS filiphr
FAIL itaske
PASS khmarbaise
FAIL kuduwa-keshavram
FAIL lawrey
PASS padreati
FAIL palmr
PASS richardstartin
FAIL royvanrijn
FAIL seijikun
PASS spullara
PASS truelive
```

Show only passing implementations:
```
$ ./test_all.sh 2>/dev/null | grep PASS | cut -d' ' -f2
artsiomkorzun
baseline
bjhara
criccomini
filiphr
khmarbaise
padreati
richardstartin
spullara
truelive
```

For #61
  • Loading branch information
AlexanderYastrebov committed Jan 4, 2024
1 parent 0c59483 commit 0d4d8c0
Show file tree
Hide file tree
Showing 3 changed files with 37 additions and 10 deletions.
Empty file modified calculate_average_ddimtirov.sh
100644 → 100755
Empty file.
17 changes: 7 additions & 10 deletions test.sh
Original file line number Diff line number Diff line change
Expand Up @@ -15,19 +15,16 @@
# limitations under the License.
#

if [ -z "$1" ]
then
echo "Usage: test.sh <fork name>"
exit 1
fi

java --version
set -euo pipefail

mvn clean verify
if [ -z "$1" ]; then
echo "Usage: test.sh <fork name>"
exit 1
fi

for sample in $(ls src/test/resources/samples/*.txt)
do
for sample in $(ls src/test/resources/samples/*.txt); do
echo "Validating calculate_average_$1.sh -- $sample"

rm -f measurements.txt
ln -s $sample measurements.txt

Expand Down
30 changes: 30 additions & 0 deletions test_all.sh
Original file line number Diff line number Diff line change
@@ -0,0 +1,30 @@
#!/bin/bash
#
# Copyright 2023 The original authors
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#

set -euo pipefail

for impl in $(ls calculate_average_*.sh | sort); do
noext="${impl%%.sh}"
name=${noext##calculate_average_}

if output=$(./test.sh "$name" 2>&1); then
echo "PASS $name"
else
echo "FAIL $name"
echo "$output" 1>&2
fi
done

0 comments on commit 0d4d8c0

Please sign in to comment.