Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Generate list of test report #2

Open
cconcolato opened this issue May 12, 2023 · 3 comments
Open

Generate list of test report #2

cconcolato opened this issue May 12, 2023 · 3 comments
Labels
documentation Improvements or additions to documentation

Comments

@cconcolato
Copy link

It would be good to generate an HTML report listing all the tests (filename, human description, is valid or not...) maybe in the form of a table. That report could be generated automatically whenever a PR is merged and published on GitHub pages. That would offer a synthesis of what is tested.
@yeroro yeroro added the documentation Improvements or additions to documentation label May 15, 2023
jwcullen referenced this issue in jwcullen/libiamf Jun 16, 2023
@jwcullen
Include two CSV dumps of test vector metadata (related #16).
d10b655 
  - Add coverage.csv which shows which sections are covered by which test vectors.
  - Add test_summary.csv which is a dump of several human readable fields for test vectors.
  - Using GitHub workflows to automatically generate this is deferred for a future PR.
@jwcullen
Copy link
Collaborator

jwcullen commented Aug 2, 2023

We have test_summary.csv and coverage.csv report. Still outstanding is generating this when PRs are merged in.

@sunghee-hwang
Copy link

@jwcullen @yeroro @yilun-zhangs,
is it still an open issue or was it already addressed?

@jwcullen
Copy link
Collaborator

I added a label to postpone this. We have these reports published, but ideally they would be automatically generated when a PR is merged.

@jwcullen jwcullen transferred this issue from AOMediaCodec/libiamf Jan 30, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
documentation Improvements or additions to documentation
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@cconcolato @jwcullen @yeroro @sunghee-hwang