Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

no comment on PRs when using v5 #1662

Open
ReenigneArcher opened this issue Nov 16, 2024 · 57 comments
Open

no comment on PRs when using v5 #1662

ReenigneArcher opened this issue Nov 16, 2024 · 57 comments
Assignees
Labels
Area: Report Upload Issues with pre-ingest report uploading bug Something isn't working Urgent Urgent Issues

Comments

@jwillemsen
Copy link

Same happening for me for jwillemsen/daikin_onecta#350

@jrfnl
Copy link

jrfnl commented Nov 18, 2024

I can confirm as well, though we have comments turned off, but the status check is also not reporting in.

What I expect to see:
Image

And the statuses just never show up.

On repos where branch protection is being used and the statuses are required for merging, this now means merging PRs would be blocked:
Image

I think this issue needs the "Priority: high" label.

@dashdanw
Copy link

Just to mention, experiencing the same issues here. Have verified that the conditions are identical between instances which use @v4 and report status badge + comments, where upgrading to @v5 no longer creates either.

@thomasrockhu-codecov thomasrockhu-codecov self-assigned this Nov 19, 2024
@thomasrockhu-codecov thomasrockhu-codecov added Urgent Urgent Issues bug Something isn't working Area: Notifications Issues with notifications Area: Report Upload Issues with pre-ingest report uploading and removed bug Something isn't working Area: Notifications Issues with notifications Urgent Urgent Issues labels Nov 19, 2024
@yanyongyu
Copy link

Same issue for me and i check the codecov upload files in the website page, there is nothing uploaded. (action log says upload complete)

@thomasrockhu-codecov
Copy link
Contributor

Got it, sorry this is taking so long. I'm going to try to fix tomorrow morning.

@dashdanw
Copy link

@thomasrockhu-codecov thanks for your work

@thomasrockhu-codecov
Copy link
Contributor

thomasrockhu-codecov commented Nov 20, 2024

@ReenigneArcher @jwillemsen @jrfnl @dashdanw @yanyongyu @wbaldoumas

ok, I released 5.0.4, would you be able to see if that fixes the issue?

@wbaldoumas
Copy link

@thomasrockhu-codecov upgraded to v5.0.4, but it doesn't look like it resolved things: wbaldoumas/markdown-colorcode#174

@ReenigneArcher
Copy link
Contributor Author

@thomasrockhu-codecov unfortunately, there is still no PR comment with v5.0.4 LizardByte/libdisplaydevice#124

@HarelM
Copy link

HarelM commented Nov 21, 2024

My experience is different in maplibre-gl-js.
I've enabled tokenless upload but still didn't get a PR comment.
I enabled the codecov app on the repo and the comments returned, but when I disable the codecov app the comments stopped.
The codecov app is creating noise in the CI checks section, so I prefer to remove it if possible, the PR comment is sufficient for my need.
Here's a PR where upload did not fail but there was no PR comment:
maplibre/maplibre-gl-js#5074
Run details:
https://github.com/maplibre/maplibre-gl-js/actions/runs/11923312553/job/33231425376

@yanyongyu
Copy link

do you have a link to CI you can share?

sure. it's nonebot/nonebot2#3119

@thomasrockhu-codecov
Copy link
Contributor

@yanyongyu I'm a little confused, it looks like you are getting a PR comment on that link.

@thomasrockhu-codecov
Copy link
Contributor

@HarelM got it, that looks like an older version of the Action which probably means that the fixes we put in haven't hit. Are you still experiencing this issue?

@yanyongyu
Copy link

@yanyongyu I'm a little confused, it looks like you are getting a PR comment on that link.

i just turn the token authentication option to not required, rerun the action, the upload and comment is success now.

@HarelM
Copy link

HarelM commented Nov 21, 2024

@thomasrockhu-codecov I just opened a PR to test if I get a comment if the app is disabled, and it didn't oost a comment:
See here:

So I don't think it uses an older version.
You can let us know when to disable the app if you want to do some tests.
In any case we'll enable it again until this is solved.

@thomasrockhu-codecov
Copy link
Contributor

@HarelM just curious what you meant by disable the app, digging into this

@thomasrockhu-codecov
Copy link
Contributor

@HarelM if you mean the Codecov app, yeah it actually looks like something is going wrong with permissions. Can you uninstall the Codecov app and re-install it? Aside from that, everything looks fine to me.

@HarelM
Copy link

HarelM commented Nov 21, 2024

When I uninstall it, the comment does not appear. This wasn't the case for version 4.
I do not want it installed, or need it (it marks build as failing, which I'm sure I can configure, but lack the motivation to do so),
but I do need and want the coverage comment.

@thomasrockhu-codecov
Copy link
Contributor

thomasrockhu-codecov commented Nov 21, 2024

@HarelM hmmm, I don't think you will be able to get notification from Codecov without the app installed. Can you show me a screenshot specifically of what you mean by what you are install/uninstalling so that there's not a miscommunication?

And as far marking a build as failing, what do you mean by that? Is there a specific Codecov status check that fails or something else?

@dashdanw
Copy link

@wbaldoumas @jwillemsen @jrfnl @dashdanw @yanyongyu, ok, I think there was an issue on our backend with a different race condition. Thanks for the patience and all the retries, and would you mind seeing if it works for you now?

Ran once which failed, received an alert on the CodeCov link generated in the output when uploading that I needed to create a new commit, did so by rebasing via main and it worked!

Thank you

@HarelM
Copy link

HarelM commented Nov 21, 2024

@thomasrockhu-codecov the following is the configuration in the org level, I mean install/uninstall when adding or removing the relevant repository from the list (in the following image it is installed on maplibre-gl-js, and other two repos):
Image

Here's an example where the app was working, but the build is marked as "red" (red x at the top), while I consider this build a success (if the app report was not part of the "CI runs" it would have been green)
maplibre/maplibre-gl-js#5092

I've been in contact with the codecov team in the past, so you have my mail and personal info, if anything is not clear with the experience I'm trying to explain please reach out.

The bottom line from my point of view is that version 4 worked as desired and there's a problem with version 5. If this is intentional and you want to nudge people to install the app this is totally acceptable, but it's not written anywhere as far I can see, so I'm expecting the version 4 behavior to remain from my developer experience.

@wbaldoumas
Copy link

@thomasrockhu-codecov this appears to be resolved in my https://github.com/wbaldoumas/markdown-colorcode repository. Re-run worked fine today on v5. Thank you for all of your work!

@yanyongyu
Copy link

yanyongyu commented Nov 28, 2024

Hi, i have another pr without comment now. nonebot/adapter-onebot#121

I have tried to re-run the actions, the uploads are all successfull. The upload files can also be found at the webpage, but there is no comment. I have also tried to re-installed the codecov app.
Image

@thomasrockhu-codecov
Copy link
Contributor

@yanyongyu hmmm, I'm not sure about this one. I'm seeing a No app found error on our backend, so I would have assumed it was something wrong with the GitHub app install. I need to ask the product team about what's going on there

@thomasrockhu-codecov
Copy link
Contributor

thomasrockhu-codecov commented Dec 6, 2024

@yanyongyu are you able to do a @dependabot rebase? We think there was a timing issue for this. Are you seeing this in any other recent PRs?

@yanyongyu
Copy link

yanyongyu commented Dec 6, 2024

are you able to do a @dependabot rebase?

i have rebase the pr and get the comment now. 👍🏻

Are you seeing this in any other recent PRs?

No. I only found issue in this pr. All other prs are ok.

@thomasrockhu-codecov
Copy link
Contributor

@yanyongyu ok you should be good for now then

@HarelM
Copy link

HarelM commented Dec 6, 2024

@thomasrockhu-codecov was everything changed in order to solve this issue?
When I upgraded to codecov 5 I needed to install the codecov app to get PR comments, is this solved now?

@thomasrockhu-codecov
Copy link
Contributor

thomasrockhu-codecov commented Dec 6, 2024

@HarelM sorry I lost that thread. I need to investigate your instance in particular.

One note, it is possible to turn off the status checks from Codecov so that you only get a comment by setting that in the codecov.yml file

@HarelM
Copy link

HarelM commented Dec 6, 2024

Yeah... I don't have a codecov.yml file, I use the action only... :-)

@thomasrockhu-codecov
Copy link
Contributor

@HarelM got it, if you're open to PRs I'll write one up early next week

@HarelM
Copy link

HarelM commented Dec 7, 2024

Sure, feel free to use malibre-gl-js for testing. Just make sure to open draft PRs and have a good title so I'd know to ignore it.

@HarelM
Copy link

HarelM commented Dec 9, 2024

I've ask an org admin to uninstall the app and I don't get comments, so the issue here still exists.
The following is the relevant PR:
maplibre/maplibre-gl-js#5167

I'll ask her to install the app back as I need these comments.

@stefanofusai
Copy link

Also experiencing the same issue (status checks not reporting and PR's not being commented) as noted in #1712

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Area: Report Upload Issues with pre-ingest report uploading bug Something isn't working Urgent Urgent Issues
Projects
None yet
Development

No branches or pull requests

9 participants