Skip to content
This repository has been archived by the owner on Jul 24, 2024. It is now read-only.

Create reviewer folder to add files #9

Open
wants to merge 13 commits into
base: main
Choose a base branch
from
5 changes: 5 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,3 +4,8 @@ Public-facing policies, procedures, and documentation around running the OLS pro
Note that certain documetnation (such as passwords and authentication credentials) and internal OLS business processes that could be deemed private or business-specific (e.g. how payroll is processed) should not be uploaded into this repository.

<a rel="license" href="http://creativecommons.org/licenses/by/4.0/"><img alt="Creative Commons License" style="border-width:0" src="https://i.creativecommons.org/l/by/4.0/88x31.png" /></a><br />This work is licensed under a <a rel="license" href="http://creativecommons.org/licenses/by/4.0/">Creative Commons Attribution 4.0 International License</a>.

![RSE Asia image](figures/rse-community.jpg)

Title for the image

1 change: 1 addition & 0 deletions figures/README
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
Adding images that are for this repository.
Binary file added figures/rse-community.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
3 changes: 3 additions & 0 deletions reviewer/images.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@

![![OpenReview 0](https://user-images.githubusercontent.com/30540958/179064015-256acd69-331c-4964-aad3-f4befac40883.png)
OpenReview 0](https://user-images.githubusercontent.com/30540958/179063947-5c0f1e07-b7b2-4727-8208-e6a596f20495.png)
1 change: 1 addition & 0 deletions reviewer/review-rubric.md
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
![Alt text](../figures/rse-community.jpg)
38 changes: 38 additions & 0 deletions reviewer/reviewer-instructions.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,38 @@
# OLS Reviewer’s guide for OpenReview
## Accept Invitation and Create an Account
* Please click on the ‘invitation link’ sent via OpenReview to your email.
* You will be taken to a page that looks like this:

![OpenReview 0](https://user-images.githubusercontent.com/30540958/179065006-da966abd-b91d-43a6-9744-830334cd7fc3.png)
* Click OK in order to see this page with your email (will be slightly different, will say **2022 and OLS-6**).
* ![open review 1](https://user-images.githubusercontent.com/30540958/179070348-a68f3a73-d9e2-46c1-9acc-3d8d2fa11d10.png)
* Log in to update your profile (left side of the screen), or complete registration (right side of the screen) if you don’t have an Open Review account.
* ![open review 2](https://user-images.githubusercontent.com/30540958/179070602-1a676675-c498-48d1-a48c-9ab44461dad7.png)
* When signing up, you will be asked to fill these details
* ![open review 3](https://user-images.githubusercontent.com/30540958/179070727-ec786aa0-8a43-4877-80dc-f4245722a80a.png)
* Add your name and email to receive a confirmation email and click the confirmation link sent to your email.
* Set up your profile by adding the following minimum information: (i) Personal link (Add any one link from Twitter/GitHub/Website), (ii) Your current position, start date (skip the end date to indicate your present role), (iii) Institute domain (like “openlifesci.org”), and (iv) Your institution name. You can optionally add other details, but they are not necessary for your application
* You will receive an email saying “Your OpenReview profile has been successfully created. Please allow up to 12 hours before the profile is activated.” (it takes only a few hours before a profile is activated).
## Application Review Process
On 24 January, the OLS team will send assigned applications for you to review based on the preference and topic of interest as provided by you in the bid that matches your bio.
All the application will be scored against a rubric integrated in the system.
Reviewing each application is likely to take 10-15 minutes, which should be submitted for each application that you have been assigned before 28 January 2022 (review submission deadline).
Please let the OLS team know if more time will be required, or if for any reason you are unable to review applications assigned to you within the given time-frame.
Once registered on OpenReview, visit this link: https://openreview.net/group?id=openlifesci.org/Open_Life_Science/2022/Cohort_5/Reviewers&referrer=[Homepage](%2F).
You should see all the applications assigned to you with the paper summary (title) as shown in the screenshot below.
![open review 4](https://user-images.githubusercontent.com/30540958/179071308-b86bb7e6-602d-40c2-924d-5f6d91f592d8.png)
## Application Allocation for Mentorship
We have already selected a 1-4 most suitable applications for you to review, however, you would be able to request to review other applications.
Please see the #ols-6-review channel for a shared sheet where you can see the titles for all the applications.
Application have been allocated to review based on what we think is compatible based on the common interests.
The review process should allow you to choose a project that you feel excited about and have some alignment with your ongoing work or past experience.
Of course, reviewing doesn’t mean you have to mentor the projects, you will be able to decline the project if you do not think you can mentor that.
## Adding your review
Click on Submit Official Review button next to the application summary (title).
This will take you to the full proposal with details provided by the applicant.
Please read the full application - this shoulkd take 8-10 minutes in an average.
Scroll down to choose your scoring (1, 2 or 3) under the New Official Review section.
We have provided rubrics in the drop down menu (for instance, see the image below) describing what 1, 2, and 3 score meann for ‘readiness’, ‘goal’, ‘openness’, ‘willingness’, your ‘recommendation’ and preference for ‘mentoring’.
![open review 5](https://user-images.githubusercontent.com/30540958/179071628-23b6c225-8e64-4b81-bc9f-96c270031624.png)

Please visit the paper bidding page to indicate conflicts or bid to review applications. You can also access this page by visiting the “Tasks” page on the top right of your screen when you’re signed in to OpenReview.