Author Guide

This year we are asking authors to submit paper abstracts by the abstract submission deadline of  Abstract submission: September 21 2022, anywhere on earth. The full paper submission deadline is September 28 2022, anywhere on earth. Abstracts and papers must be submitted using the conference submission system at: https://openreview.net/group?id=ICLR.cc/2023/Conference. Please keep in mind that the deadlines are final and we cannot make any accommodations for missing the abstract deadline or paper deadline. It is key that authors submit genuine and informative abstracts that reflect the content of the full submission, as abstracts will be used in Area Chair bidding before the final paper submission deadline. Placeholder or duplicate abstracts will be removed.

For detailed submission instructions, including paper length and style file, please refer to the call for papers on https://iclr.cc/Conferences/2023/CallForPapers.

Source code submission: Source code associated with a paper can be uploaded as part of the supplementary material. Code submission gives more information to reviewers, especially for replicability of the paper. We encourage all authors to submit code as part of their submission. Note that reviewers are encouraged, but not required to review supplementary material during the review process. All supplementary code must be self-contained and zipped into a single file or can be downloaded via an anonymous URL. Note that supplementary material will be visible to reviewers and the public throughout and after the review period, and ensure all material is anonymized.

Supplementary (text) submission: We encourage authors to submit a single file (paper + supplementary text) this year. Please mark the supplementary material clearly. 

Code of Ethics and Ethics statement

All ICLR participants, including authors, are required to adhere to the ICLR Code of Ethics (https://iclr.cc/public/CodeOfEthics). All authors of submitted papers are required to read the Code of Ethics, adhere to it, and explicitly acknowledge this during the submission process. The Code of Ethics applies to all conference participation, including paper submission, reviewing, and paper discussion. 

As part of the review process, reviewers will be encouraged to raise potential violations of the ICLR Code of Ethics. If authors feel that their paper submission raises questions regarding the Code of Ethics, they are encouraged to discuss any potential issues as part of their submission. This discussion is not counted against the maximum page limit of the paper and should be included as a separate section.

Authors who encounter potential violations of the Code of Ethics, e.g., as part of the review or public discussion, should raise these issues in a private message to their paper’s Area Chair through the open review interface.

Authors are encouraged to include a paragraph of Ethics Statement (at the end of the main text before references) to address potential concerns where appropriate, topics include, but are not limited to, studies that involve human subjects, practices to data set releases, potentially harmful insights, methodologies and applications, pontential conflicts of interest and sponsorship, discrimination/bias/fairness concerns, privacy and security issues, legal compliance, and research integrity issues (e.g., IRB, documentation, research ethics). The optional ethic statement will not count toward the page limit, but should not be more than 1 page. 

Reproducibility

It is important that the work published in ICLR is reproducible. Authors are strongly encouraged to include a paragraph-long Reproducibility Statement at the end of the main text (before references) to discuss the efforts that have been made to ensure reproducibility. This paragraph should not itself describe details needed for reproducing the results, but rather reference the parts of the main paper, appendix, and supplemental materials that will help with reproducibility. For example, for novel models or algorithms, a link to a anonymous downloadable source code can be submitted as supplementary materials; for theoretical results, clear explanations of any assumptions and a complete proof of the claims can be included in the appendix; for any datasets used in the experiments, a complete description of the data processing steps can be provided in the supplementary materials. Each of the above are examples of things that can be referenced in the reproducibility statement. This optional reproducibility statement will not count toward the page limit, but should not be more than 1 page.

Reviewing Process

Submissions to ICLR are uploaded on OpenReview, which enables public discussion during the review process public discussion phase, which lasts until November 18 2022, as well as further discussion between authors, reviewers and area chairs until December 12, 2022.

Authors are encouraged to participate in the public discussion of their paper, as well as of any other paper submitted to the conference. Submissions and reviews are both anonymous and visible as follows:

  • Official reviews are anonymous and publicly visible.
  • Anybody who is logged in can post comments that are publicly visible or restrict visibility to reviewers and up, ACs and up, or just PCs. Login is required before posting any comment.

By November 4, 2022, we expect all reviews to be completed. Reviews are anonymous and publicly visible in Open Review. Once the reviews are posted, authors are free to upload modifications to the paper until Nov 18, 2022. The most relevant dates for authors are as follows:

  • Review Release: November 4, 2022
  • Discussion Stage 1:  November 4 - November 18
    • Discussions among Reviewers/Authors/Public.
    • Anyone may post comments, but they must be logged in, and their names will be shown. Reviewers remain anonymous 
    • Authors can update their draft until Nov 18.
  • Discussion Stage 2 - November 18 - December 12
    • Discussions among authors, reviewers and AC (authors can’t update their submissions during this time)
    • [new this year] ACs will meet with reviewers for borderline papers
    • ACs encourage reviewers to acknowledge and respond to author responses.

In addition, authors can post "official comments" about their paper before the discussion stages, and restrict visibility to reviewers, area chairs, or program chairs as appropriate. For example, this functionality can be used to post links to supplementary material.

 

Camera-ready Submissions

The deadline for uploading camera-ready submissions will be in March 1st 2023. Additional guidance on preparing your camera-ready version will be provided on this page in due course.

Frequently Asked Questions

  

FAQ Before Submission Deadline

Q. How do I submit the abstract?
 
In openreview page, you will see that only "Abstract*" section is mandatory (indicated by "*") and not "PDF" section. To submit an abstract, you can enter text in "Abstract" section. You can upload the full paper in "PDF" section anytime before the deadline.
 

Q. Do I need an open review account to submit the paper?

Yes. And so as all your co-authors. Please ensure this before the submission deadline; we cannot make an exception (for fairness) if you failed to submit by the abstract deadline.

Q: When is the submission deadline for supplementary materials?

The deadline is the same for the full paper and for the supplementary materials.

Q: Should the appendices be added as a separate PDF or in the same PDF as the main paper?

Either is allowed: you can include the appendices at the end of the main pdf after the references, or you can include it as a separate file for the supplementary materials.

Q: How can we make our code available for reviewing anonymously? 

You can share your code in three ways:

  1. Anonymize your code, put it in a .zip file and submit it as supplementary materials.
  2. Make an anonymous repository and put the link in your paper. The above methods will make your code public, along with your paper and reviews/comments for the paper.
  3. After we open the discussion forums for all submitted papers, make a comment directed to the reviewers and area chairs and put a link to an anonymous repository. This method will let you keep your code visible only to the reviewers and ACs for your paper.

Q: I can’t modify my submission to include the PDF and supplementary materials. Can you help?

Make sure you logged in using the same account you used to upload the submission. If so, you should be able to click on your submission and see a "Revision" button.

If you are still having problems accessing your submission, follow these steps:

  1. Go to your submission and hover over your name in the ‘Authors’ field.
  2. If your name is associated with an email address that is not currently on your profile, add this email address to your OpenReview profile and confirm it. This will give you access to your submission and the ‘Revision’ button.
  3. If your name is associated with another profile that is not the profile you submitted the paper with, contact the OpenReview team at info@openreview.net so they can merge your profiles.

If you are still having trouble, please contact OpenReview technical support at info@openreview.net and explain the situation.

Q: Can you explain how to treat de-anonymization in the case where a submitted paper refers to a challenge they won which can identify the authors? 

It is ok to report the results on the leaderboard of a challenge. The authors can include the ranking and the name of the challenge. The reviewers will be advised to not intentionally search the authors by examining the leaderboard.

Q: Can I add or make changes on authors after the abstract submission deadline? 

No. You cannot add or remove authors (or fix typos) after the abstract submission deadline - we make no exceptions whatsoever, so please don't bother sending an email (we get a lot of these emails, sometimes the same question multipe times from the same people).  Note that the orders can be changed if the contribution among the authors changes. Please coordinate among the authors and make sure that everyone has an OpenReview profile before the abstract submission deadline.

 

Q: Can I submit an abstract to serve as a placeholder so that I can fill in the details of my submission after the abstract deadline? 

No. All placeholder abstract submissions will be deleted. 

Q: We recently submitted a paper A on arxiv. Now we are submitting a follow up work B to ICLR.  Should we cite paper A in our submission B? If so, how should I cite the work without violating the double-blind process? 

Yes, authors should provide the citations to all related work, including paper A. When referring to paper A, please use a 3rd person narrative. 

Q: If my submission does not have any ethics issues to the best of our knowledge, do I still need to include an Ethics Statement? 

No, there is no need to include an Ethics Statement for all submissions. Submissions with potential ethics issues (such as study involving human subjects, dataset with sensitive information, etc) should consider including an ethics statement. 

 

FAQ During Discussion Stages

Q. Can we make changes to the title and abstract for the full paper submission?

It is Ok to revise the title and abstract for your full paper submission so long as the revised version stays close to your original abstract submission; The revised version shouldn’t read like a different paper compared to your original abstract submission. If so, the paper will be rejected.

Q. Can we change the title of a paper during the rebuttal?

Yes, you can change the title, abstract, and the paper’s content, including supplementary materials. But make sure any modifications are clearly communicated to the reviewers and the area chair, so that they can efficiently review the modified version of your paper. The set of authors cannot be changed, but the order can be changed.

Q. For rebuttal revisions, are we limited to one upload or can we update the paper several times? 

You can upload revisions until Nov 18, but reviewers and area chairs are not required to look at every revision. It is up to you to clearly communicate what’s been changed.

Q. Can you please explain to me the difference between the first and second stages of discussion? Are there things that I must reply/address before Nov 18th (end date of the first discussion phase)?

The key difference is that during stage 1 the discussion is open to the public. This means any user who is logged on to Openreview can comment on papers. This is an opportunity to get the widest possible discussion, and if you have follow up questions to public comments, then these should be resolved by the end of discussion phase 1. Authors can upload a revised PDF until the end of discussion phase 1. Discussion phase 2 allows a more focused discussion between authors, reviewers and area chairs. Authors can respond to reviewer/AC questions up until Dec 12 (End of Day, Anywhere on Earth) both by posting on the forum.

 

Q. Is there a limit on the number of comments we can post? Can we post multiple replies to each reviewer?

There is a word limit for each comment, but there is no limit on the number of comments. You may post multiple replies to each reviewer, but please remain civil and considerate of the reviewers’ time, as they are reviewing and thus engaging in discussions for multiple papers for ICLR. Compared to other conferences in the field, the open nature of the discussion phases allows more interaction among the authors and reviewers. Please see previous versions of ICLR Openreview to get a sense of the interactions (e.g., Openreview forums for ICLR 2021)

Q. How do we contact the Reviewers, Area Chairs, and Program Chairs?

If you have important private comments to the area chair and/or reviewers of your paper, please communicate through the Openreview forum for that submission and choose “Area Chairs of the submission” and/or "Reviewers of the submission" from the dropdown menu of the “Readers”.

Your first point of contact in case of questions is the Area Chair assigned to your submission. In cases that cannot be resolved together with the Area Chair, please contact the Program Chairs by emailing program-committee@iclr.cc. Prefix your title as [Authors-to-PCs].