SUBMISSIONS

We invite you to submit:

Full reserach papers (up to 10 pages excluding references) that must describe authors’ original research work and results. We encourage authors to include validation w.rt. a case study in the recommended themes. We welcome papers focusing on tools and tool development.

Case study papers (up to 10 pages excluding references) that should identify lessons learned, validate theoretical results (such as scalability of methods) or provide specific motivation for further research and development.

Research ideas papers (be up to 4 pages plus up to 1 additional page of references) on new research ideas in order to stimulate discussions.

To avoid that authors waste time fitting their papers into the stated limit at the expense of presentation clarity, paper lengths slightly exceeding the stated limit will be tolerated provided that the presentation is of high quality, which will be left at the appreciation of the reviewers.

All submission must be unpublished original work written in English, must conform to the IEEE Conference Proceedings Formatting Guidelines, and should not be under review or submitted elsewhere whilst being under consideration.

We recommend placing the following two lines in your LaTeX source right after the \documentclass command:

\usepackage[switch,columnwise]{lineno}
\linenumbers

This adds line numbers, thereby allowing reviewers to refer to specific lines in their comments.

Upon submission, papers must comply with the FormaliSE's lightweight double-blind review process.

Submissions to FormaliSE 2023 can be made via EasyChair by the submission deadline. We encourage authors to submit artifact in addition to their papers.

REVIEW PROCESS

FormaliSE 2023 uses the following light-weight double-blind review process: Authors of papers must omit their names and institutions from the title page, they should refer to their other work in the third person, and omit acknowledgments that could reveal their identity or affiliation.

The purpose is to avoid any bias based on authors' identity characteristics, such as gender, seniority, or nationality, in the review process. Our goal is to facilitate an unbiased approach to reviewing by supporting reviewers' access to works that do not carry obvious references to the authors' identities.

As mentioned above, this is a light-weight double-blind process. Anonymization should not be a heavy burden for authors and should not make papers weaker or more difficult to review. Advertising the paper on alternate forums (e.g., on a personal web-page, pre-print archive, email, talks, discussions with colleagues) is permitted, and authors will not be penalized by for such advertisement.

PAPER SELECTION

Each paper will be reviewed by at least three program committee members that judge the paper based on its clarity, relevance, originality, and contribution to the field.

FormaliSE 2023 will continue the light-weight rebuttal scheme: if all the reviewers of a given submission agree that a clarification from the authors regarding a specific question could move a borderline paper into the acceptable range, the chairs will ask that question to the authors by e-mail and post their reply on EasyChair for the benefit of the reviewers.

The goal of such light-weight rebuttals is to eliminate "coin-toss" decisions on borderline papers. Hence, it will clearly concern only a minority of submissions and most of the authors should not expect to receive such questions. However, we would ask the corresponding authors of all submissions to make sure that they are available to answer a question by email if the necessity were to arise.

ARTIFACT EVALUATION

Reproducibility of experimental results is crucial to foster an atmosphere of trustworthy, open, and reusable research. To improve and reward reproducibility, FormaliSE 2023 continues its Artifact Evaluation (AE) procedure.

An artifact is any additional material (software, data sets, machine-checkable proofs, etc.) that substantiates the claims made in the paper and ideally makes them fully reproducible. Submission of an artifact is optional but encouraged for all papers where it can support the results presented in the paper.

Artifact review is single-blind (the paper corresponding to an artifact must still follow the double-blind submissions requirements) and will be conducted concurrently with the paper reviewing process.

Artifacts will be handled by a separate Artifact Evaluation Committee, and the Artifact Evaluation process will be set up such that the anonymization of the corresponding papers will not be compromised. The results of the evaluation may be taken into consideration for the corresponding paper acceptance decision. Accepted papers with a successfully evaluated artifact will receive a badge to be shown on the published paper's title page.

Artifacts will be assessed with respect to their consistency with the results presented in the paper, their completeness, their documentation, and their ease of use. The Artifact Evaluation will include an initial check for technical issues; authors of artifacts may be contacted by e-mail within the first two weeks after artifact submission to help resolve any technical problems that prevent the evaluation of an artifact if necessary.

Detailed guidelines for preparation and submission of artifacts will be specified on the artifact page.

PUBLICATION

All accepted papers are published as part of the ICSE 2023 Proceedings in the ACM and IEEE Digital Libraries.

At least one author of each accepted paper is required to register for the conference and present the paper at the conference — physically or, if the circumstances warrant so, virtually. Otherwise, the paper will be removed from the proceedings.