Call for Submissions: RRRR 2025

4th Workshop on Reproducibility and Replication of Research Results – May 3, 2025, as a satellite event of ETAPS 2025 in Hamilton, Ontario, Canada – https://qcomp.org/rrrr/2025/

RRRR provides a forum to present and discuss novel approaches to foster reproducibility of research results, and replication studies of existing work, in the broad area of formal methods and software engineering research. Its goal is to spread the word on best practices, and reward the work invested in replicating results. RRRR invites abstracts and short papers for presentation at the workshop; we plan to invite authors to submit full papers to a special issue of STTT afterwards.

Submissions

Submissions are handled via EasyChair. Submissions should be related to research in the broad area of formal methods and software engineering. All accepted submissions will be informally published via the RRRR website.

Submissions are welcome in, but not limited to, the following topics on reproducibility and replication:

• Studies of reproducibility or replication trends in a formal methods or software engineering research area.
• Presentations of novel developments in, or retrospective studies on, reproducibility initiatives such as artifact evaluations.
• Reports on successful or failed attempts at reproducing or replicating earlier research results.
• Presentations of replication aspects within separate research papers, student thesis projects, and similar work.
• Tools and methods to support reproducibility and replication of research results.
• Any other topic related to reproducibility and replication; if in doubt, contact the organizers.

We in particular encourage authors of papers accepted at the main ETAPS conferences to present the reproducibility- and replication-related aspects of their work at RRRR.

RRRR accepts presentation abstracts (1-2 pages in LNCS style including references) as well as short papers (around 6 pages in LNCS style plus references). Authors of all accepted submissions will present their work at the workshop (in person).

Special Issue in STTT

We plan to invite authors of accepted papers/abstracts to submit an extended/full version of their work to a special issue in the International Journal on Software Tools for Technology Transfer (STTT). All journal submissions will undergo a full reviewing process and are expected to be accompanied by an artifact where applicable.

Timeline

• March 13: Submission deadline
• April 3: Acceptance notification
• April 17: Final versions for informal publication on the website
• May 3: Workshop day

All dates are in 2025 and all deadlines are "anywhere on Earth" (UTC-12). The timeline may be adjusted if necessary so that the notification happens before the ETAPS 2025 early registration deadline. The organizers would appreciate an early informal indication, via email, of the intention to submit to RRRR 2025.

Organizers

• Arnd Hartmanns (University of Twente, The Netherlands)
• Sean Kauffman (Queen’s University, Canada)

Website

For more details, please visit the RRRR 2025 website at qcomp.org/rrrr/2025.