Registered Reports are a form of empirical article in which the methods and proposed analyses (Protocols) are pre-registered and reviewed prior to research being conducted. This format is designed to minimise various biases, including publication bias, in deductive science, while also allowing flexibility to conduct exploratory (unregistered) analyses and report serendipitous findings.

The cornerstone of the Registered Reports format is that the research question and proposed methods are evaluated for suitability prior to any data being collected. Therefore, a significant part of the manuscript is assessed prior to data collection. Only Registered Report Protocols that are considered to ask significant and topical questions will be reviewed favourably. These Protocols will include a summary, description of the key research question and background literature, hypotheses, experimental procedures, proposed data analyses, a statistical power analysis (or Bayesian equivalent), and pilot data (where applicable).

These Protocols will be assessed by the editorial team for suitability. Protocols that pass initial assessment will then be sent for in-depth peer review, following the journal’s standard practices. If the Protocol requires substantial revision, it will be rejected prior to full review. If the Protocol is reviewed favourably, it will be issued an in principle acceptance (IPA). The authors are then asked to conduct the proposed study, adhering exactly to the peer-reviewed procedures, and submit their results (Registered Report) to the journal for final consideration. If authors need to deviate from the accepted Protocol, they will be asked to describe any alterations in full, providing rationale for any deviation from the agreed Protocol. Registered Reports will be sent to the same referees, where possible, as the Protocol for review to assess whether the Protocol, including analyses, has been followed and data interpretation is appropriate. Authors will be asked to share their raw data as supporting information of the Registered Report, and are encouraged to upload their raw data and digital study materials to a publicly accessible file sharing service. Pending quality checks and a sensible interpretation of the findings, the manuscript will be published regardless of the observed results.

Not all types of science are equally amenable to Registered Reports. The format celebrates the deductive scientific method, so purely exploratory research or observations (i.e. with no prior hypothesis) are less applicable. Pure methods development is also unlikely to be suitable for a Registered Report. Of course, not all cases of exploratory research or methods development will be unsuitable, and editors are happy to consider proposals on a case-by-case basis.

Registered Report Protocol - Initial submission

Initial Registered Report Protocol submissions should include the following sections and should be written in the future tense:

Abstract

Introduction
A review of the relevant literature that motivated the authors to ask the research question(s) and a full description of the experimental aims designed to answer such question(s). The research question should be novel and of importance (see scope for more information). Please note that following in-principle acceptance (IPA), the Introduction section of the Registered Report Protocol should not be changed apart from correction of factual errors, typographic errors and altering of tense from future to past (see below).

Methods

1. A description of experimental procedures in sufficient detail to allow another researcher to repeat the methods exactly, without requiring further information. These procedures must be adhered to exactly in the subsequent experiments or the RRR manuscript may be rejected. Deviations from the published Protocol must be reported and justified in the Registered Report Protocol.
2. Full description of proposed sample characteristics (including the definition of any use of ‘n’), as well as complete criteria for data inclusion and exclusion (e.g. outlier extraction). Procedures for objectively defining exclusion criteria due to technical errors or for any other reasons must be specified, including details of how and under what conditions data would be replaced.
3. Proposed analyses plan, including all pre-processing steps, and a precise description of all planned analyses, including appropriate correction for multiple comparisons. Any covariates or regressors must be stated. Where analysis decisions are contingent on the outcome of prior analyses, these contingencies must be specified and adhered to. Only pre-planned analyses can be reported in the main Results section of Registered Report submissions. However, unplanned exploratory analyses will be admissible in a separate section of the Results.
4. Approximate timeline for completion of the study and proposed resubmission date. Extensions to this deadline can be negotiated with the editorial team.
5. Pilot Data (Optional)
   Can be included to establish proof of concept, effect size estimations, or feasibility of proposed methods. Any pilot experiments will be published with the final version of the manuscript and will be clearly distinguished from data obtained for the pre-registered experiment(s).

We recommend using our MS Word template when preparing the article.

In considering papers at Registered Report Protocol stage, Editors and reviewers will be asked to assess:

1. The scientific validity of the research question(s);
2. The logic, rationale, and plausibility of the proposed hypotheses;
3. The soundness and feasibility of the methodology and analysis plan (including statistical power analysis where appropriate, and thoroughness of subject characteristics including inclusion and exclusion criteria.
4. Whether the clarity and degree of methodological detail is sufficient to exactly replicate the proposed procedures and analysis plan

Authors are reminded that any deviation from the stated experimental procedures, regardless of how minor it may seem to the authors, could lead to rejection of the manuscript at the Registered Report stage. In cases where the pre-registered protocol is more than trivially altered after IPA due, for example, to unforeseen circumstances (e.g. change of equipment or unanticipated technical error), the authors must contact the editorial team immediately for advice, and prior to the completion of data collection. Minor changes to the protocol may be permitted if fully explained and justified . All deviations must be reported in the Registered Report manuscript. If the authors wish to alter the experimental question or protocol more substantially following IPA, but still wish to publish their article as a Registered Report then the Registered Report Protocol must be withdrawn and resubmitted as a new submission.

Once the RRP is published it should be registered by the authors on the Open Science Framework or another recognised repository.

The journal welcomes submissions proposing secondary analyses of existing data sets, provided authors can supply sufficient evidence (e.g. self-certification; letter from independent gatekeeper) to confirm that they have had no prior access to the data in question. For advice on the eligibility of specific scenarios, authors are welcome to contact the editorial team.

Registered Report - Initial submission

Once the research is complete, authors should prepare their Registered Reports Results for further review. The structure and formatting of manuscripts submitted to Cad_Lin are described here. We recommend using our MS Word template when preparing the article.

Note that, apart from minor stylistic revisions, the Introduction should not be altered from the approved Protocol, and the stated hypotheses cannot be amended or appended. At the Registered Report stage, any description of the rationale or proposed methodology that was written in future tense within the Protocol manuscript should be changed to past tense. Any relevant literature that appeared following the date of IPA should be covered in the Discussion.

The outcome of all registered analyses must be reported in the manuscript, except in rare instances where a registered and approved analysis is subsequently shown to be logically flawed or unfounded. In such cases, the authors, reviewers, and editor must agree that the analysis is inappropriate. In such cases the analysis would still be mentioned in the Methods but omitted with justification from the Results.

It is reasonable that authors may wish to include additional analyses that were not included in the registered submission. For instance, a new analytic approach might become available between IPA and RRR submission, or a particularly interesting and unexpected finding may emerge. Such analyses are admissible but must be clearly justified in the text, appropriately caveated, and reported in a separate section of the Results titled “Exploratory analyses”. Authors should not base their conclusions solely on the outcome of statistically significant exploratory or unplanned analyses.

Authors reporting null hypothesis significance tests are required to report exact p values and effect sizes for all inferential analyses.

The Registered Report submission will most likely be considered by the same reviewers as in the Registered Report Protocol, but could also be assessed by new reviewers. In considering papers at Registered Report stage, reviewers will be asked to decide:

1. Whether the data are able to test the authors’ proposed hypotheses by satisfying the approved outcome-neutral conditions (such as quality checks, positive controls)
2. Whether the Introduction, rationale and stated hypotheses are the same as the approved RRP submission
3. Whether the authors adhered precisely to the registered experimental procedures or have made acceptable /agreed deviations
4. Whether any unregistered post hoc analyses added by the authors are justified, methodologically sound, and informative
5. Whether the authors’ interpretation of the data and subsequent conclusions are justified

It is recommended that anonymised raw data and digital study materials are made freely available in a public repository/archive with a link provided within the Registed Report manuscript. Authors are free to use any repository that renders data and materials freely and publicly accessible and provides a digital object identifier (DOI) to ensure that the data remain persistent, unique and citable.

Other than pre-registered and approved pilot data, no data acquired prior to the date of IPA is admissible in the Registered Report submission. Raw data must be accompanied by guidance notes, where required, to assist other scientists in replicating the analysis plan. Authors are required to upload any relevant analysis scripts and other digital experimental materials that would assist in replication.

Reviewers are informed that editorial decisions at the Registered Report stage will not be based on the perceived 'importance' of the results, but rather on the adherence to the agreed Registered Report and the interpretation of these results. Thus, while reviewers are free to enter such comments on the record, they will not influence editorial decisions.