---
title: "Related software"
output: rmarkdown::html_vignette
vignette: >
  %\VignetteIndexEntry{Related software}
  %\VignetteEngine{knitr::rmarkdown}
  %\VignetteEncoding{UTF-8}
---

```{r, include = FALSE}
knitr::opts_chunk$set(
  collapse = TRUE,
  comment = "#>"
)
```

Software for error detection goes well beyond scrutiny. This vignette presents broadly similar packages and apps, with no claim to completeness.

Please contact me if you know about relevant software that isn't listed here (email: jung-lukas\@gmx.net).

-   For good reason, [statcheck](https://michelenuijten.shinyapps.io/statcheck-web/) by Sacha Epskamp and Michèle Nuijten is the best-known error detection software. It reconstructs *p*-values and tests them for consistency with their respective statistic, such as *t* or *F*. Even better, it operates on PDF files automatically, enabling users to scan [massive amounts](https://link.springer.com/article/10.3758/s13428-015-0664-2) of published articles. Steve Haroz built a [simple edition](https://steveharoz.shinyapps.io/statchecksimple/) of the statcheck web app.

-   James Heathers' [SPRITE](https://peerj.com/preprints/26968v1/) algorithm reconstructs possible distributions of raw data from summary statistics. James also wrote a [light introduction](https://medium.com/hackernoon/introducing-sprite-and-the-case-of-the-carthorse-child-58683c2bfeb) to SPRITE. For R users, it was implemented in [rsprite2](https://lukaswallrich.github.io/rsprite2/) by Lukas Wallrich, building up on code by Nick Brown. Jordan Anaya developed a [Python-based SPRITE app](http://www.prepubmed.org/sprite/).

-   The R package [validate](https://cran.r-project.org/package=validate) by Mark P.J. van der Loo provides numerous tools for data checking.

-   The delta-F test for linearity, a.k.a. the "Förster test", was implemented in Dale J. Barr's R package [forsterUVA](https://github.com/dalejbarr/forsterUVA).

-   Several R packages leverage the Benford distribution of naturally occurring numbers to assess whether reported numbers are, in fact, natural. These packages include:

    -   [benford.analysis](https://github.com/carloscinelli/benford.analysis) by Carlos Cinelli contains various sophisticated tools for inspecting data using the Benford distribution.

    -   [jfa](https://koenderks.github.io/jfa/index.html) by Koen Derks offers a full statistical auditing suite (including Benford analysis).

-   Emerging from the Pruitt investigations, there is now R software for analyzing sequences:

    -   The package [twopointzerothree](https://github.com/Sorbus-torminalis/twopointzerothree/) (by an anonymous developer) checks data for sequences of perfectly correlated numbers. These numbers are either duplicates of each other or they are duplicates offset by some constant amount; hence the name.

    -   Similarly, the [sequenceSniffer](https://github.com/alrutten/sequenceSniffer) app by Anne Rutten detects repetitions in sequences.
