Reproducibility Ratings for Blogposts

The top and bottom of all blogposts on this site shows a rating for the reproducibility of the content with the following considerations:

  • Is the author citable?
  • Is the data citable?
  • Is the code citable (and replicable)?

The rating system is as follows:

Not reproducible!

Complete lack of unique identifier or programmatic access to resource.

Should be reproducible!

A potentially volatile link to the resource has been provided, this includes resources like Gists where commercial interests may make them unavailable in the future. This category includes data accessible via API or CRAN-hosted R packages.

Reliably reproducible.

A DOI or other permanent identifier has been given to the resource, future access is highly likely.


This ratings system was introduced back in February 2018 in the reproducible blogposts post. The current implementation of the ratings system requires blog authors to manually insert raw HTML into a post, in the future an R package will be built which will make this process much smoother.

This code is to be inserted at the top of each post, note the use of a <hr> tags to soak up some of the white vertical space:

    <!--html_preserve-->
    <hr style="margin-top: -10px;margin-bottom: 5px;">
    <div class="row">
        <div class="col-sm-4">
            <center> <span class="fa fa-star fa-2x text-center" style="color:Tomato"></span>
                <p><a href='../reproducibility-ratings' data-toggle="tooltip" data-placement="right" title="" data-original-title="Click for info" style='font-weight:bold;color:black;text-decoration:underline;' target='_blank'>Citable Author<i class="fa fa-question-circle "></i></a>
                    <br>
                    Charlie Joey Hadley
                    <br>
                    (<a href="https://orcid.org/0000-0002-3039-6849" target="orcid.widget" rel="noopener noreferrer" style="vertical-align:top;"  target='_blank'><img src="../img/orcid_16x16.png" style="width:1em;margin-right:.2em;" alt="ORCID iD icon">orcid.org/0000-0002-3039-6849</a>)
            </center>
        </div>
        <div class="col-sm-4">
            <center> <span class="fa fa-star fa-2x text-center" style="color:Tomato"></span>
                <p><a href='../reproducibility-ratings' data-toggle="tooltip" data-placement="right" title="" data-original-title="Click for info" style='font-weight:bold;color:black;text-decoration:underline;' target='_blank'>Citable Data<i class="fa fa-question-circle "></i></a>
                    <br>
                    No data used.
            </center>
        </div>
        <div class="col-sm-4">
            <center> <span class="far fa-star-half fa-2x text-center" style="color:Tomato"></span>
                <p><a href='../reproducibility-ratings' data-toggle="tooltip" data-placement="right" title="" data-original-title="Click for info" style='font-weight:bold;color:black;text-decoration:underline;' target='_blank'>Citable Code<i class="fa fa-question-circle "></i></a>
                    <br>
                    <a href="https://github.com/visibledata/visibledata.github.io/blob/master/content/blog/blogpost-title.Rmd" target="orcid.widget" rel="noopener noreferrer" style="vertical-align:top;"  target='_blank'><img src="../img/GitHub-Mark-32px.png" style="width:1em;margin-right:.5em;" alt="GitHub icon">.Rmd on GitHub</a>
            </center>
        </div>
    </div>
    
    <hr style="margin-top: 5px;margin-bottom: 5px;">
    
    <!--/html_preserve-->

This is the code to be inserted at the end of a post:

    <!--html_preserve-->
    <hr>
    <div class="row" style='margin-bottom:-40px;'>
        <div class="col-sm-4">
            <center> <span class="fa fa-star fa-2x text-center" style="color:Tomato"></span>
                <p><a href='../reproducibility-ratings' data-toggle="tooltip" data-placement="right" title="" data-original-title="Click for info" style='font-weight:bold;color:black;text-decoration:underline;' target='_blank'>Citable Author<i class="fa fa-question-circle "></i></a>
                    <br>
                    Charlie Joey Hadley
                    <br>
                    (<a href="https://orcid.org/0000-0002-3039-6849" target="orcid.widget" rel="noopener noreferrer" style="vertical-align:top;"  target='_blank'><img src="../img/orcid_16x16.png" style="width:1em;margin-right:.2em;" alt="ORCID iD icon">orcid.org/0000-0002-3039-6849</a>)
            </center>
        </div>
        <div class="col-sm-4">
            <center> <span class="far fa-star-half fa-2x text-center" style="color:Tomato"></span>
                <p><a href='../reproducibility-ratings' data-toggle="tooltip" data-placement="right" title="" data-original-title="Click for info" style='font-weight:bold;color:black;text-decoration:underline;' target='_blank'>Citable Data<i class="fa fa-question-circle "></i></a>
                    <br>
                    R packages: <a href='https://cran.r-project.org/web/packages/WDI/' target='_blank'>WDI</a>
            </center>
        </div>
        <div class="col-sm-4">
            <center> <span class="far fa-star-half fa-2x text-center" style="color:Tomato"></span>
                <p><a href='../reproducibility-ratings' data-toggle="tooltip" data-placement="right" title="" data-original-title="Click for info" style='font-weight:bold;color:black;text-decoration:underline;' target='_blank'>Citable Code<i class="fa fa-question-circle "></i></a>
                    <br>
                    <a href="https://github.com/visibledata/visibledata.github.io/blob/master/content/blog/blogpost-title.Rmd" target="orcid.widget" rel="noopener noreferrer" style="vertical-align:top;"  target='_blank'><img src="../img/GitHub-Mark-32px.png" style="width:1em;margin-right:.5em;" alt="GitHub icon">.Rmd on GitHub</a>
            </center>
        </div>
    </div>
    
    <!--/html_preserve-->