CRAN Package Check Results for Package mlr3fairness

Last updated on 2024-03-27 22:57:51 CET.

Flavor Version Tinstall Tcheck Ttotal Status Flags
r-devel-linux-x86_64-debian-clang 0.3.2 15.37 294.21 309.58 NOTE
r-devel-linux-x86_64-debian-gcc 0.3.2 11.63 274.21 285.84 NOTE
r-devel-linux-x86_64-fedora-clang 0.3.2 526.58 NOTE
r-devel-linux-x86_64-fedora-gcc 0.3.2 481.66 NOTE
r-devel-windows-x86_64 0.3.2 14.00 259.00 273.00 NOTE
r-patched-linux-x86_64 0.3.2 22.95 351.51 374.46 OK
r-release-linux-x86_64 0.3.2 12.54 352.13 364.67 OK
r-release-macos-arm64 0.3.2 143.00 OK
r-release-macos-x86_64 0.3.2 327.00 ERROR
r-release-windows-x86_64 0.3.2 18.00 361.00 379.00 OK
r-oldrel-macos-arm64 0.3.2 139.00 OK
r-oldrel-windows-x86_64 0.3.2 18.00 365.00 383.00 OK

Check Details

Version: 0.3.2
Check: Rd files
Result: NOTE checkRd: (-1) groupdiff_tau.Rd:23: Lost braces 23 | \code{groupdiff_tau()} computes \eqn{min(x/y, y/x)}, i.e. the smallest symmetric ratio between \eqn{x} and eqn{y} | ^ Flavors: r-devel-linux-x86_64-debian-clang, r-devel-linux-x86_64-debian-gcc, r-devel-linux-x86_64-fedora-clang, r-devel-linux-x86_64-fedora-gcc, r-devel-windows-x86_64

Version: 0.3.2
Check: re-building of vignette outputs
Result: ERROR Error(s) in re-building vignettes: --- re-building ‘debiasing-vignette.Rmd’ using rmarkdown Pandoc is required to build R Markdown vignettes but not available. Please make sure it is installed. 2023-07-10 23:46:26.428 R[80044:2290430804] XType: Using static font registry. Warning in file.info(x, extra_cols = FALSE) : expanded path length 4561 would be too long for <h1 id="introduction-fairness-pipeline-operators">Introduction: Fairness Pipeline Operators</h1> <p>Given we detected some form of bias during bias auditing, we are often interested in obtaining fair(er) models. There are several ways to achieve this, such as collecting additional data or finding and fixing errors in the data. Assuming there are no biases in the data and labels, one other option is to debias models using either <strong>preprocessing</strong>, <strong>postprocessing</strong> and <strong>inprocessing</strong> methods. <code>mlr3fairness</code> provides some operators as <code>PipeOp</code>s for <code>mlr3pipelines</code>. If you are not familiar with <code>mlr3pipelines</code>, the <a href="https://mlr3book.mlr-org.com/pipelines.html">mlr3 book</a> contains an introduction.</p> <p>We again showcase debiasing using the <code>adult_train</code> task:</p> <pre><code class="language-r">library(mlr3) library(mlr3fairness) librar [... truncated] --- finished re-building ‘debiasing-vignette.Rmd’ --- re-building ‘measures-vignette.Rmd’ using rmarkdown Pandoc is required to build R Markdown vignettes but not available. Please make sure it is installed. Warning in file.info(x, extra_cols = FALSE) : expanded path length 17990 would be too long for <h1 id="fairness-measures">Fairness Measures</h1> <p>Fairness measures (or metrics) allow us to assess and audit for possible biases in a trained model. There are several types of metrics that are widely used in order to assess a model’s fairness. They can be coarsely classified into three groups:</p> <ul> <li> <p><strong>Statistical Group Fairness Metrics</strong>: Given a set of predictions from our model, we assess for differences in one or multiple metrics across groups given by a <em>protected attribute</em> [@fairmlbook; @hardt2016equality].</p> </li> <li> <p><strong>Individual Fairness</strong>: Basically requires that similar people are treated similar independent of the protected attribute [@dwork2012]. We will briefly introduce individual fairness in a dedicated section below.</p> </li> <li> <p><strong>Causal Fairness Notions</strong>: An important realization in the context of Fairness is, that whether a process is fair is o [... truncated] --- finished re-building ‘measures-vignette.Rmd’ --- re-building ‘reports-vignette.Rmd’ using rmarkdown Pandoc is required to build R Markdown vignettes but not available. Please make sure it is installed. Quitting from lines 52-54 [build_modelcard_example_for_vignette] (reports-vignette.Rmd) Error: processing vignette 'reports-vignette.Rmd' failed with diagnostics: pandoc version 1.12.3 or higher is required and was not found (see the help page ?rmarkdown::pandoc_available). --- failed re-building ‘reports-vignette.Rmd’ --- re-building ‘visualization-vignette.Rmd’ using rmarkdown Pandoc is required to build R Markdown vignettes but not available. Please make sure it is installed. 2023-07-10 23:48:42.299 R[18209:2290505996] XType: Using static font registry. Warning in file.info(x, extra_cols = FALSE) : expanded path length 8617 would be too long for <pre><code class="language-r">library(mlr3) library(mlr3fairness) library(mlr3learners) </code></pre> <h1 id="why-we-need-fairness-visualizations">Why we need fairness visualizations:</h1> <p>Through fairness visualizations allow for first investigations into possible fairness problems in a dataset. In this vignette we will showcase some of the pre-built fairness visualization functions. All the methods showcased below can be used together with objects of type <code>BenchmarkResult</code>, <code>ResampleResult</code> and <code>Prediction</code>.</p> <h1 id="the-scenario">The scenario</h1> <p>For this example, we use the <code>adult_train</code> dataset. Keep in mind all the datasets from <code>mlr3fairness</code> package already set protected attribute via the <code>col_role</code> “pta”, here the “sex” column.</p> <pre><code class="language-r">t = tsk(&quot;adult_train&quot;) t$col_roles$pta #&gt; [1] &quot;sex&quot; </code></pre [... truncated] --- finished re-building ‘visualization-vignette.Rmd’ SUMMARY: processing the following file failed: ‘reports-vignette.Rmd’ Error: Vignette re-building failed. Execution halted Flavor: r-release-macos-x86_64