Last updated on 2025-06-20 12:49:21 CEST.
| Flavor | Version | Tinstall | Tcheck | Ttotal | Status | Flags |
|---|---|---|---|---|---|---|
| r-devel-linux-x86_64-debian-clang | 0.3.2 | 15.91 | 183.16 | 199.07 | ERROR | |
| r-devel-linux-x86_64-debian-gcc | 0.3.2 | 9.62 | 118.18 | 127.80 | ERROR | |
| r-devel-linux-x86_64-fedora-clang | 0.3.2 | 292.20 | ERROR | |||
| r-devel-linux-x86_64-fedora-gcc | 0.3.2 | 295.78 | ERROR | |||
| r-devel-windows-x86_64 | 0.3.2 | 16.00 | 268.00 | 284.00 | ERROR | |
| r-patched-linux-x86_64 | 0.3.2 | 13.03 | 278.37 | 291.40 | ERROR | |
| r-release-linux-x86_64 | 0.3.2 | 12.85 | 288.01 | 300.86 | ERROR | |
| r-release-macos-arm64 | 0.3.2 | 156.00 | NOTE | |||
| r-release-macos-x86_64 | 0.3.2 | 277.00 | NOTE | |||
| r-release-windows-x86_64 | 0.3.2 | 16.00 | 277.00 | 293.00 | NOTE | |
| r-oldrel-macos-arm64 | 0.3.2 | 137.00 | NOTE | |||
| r-oldrel-macos-x86_64 | 0.3.2 | 214.00 | NOTE | |||
| r-oldrel-windows-x86_64 | 0.3.2 | 21.00 | 398.00 | 419.00 | NOTE |
Version: 0.3.2
Check: Rd files
Result: NOTE
checkRd: (-1) groupdiff_tau.Rd:23: Lost braces
23 | \code{groupdiff_tau()} computes \eqn{min(x/y, y/x)}, i.e. the smallest symmetric ratio between \eqn{x} and eqn{y}
| ^
Flavors: r-devel-linux-x86_64-debian-clang, r-devel-linux-x86_64-debian-gcc, r-devel-linux-x86_64-fedora-clang, r-devel-linux-x86_64-fedora-gcc, r-devel-windows-x86_64, r-patched-linux-x86_64, r-release-linux-x86_64, r-release-macos-arm64, r-release-macos-x86_64, r-release-windows-x86_64, r-oldrel-macos-arm64, r-oldrel-macos-x86_64, r-oldrel-windows-x86_64
Version: 0.3.2
Check: Rd cross-references
Result: NOTE
Found the following Rd file(s) with Rd \link{} targets missing package
anchors:
MeasureFairness.Rd: mlr_measures_classif.ce,
mlr_measures_classif.fpr, mlr_measures, Task
MeasureFairnessComposite.Rd: Task
MeasureFairnessConstraint.Rd: Task
MeasureSubgroup.Rd: mlr_measures_classif.fpr
compas.Rd: TaskClassif
compute_metrics.Rd: Task
fairness_accuracy_tradeoff.Rd: PredictionClassif, BenchmarkResult,
ResampleResult, Task, Measure, TaskClassif
fairness_compare_metrics.Rd: PredictionClassif, BenchmarkResult,
ResampleResult, Measure, TaskClassif, Task
fairness_prediction_density.Rd: PredictionClassif, ResampleResult,
BenchmarkResult, Task, TaskClassif
fairness_tensor.Rd: data.table, PredictionClassif, ResampleResult,
TaskClassif, Task
groupdiff_tau.Rd: Task
groupwise_metrics.Rd: Task
mlr_learners_classif.fairfgrrm.Rd: Learner, mlr_learners, lrn
mlr_learners_classif.fairzlrm.Rd: Learner, mlr_learners, lrn
mlr_learners_fairness.Rd: Task
mlr_learners_regr.fairfrrm.Rd: Learner, mlr_learners, lrn
mlr_learners_regr.fairnclm.Rd: Learner, mlr_learners, lrn
mlr_learners_regr.fairzlm.Rd: Learner, mlr_learners, lrn
mlr_measures_fairness.Rd: Task
mlr_pipeops_equalized_odds.Rd: R6Class, PipeOpTaskPreproc, PipeOp
mlr_pipeops_explicit_pta.Rd: R6Class, PipeOpTaskPreproc, PipeOp
mlr_pipeops_reweighing.Rd: R6Class, PipeOpTaskPreproc, PipeOp
report_fairness.Rd: Task
task_summary.Rd: Task
Please provide package anchors for all Rd \link{} targets not in the
package itself and the base packages.
Flavors: r-devel-linux-x86_64-debian-clang, r-devel-linux-x86_64-debian-gcc, r-devel-windows-x86_64, r-patched-linux-x86_64, r-release-linux-x86_64, r-release-windows-x86_64
Version: 0.3.2
Check: examples
Result: ERROR
Running examples in ‘mlr3fairness-Ex.R’ failed
The error most likely occurred in:
> base::assign(".ptime", proc.time(), pos = "CheckExEnv")
> ### Name: MeasureFairness
> ### Title: Base Measure for Fairness
> ### Aliases: MeasureFairness
>
> ### ** Examples
>
> library("mlr3")
> # Create MeasureFairness to measure the Predictive Parity.
> t = tsk("adult_train")
> learner = lrn("classif.rpart", cp = .01)
> learner$train(t)
> measure = msr("fairness", base_measure = msr("classif.ppv"))
> predictions = learner$predict(t)
> predictions$score(measure, task = t)
Error in prediction$clone()$filter(rws)$score(base_measure, task = task, :
unused argument (weights = NULL)
Calls: <Anonymous> ... score_groupwise -> map_dbl -> map_mold -> vapply -> FUN
Execution halted
Flavors: r-devel-linux-x86_64-debian-clang, r-devel-linux-x86_64-debian-gcc
Version: 0.3.2
Check: tests
Result: ERROR
Running ‘testthat.R’ [19s/22s]
Running the tests in ‘tests/testthat.R’ failed.
Complete output:
> if (requireNamespace("testthat", quietly = TRUE)) {
+ library("testthat")
+ library("checkmate")
+ library("mlr3")
+ library("mlr3pipelines")
+ library("mlr3fairness")
+ test_check("mlr3fairness")
+ }
INFO [03:15:42.446] [mlr3] Running benchmark with 12 resampling iterations
INFO [03:15:42.662] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/3)
INFO [03:15:42.736] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/3)
INFO [03:15:42.797] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 3/3)
INFO [03:15:42.843] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 1/3)
INFO [03:15:42.875] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 2/3)
INFO [03:15:42.915] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 3/3)
INFO [03:15:42.957] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 1/3)
INFO [03:15:43.002] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 2/3)
INFO [03:15:43.046] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 3/3)
INFO [03:15:43.089] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 1/3)
INFO [03:15:43.129] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 2/3)
INFO [03:15:43.174] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 3/3)
INFO [03:15:43.253] [mlr3] Finished benchmark
INFO [03:15:43.650] [mlr3] Running benchmark with 12 resampling iterations
INFO [03:15:43.698] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/3)
INFO [03:15:43.750] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/3)
INFO [03:15:43.806] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 3/3)
INFO [03:15:43.852] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 1/3)
INFO [03:15:43.891] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 2/3)
INFO [03:15:43.962] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 3/3)
INFO [03:15:44.031] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 1/3)
INFO [03:15:44.095] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 2/3)
INFO [03:15:44.140] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 3/3)
INFO [03:15:44.183] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 1/3)
INFO [03:15:44.216] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 2/3)
INFO [03:15:44.252] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 3/3)
INFO [03:15:44.287] [mlr3] Finished benchmark
INFO [03:15:44.538] [mlr3] Running benchmark with 12 resampling iterations
INFO [03:15:44.557] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/3)
INFO [03:15:44.601] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/3)
INFO [03:15:44.646] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 3/3)
INFO [03:15:44.691] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 1/3)
INFO [03:15:44.734] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 2/3)
INFO [03:15:44.767] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 3/3)
INFO [03:15:44.829] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 1/3)
INFO [03:15:44.872] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 2/3)
INFO [03:15:44.914] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 3/3)
INFO [03:15:44.955] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 1/3)
INFO [03:15:44.992] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 2/3)
INFO [03:15:45.028] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 3/3)
INFO [03:15:45.068] [mlr3] Finished benchmark
[ FAIL 21 | WARN 14 | SKIP 30 | PASS 99 ]
══ Skipped tests (30) ══════════════════════════════════════════════════════════
• On CRAN (30): 'test_datasets.R:16:3', 'test_datasets.R:32:3',
'test_datasets.R:47:3', 'test_learners_fairml.R:2:5',
'test_learners_fairml.R:12:5', 'test_learners_fairml.R:25:5',
'test_learners_fairml.R:39:5', 'test_learners_fairml.R:51:5',
'test_learners_fairml_ptas.R:2:5', 'test_learners_fairml_ptas.R:17:5',
'test_measure_subgroup.R:47:3', 'test_measure_subgroup.R:66:3',
'test_pipeop_eod.R:2:3', 'test_pipeop_eod.R:17:3', 'test_pipeop_eod.R:57:3',
'test_pipeop_explicit_pta.R:3:5', 'test_pipeop_explicit_pta.R:17:5',
'test_pipeop_reweighing.R:2:3', 'test_pipeop_reweighing.R:15:3',
'test_pipeop_reweighing.R:25:3', 'test_pipeop_reweighing.R:34:3',
'test_pipeop_reweighing.R:51:3', 'test_pipeop_reweighing.R:61:3',
'test_report_modelcard_datasheet.R:2:3',
'test_report_modelcard_datasheet.R:18:3',
'test_report_modelcard_datasheet.R:34:3',
'test_use_modelcard_datasheet.R:2:3', 'test_use_modelcard_datasheet.R:17:3',
'test_use_modelcard_datasheet.R:31:3', 'test_write_files.R:2:3'
══ Failed tests ════════════════════════════════════════════════════════════════
── Error ('test_measure_subgroup.R:20:3'): measure ─────────────────────────────
Error in `prediction$clone()$filter(rws)$score(self$base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─l$train(t)$predict(t)$score(m, t) at test_measure_subgroup.R:20:3
2. └─mlr3:::.__Prediction__score(...)
3. └─mlr3misc::map_dbl(...)
4. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
5. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
6. └─mlr3 (local) FUN(X[[i]], ...)
7. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
8. └─mlr3:::.__Measure__score(...)
9. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
10. └─get_private(measure)$.score(...)
11. └─mlr3fairness:::.__MeasureSubgroup__.score(...)
── Error ('test_measure_subgroup.R:32:3'): measure ─────────────────────────────
Error in `prediction$clone()$filter(rws)$score(self$base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─l$train(t)$predict(t)$score(m, t) at test_measure_subgroup.R:32:3
2. └─mlr3:::.__Prediction__score(...)
3. └─mlr3misc::map_dbl(...)
4. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
5. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
6. └─mlr3 (local) FUN(X[[i]], ...)
7. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
8. └─mlr3:::.__Measure__score(...)
9. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
10. └─get_private(measure)$.score(...)
11. └─mlr3fairness:::.__MeasureSubgroup__.score(...)
── Error ('test_measures.R:51:9'): fairness measures work as expcted ───────────
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─prd$score(measures = ms, task = tsk) at test_measures.R:51:9
2. └─mlr3:::.__Prediction__score(...)
3. └─mlr3misc::map_dbl(...)
4. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
5. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
6. └─mlr3 (local) FUN(X[[i]], ...)
7. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
8. └─mlr3:::.__Measure__score(...)
9. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
10. └─get_private(measure)$.score(...)
11. └─mlr3fairness:::.__MeasureFairness__.score(...)
12. └─mlr3fairness:::score_groupwise(...)
13. └─mlr3misc::map_dbl(...)
14. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
15. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
16. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:71:9'): fairness measures work as expected - simulated data ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─prd$score(measures = ms, task = tsk) at test_measures.R:71:9
2. └─mlr3:::.__Prediction__score(...)
3. └─mlr3misc::map_dbl(...)
4. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
5. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
6. └─mlr3 (local) FUN(X[[i]], ...)
7. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
8. └─mlr3:::.__Measure__score(...)
9. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
10. └─get_private(measure)$.score(...)
11. └─mlr3fairness:::.__MeasureFairness__.score(...)
12. └─mlr3fairness:::score_groupwise(...)
13. └─mlr3misc::map_dbl(...)
14. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
15. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
16. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:92:3'): fairness errors on missing pta, works with ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_equal(...) at test_measures.R:92:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. ├─base::unname(prd$score(msr("fairness.acc"), task = task))
5. └─prd$score(msr("fairness.acc"), task = task)
6. └─mlr3:::.__Prediction__score(...)
7. └─mlr3misc::map_dbl(...)
8. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
9. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
10. └─mlr3 (local) FUN(X[[i]], ...)
11. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
12. └─mlr3:::.__Measure__score(...)
13. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
14. └─get_private(measure)$.score(...)
15. └─mlr3fairness:::.__MeasureFairness__.score(...)
16. └─mlr3fairness:::score_groupwise(...)
17. └─mlr3misc::map_dbl(...)
18. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
19. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
20. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:111:3'): fairness works with non-binary pta ─────────
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─checkmate::expect_number(...) at test_measures.R:111:3
2. └─prd$score(msr("fairness.acc"), task = task)
3. └─mlr3:::.__Prediction__score(...)
4. └─mlr3misc::map_dbl(...)
5. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
6. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
7. └─mlr3 (local) FUN(X[[i]], ...)
8. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
9. └─mlr3:::.__Measure__score(...)
10. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
11. └─get_private(measure)$.score(...)
12. └─mlr3fairness:::.__MeasureFairness__.score(...)
13. └─mlr3fairness:::score_groupwise(...)
14. └─mlr3misc::map_dbl(...)
15. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
16. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
17. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:129:3'): fairness works on non-binary target ────────
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─checkmate::expect_number(...) at test_measures.R:129:3
2. └─prd$score(msr("fairness.acc"), task = task)
3. └─mlr3:::.__Prediction__score(...)
4. └─mlr3misc::map_dbl(...)
5. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
6. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
7. └─mlr3 (local) FUN(X[[i]], ...)
8. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
9. └─mlr3:::.__Measure__score(...)
10. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
11. └─get_private(measure)$.score(...)
12. └─mlr3fairness:::.__MeasureFairness__.score(...)
13. └─mlr3fairness:::score_groupwise(...)
14. └─mlr3misc::map_dbl(...)
15. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
16. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
17. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:140:3'): fairness.fpr can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_equal(...) at test_measures.R:140:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. ├─base::unname(round(predictions$score(msr_obj, test_data), 4))
5. └─predictions$score(msr_obj, test_data)
6. └─mlr3:::.__Prediction__score(...)
7. └─mlr3misc::map_dbl(...)
8. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
9. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
10. └─mlr3 (local) FUN(X[[i]], ...)
11. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
12. └─mlr3:::.__Measure__score(...)
13. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
14. └─get_private(measure)$.score(...)
15. └─mlr3fairness:::.__MeasureFairness__.score(...)
16. └─mlr3fairness:::score_groupwise(...)
17. └─mlr3misc::map_dbl(...)
18. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
19. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
20. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:145:3'): fairness.acc can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_lt(...) at test_measures.R:145:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. └─predictions$score(msr_obj, test_data)
5. └─mlr3:::.__Prediction__score(...)
6. └─mlr3misc::map_dbl(...)
7. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
8. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
9. └─mlr3 (local) FUN(X[[i]], ...)
10. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
11. └─mlr3:::.__Measure__score(...)
12. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
13. └─get_private(measure)$.score(...)
14. └─mlr3fairness:::.__MeasureFairness__.score(...)
15. └─mlr3fairness:::score_groupwise(...)
16. └─mlr3misc::map_dbl(...)
17. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
18. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
19. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:150:3'): fairness.fnr can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_lt(...) at test_measures.R:150:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. └─predictions$score(msr_obj, test_data)
5. └─mlr3:::.__Prediction__score(...)
6. └─mlr3misc::map_dbl(...)
7. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
8. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
9. └─mlr3 (local) FUN(X[[i]], ...)
10. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
11. └─mlr3:::.__Measure__score(...)
12. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
13. └─get_private(measure)$.score(...)
14. └─mlr3fairness:::.__MeasureFairness__.score(...)
15. └─mlr3fairness:::score_groupwise(...)
16. └─mlr3misc::map_dbl(...)
17. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
18. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
19. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:155:3'): fairness.tpr can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_lt(...) at test_measures.R:155:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. └─predictions$score(msr_obj, test_data)
5. └─mlr3:::.__Prediction__score(...)
6. └─mlr3misc::map_dbl(...)
7. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
8. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
9. └─mlr3 (local) FUN(X[[i]], ...)
10. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
11. └─mlr3:::.__Measure__score(...)
12. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
13. └─get_private(measure)$.score(...)
14. └─mlr3fairness:::.__MeasureFairness__.score(...)
15. └─mlr3fairness:::score_groupwise(...)
16. └─mlr3misc::map_dbl(...)
17. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
18. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
19. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:160:3'): fairness.ppv can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_lt(...) at test_measures.R:160:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. └─predictions$score(msr_obj, test_data)
5. └─mlr3:::.__Prediction__score(...)
6. └─mlr3misc::map_dbl(...)
7. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
8. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
9. └─mlr3 (local) FUN(X[[i]], ...)
10. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
11. └─mlr3:::.__Measure__score(...)
12. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
13. └─get_private(measure)$.score(...)
14. └─mlr3fairness:::.__MeasureFairness__.score(...)
15. └─mlr3fairness:::score_groupwise(...)
16. └─mlr3misc::map_dbl(...)
17. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
18. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
19. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:165:3'): fairness.npv can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_lt(...) at test_measures.R:165:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. └─predictions$score(msr_obj, test_data)
5. └─mlr3:::.__Prediction__score(...)
6. └─mlr3misc::map_dbl(...)
7. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
8. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
9. └─mlr3 (local) FUN(X[[i]], ...)
10. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
11. └─mlr3:::.__Measure__score(...)
12. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
13. └─get_private(measure)$.score(...)
14. └─mlr3fairness:::.__MeasureFairness__.score(...)
15. └─mlr3fairness:::score_groupwise(...)
16. └─mlr3misc::map_dbl(...)
17. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
18. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
19. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:170:3'): fairness.fp can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_equal(...) at test_measures.R:170:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. ├─base::unname(predictions$score(msr_obj, test_data))
5. └─predictions$score(msr_obj, test_data)
6. └─mlr3:::.__Prediction__score(...)
7. └─mlr3misc::map_dbl(...)
8. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
9. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
10. └─mlr3 (local) FUN(X[[i]], ...)
11. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
12. └─mlr3:::.__Measure__score(...)
13. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
14. └─get_private(measure)$.score(...)
15. └─mlr3fairness:::.__MeasureFairness__.score(...)
16. └─mlr3fairness:::score_groupwise(...)
17. └─mlr3misc::map_dbl(...)
18. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
19. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
20. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:175:3'): fairness.fn can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_equal(...) at test_measures.R:175:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. ├─base::unname(predictions$score(msr_obj, test_data))
5. └─predictions$score(msr_obj, test_data)
6. └─mlr3:::.__Prediction__score(...)
7. └─mlr3misc::map_dbl(...)
8. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
9. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
10. └─mlr3 (local) FUN(X[[i]], ...)
11. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
12. └─mlr3:::.__Measure__score(...)
13. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
14. └─get_private(measure)$.score(...)
15. └─mlr3fairness:::.__MeasureFairness__.score(...)
16. └─mlr3fairness:::score_groupwise(...)
17. └─mlr3misc::map_dbl(...)
18. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
19. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
20. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:180:3'): fairness.pp (disparate impact score) can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_equal(...) at test_measures.R:180:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. ├─base::unname(predictions$score(msr_obj, test_data))
5. └─predictions$score(msr_obj, test_data)
6. └─mlr3:::.__Prediction__score(...)
7. └─mlr3misc::map_dbl(...)
8. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
9. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
10. └─mlr3 (local) FUN(X[[i]], ...)
11. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
12. └─mlr3:::.__Measure__score(...)
13. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
14. └─get_private(measure)$.score(...)
15. └─mlr3fairness:::.__MeasureFairness__.score(...)
16. └─mlr3fairness:::score_groupwise(...)
17. └─mlr3misc::map_dbl(...)
18. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
19. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
20. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:194:7'): fairness constraint measures - simulated data ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─mlr3misc::map(...) at test_measures.R:192:3
2. └─base::lapply(.x, .f, ...)
3. └─mlr3fairness (local) FUN(X[[i]], ...)
4. └─mlr3misc::map_dbl(...) at test_measures.R:193:5
5. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
6. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
7. └─mlr3fairness (local) FUN(X[[i]], ...)
8. └─prd$score(measures = msr(m), task = tsk) at test_measures.R:194:7
9. └─mlr3:::.__Prediction__score(...)
10. └─mlr3misc::map_dbl(...)
11. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
12. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
13. └─mlr3 (local) FUN(X[[i]], ...)
14. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
15. └─mlr3:::.__Measure__score(...)
16. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
17. └─get_private(measure)$.score(...)
18. └─mlr3fairness:::.__MeasureFairness__.score(...)
19. └─mlr3fairness:::score_groupwise(...)
20. └─mlr3misc::map_dbl(...)
21. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
22. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
23. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:249:3'): Args are passed on correctly ───────────────
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─prd$score(mfa, task = t, train_set = 1:10) at test_measures.R:249:3
2. └─mlr3:::.__Prediction__score(...)
3. └─mlr3misc::map_dbl(...)
4. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
5. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
6. └─mlr3 (local) FUN(X[[i]], ...)
7. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
8. └─mlr3:::.__Measure__score(...)
9. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
10. └─get_private(measure)$.score(...)
11. └─mlr3fairness:::.__MeasureFairness__.score(...)
12. └─mlr3fairness:::score_groupwise(...)
13. └─mlr3misc::map_dbl(...)
14. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
15. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
16. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:271:11'): fairness measures work as expected - simulated data ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─prd$score(measures = ms, task = tsk) at test_measures.R:271:11
2. └─mlr3:::.__Prediction__score(...)
3. └─mlr3misc::map_dbl(...)
4. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
5. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
6. └─mlr3 (local) FUN(X[[i]], ...)
7. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
8. └─mlr3:::.__Measure__score(...)
9. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
10. └─get_private(measure)$.score(...)
11. └─mlr3fairness:::.__MeasureFairness__.score(...)
12. └─mlr3fairness:::score_groupwise(...)
13. └─mlr3misc::map_dbl(...)
14. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
15. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
16. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_visualizations.R:10:5'): fairness_accuracy_tradeoff ────────────
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─mlr3misc::map(...) at test_visualizations.R:9:3
2. └─base::lapply(.x, .f, ...)
3. └─mlr3fairness (local) FUN(X[[i]], ...)
4. ├─mlr3fairness:::check_plots(fairness_accuracy_tradeoff(bmr, fmsr)) at test_visualizations.R:10:5
5. │ ├─testthat::expect_true(is.ggplot(ggplot_obj)) at tests/testthat/helper_test.R:4:3
6. │ │ └─testthat::quasi_label(enquo(object), label, arg = "object")
7. │ │ └─rlang::eval_bare(expr, quo_get_env(quo))
8. │ └─ggplot2::is.ggplot(ggplot_obj)
9. │ └─ggplot2::is_ggplot(x)
10. ├─mlr3fairness::fairness_accuracy_tradeoff(bmr, fmsr)
11. └─mlr3fairness:::fairness_accuracy_tradeoff.BenchmarkResult(...)
12. └─object$aggregate(list(acc_measure, fairness_measure))
13. └─mlr3:::.__BenchmarkResult__aggregate(...)
14. └─mlr3misc::map_dtr(...)
15. ├─data.table::rbindlist(...)
16. ├─base::unname(map(.x, .f, ...))
17. └─mlr3misc::map(.x, .f, ...)
18. └─base::lapply(.x, .f, ...)
19. └─mlr3 (local) FUN(X[[i]], ...)
20. ├─base::as.list(resample_result_aggregate(rr, measures))
21. └─mlr3:::resample_result_aggregate(rr, measures)
22. ├─... %??% set_names(numeric(), character())
23. ├─base::unlist(...)
24. └─mlr3misc::map(...)
25. └─base::lapply(.x, .f, ...)
26. └─mlr3 (local) FUN(X[[i]], ...)
27. └─m$aggregate(rr)
28. └─mlr3:::.__Measure__aggregate(...)
29. └─mlr3:::score_measures(...)
30. └─mlr3misc::pmap_dbl(...)
31. └─mlr3misc:::mapply_list(.f, .x, list(...))
32. └─base::.mapply(.f, .dots, .args)
33. └─mlr3 (local) `<fn>`(...)
34. └─mlr3:::score_single_measure(...)
35. └─get_private(measure)$.score(...)
36. └─mlr3fairness:::.__MeasureFairness__.score(...)
37. └─mlr3fairness:::score_groupwise(...)
38. └─mlr3misc::map_dbl(...)
39. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
40. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
41. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_visualizations.R:33:3'): compare_metrics ───────────────────────
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─mlr3fairness:::check_plots(compare_metrics(bmr, fairness_measures)) at test_visualizations.R:33:3
2. │ ├─testthat::expect_true(is.ggplot(ggplot_obj)) at tests/testthat/helper_test.R:4:3
3. │ │ └─testthat::quasi_label(enquo(object), label, arg = "object")
4. │ │ └─rlang::eval_bare(expr, quo_get_env(quo))
5. │ └─ggplot2::is.ggplot(ggplot_obj)
6. │ └─ggplot2::is_ggplot(x)
7. ├─mlr3fairness::compare_metrics(bmr, fairness_measures)
8. └─mlr3fairness:::compare_metrics.BenchmarkResult(bmr, fairness_measures)
9. └─object$aggregate(measures, ...)
10. └─mlr3:::.__BenchmarkResult__aggregate(...)
11. └─mlr3misc::map_dtr(...)
12. ├─data.table::rbindlist(...)
13. ├─base::unname(map(.x, .f, ...))
14. └─mlr3misc::map(.x, .f, ...)
15. └─base::lapply(.x, .f, ...)
16. └─mlr3 (local) FUN(X[[i]], ...)
17. ├─base::as.list(resample_result_aggregate(rr, measures))
18. └─mlr3:::resample_result_aggregate(rr, measures)
19. ├─... %??% set_names(numeric(), character())
20. ├─base::unlist(...)
21. └─mlr3misc::map(...)
22. └─base::lapply(.x, .f, ...)
23. └─mlr3 (local) FUN(X[[i]], ...)
24. └─m$aggregate(rr)
25. └─mlr3:::.__Measure__aggregate(...)
26. └─mlr3:::score_measures(...)
27. └─mlr3misc::pmap_dbl(...)
28. └─mlr3misc:::mapply_list(.f, .x, list(...))
29. └─base::.mapply(.f, .dots, .args)
30. └─mlr3 (local) `<fn>`(...)
31. └─mlr3:::score_single_measure(...)
32. └─get_private(measure)$.score(...)
33. └─mlr3fairness:::.__MeasureFairness__.score(...)
34. └─mlr3fairness:::score_groupwise(...)
35. └─mlr3misc::map_dbl(...)
36. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
37. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
38. └─mlr3fairness (local) FUN(X[[i]], ...)
[ FAIL 21 | WARN 14 | SKIP 30 | PASS 99 ]
Error: Test failures
Execution halted
Flavor: r-devel-linux-x86_64-debian-clang
Version: 0.3.2
Check: re-building of vignette outputs
Result: ERROR
Error(s) in re-building vignettes:
...
--- re-building ‘debiasing-vignette.Rmd’ using rmarkdown
Quitting from debiasing-vignette.Rmd:55-57 [unnamed-chunk-4]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error in `task_set_roles()`:
! Assertion on 'roles' failed: Must be a subset of {'feature','target','name','order','stratum','group','offset','weights_learner','weights_measure','pta'}, but has additional elements {'weight'}.
This happened PipeOp reweighing_wts's $train()
---
Backtrace:
▆
1. ├─p1$train(list(task))
2. │ └─mlr3pipelines:::.__PipeOp__train(...)
3. │ ├─base::withCallingHandlers(...)
4. │ └─private$.train(input)
5. │ └─mlr3pipelines:::.__PipeOpTaskPreproc__.train(...)
6. │ └─private$.train_task(intask)
7. │ └─mlr3fairness:::.__PipeOpReweighingWeights__.train_task(...)
8. │ └─task$set_col_roles(weightcolname, "weight")
9. │ └─mlr3:::.__Task__set_col_roles(...)
10. │ └─mlr3:::task_set_roles(...)
11. │ └─checkmate::assert_subset(roles, names(li))
12. │ └─checkmate::makeAssertion(x, res, .var.name, add)
13. │ └─checkmate:::mstop(...)
14. │ └─base::stop(simpleError(sprintf(msg, ...), call.))
15. └─mlr3pipelines (local) `<fn>`(`<smplErrr>`)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'debiasing-vignette.Rmd' failed with diagnostics:
Assertion on 'roles' failed: Must be a subset of {'feature','target','name','order','stratum','group','offset','weights_learner','weights_measure','pta'}, but has additional elements {'weight'}.
This happened PipeOp reweighing_wts's $train()
--- failed re-building ‘debiasing-vignette.Rmd’
--- re-building ‘measures-vignette.Rmd’ using rmarkdown
Quitting from measures-vignette.Rmd:88-90 [unnamed-chunk-6]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error:
! unused argument (weights = NULL)
---
Backtrace:
▆
1. └─prd$score(msr("fairness.tpr"), task = test)
2. └─mlr3:::.__Prediction__score(...)
3. └─mlr3misc::map_dbl(...)
4. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
5. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
6. └─mlr3 (local) FUN(X[[i]], ...)
7. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
8. └─mlr3:::.__Measure__score(...)
9. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
10. └─get_private(measure)$.score(...)
11. └─mlr3fairness:::.__MeasureFairness__.score(...)
12. └─mlr3fairness:::score_groupwise(...)
13. └─mlr3misc::map_dbl(...)
14. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
15. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
16. └─mlr3fairness (local) FUN(X[[i]], ...)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'measures-vignette.Rmd' failed with diagnostics:
unused argument (weights = NULL)
--- failed re-building ‘measures-vignette.Rmd’
--- re-building ‘reports-vignette.Rmd’ using rmarkdown
Quitting from reports-vignette.Rmd:51-54 [build_modelcard_example_for_vignette]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error in `loadNamespace()`:
! there is no package called 'posterdown'
---
Backtrace:
▆
1. ├─rmarkdown::render(rmdfile)
2. │ └─rmarkdown:::create_output_format(output_format$name, output_format$options)
3. │ └─rmarkdown:::create_output_format_function(name)
4. │ └─base::eval(xfun::parse_only(name))
5. │ └─base::eval(xfun::parse_only(name))
6. └─base::loadNamespace(x)
7. └─base::withRestarts(stop(cond), retry_loadNamespace = function() NULL)
8. └─base (local) withOneRestart(expr, restarts[[1L]])
9. └─base (local) doWithOneRestart(return(expr), restart)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'reports-vignette.Rmd' failed with diagnostics:
there is no package called 'posterdown'
--- failed re-building ‘reports-vignette.Rmd’
--- re-building ‘visualization-vignette.Rmd’ using rmarkdown
** Processing: /home/hornik/tmp/R.check/r-devel-clang/Work/PKGS/mlr3fairness.Rcheck/vign_test/mlr3fairness/vignettes/visualization-vignette_files/figure-html/unnamed-chunk-6-1.png
288x288 pixels, 3x8 bits/pixel, RGB
Input IDAT size = 15540 bytes
Input file size = 15630 bytes
Trying:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 12393
zc = 9 zm = 8 zs = 1 f = 0
zc = 1 zm = 8 zs = 2 f = 0
zc = 9 zm = 8 zs = 3 f = 0
zc = 9 zm = 8 zs = 0 f = 5
zc = 9 zm = 8 zs = 1 f = 5
zc = 1 zm = 8 zs = 2 f = 5
zc = 9 zm = 8 zs = 3 f = 5
Selecting parameters:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 12393
Output IDAT size = 12393 bytes (3147 bytes decrease)
Output file size = 12471 bytes (3159 bytes = 20.21% decrease)
** Processing: /home/hornik/tmp/R.check/r-devel-clang/Work/PKGS/mlr3fairness.Rcheck/vign_test/mlr3fairness/vignettes/visualization-vignette_files/figure-html/unnamed-chunk-7-1.png
288x288 pixels, 3x8 bits/pixel, RGB
Input IDAT size = 17272 bytes
Input file size = 17374 bytes
Trying:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 13068
zc = 9 zm = 8 zs = 1 f = 0
zc = 1 zm = 8 zs = 2 f = 0
zc = 9 zm = 8 zs = 3 f = 0
zc = 9 zm = 8 zs = 0 f = 5
zc = 9 zm = 8 zs = 1 f = 5
zc = 1 zm = 8 zs = 2 f = 5
zc = 9 zm = 8 zs = 3 f = 5
Selecting parameters:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 13068
Output IDAT size = 13068 bytes (4204 bytes decrease)
Output file size = 13146 bytes (4228 bytes = 24.34% decrease)
Quitting from visualization-vignette.Rmd:88-90 [unnamed-chunk-8]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error:
! unused argument (weights = NULL)
---
Backtrace:
▆
1. ├─mlr3fairness::fairness_accuracy_tradeoff(bmr, msr("fairness.fpr"))
2. └─mlr3fairness:::fairness_accuracy_tradeoff.BenchmarkResult(...)
3. └─object$aggregate(list(acc_measure, fairness_measure))
4. └─mlr3:::.__BenchmarkResult__aggregate(...)
5. └─mlr3misc::map_dtr(...)
6. ├─data.table::rbindlist(...)
7. ├─base::unname(map(.x, .f, ...))
8. └─mlr3misc::map(.x, .f, ...)
9. └─base::lapply(.x, .f, ...)
10. └─mlr3 (local) FUN(X[[i]], ...)
11. ├─base::as.list(resample_result_aggregate(rr, measures))
12. └─mlr3:::resample_result_aggregate(rr, measures)
13. ├─... %??% set_names(numeric(), character())
14. ├─base::unlist(...)
15. └─mlr3misc::map(...)
16. └─base::lapply(.x, .f, ...)
17. └─mlr3 (local) FUN(X[[i]], ...)
18. └─m$aggregate(rr)
19. └─mlr3:::.__Measure__aggregate(...)
20. └─mlr3:::score_measures(...)
21. └─mlr3misc::pmap_dbl(...)
22. └─mlr3misc:::mapply_list(.f, .x, list(...))
23. └─base::.mapply(.f, .dots, .args)
24. └─mlr3 (local) `<fn>`(...)
25. └─mlr3:::score_single_measure(...)
26. └─get_private(measure)$.score(...)
27. └─mlr3fairness:::.__MeasureFairness__.score(...)
28. └─mlr3fairness:::score_groupwise(...)
29. └─mlr3misc::map_dbl(...)
30. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
31. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
32. └─mlr3fairness (local) FUN(X[[i]], ...)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'visualization-vignette.Rmd' failed with diagnostics:
unused argument (weights = NULL)
--- failed re-building ‘visualization-vignette.Rmd’
SUMMARY: processing the following files failed:
‘debiasing-vignette.Rmd’ ‘measures-vignette.Rmd’
‘reports-vignette.Rmd’ ‘visualization-vignette.Rmd’
Error: Vignette re-building failed.
Execution halted
Flavor: r-devel-linux-x86_64-debian-clang
Version: 0.3.2
Check: tests
Result: ERROR
Running ‘testthat.R’ [13s/16s]
Running the tests in ‘tests/testthat.R’ failed.
Complete output:
> if (requireNamespace("testthat", quietly = TRUE)) {
+ library("testthat")
+ library("checkmate")
+ library("mlr3")
+ library("mlr3pipelines")
+ library("mlr3fairness")
+ test_check("mlr3fairness")
+ }
INFO [16:53:56.115] [mlr3] Running benchmark with 12 resampling iterations
INFO [16:53:56.403] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/3)
INFO [16:53:56.505] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/3)
INFO [16:53:56.577] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 3/3)
INFO [16:53:56.644] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 1/3)
INFO [16:53:56.717] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 2/3)
INFO [16:53:56.780] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 3/3)
INFO [16:53:56.854] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 1/3)
INFO [16:53:56.884] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 2/3)
INFO [16:53:56.912] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 3/3)
INFO [16:53:56.939] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 1/3)
INFO [16:53:56.985] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 2/3)
INFO [16:53:57.006] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 3/3)
INFO [16:53:57.031] [mlr3] Finished benchmark
INFO [16:53:57.304] [mlr3] Running benchmark with 12 resampling iterations
INFO [16:53:57.349] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/3)
INFO [16:53:57.379] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/3)
INFO [16:53:57.409] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 3/3)
INFO [16:53:57.441] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 1/3)
INFO [16:53:57.464] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 2/3)
INFO [16:53:57.484] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 3/3)
INFO [16:53:57.592] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 1/3)
INFO [16:53:57.666] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 2/3)
INFO [16:53:57.751] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 3/3)
INFO [16:53:57.824] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 1/3)
INFO [16:53:57.880] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 2/3)
INFO [16:53:57.951] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 3/3)
INFO [16:53:58.025] [mlr3] Finished benchmark
INFO [16:53:58.255] [mlr3] Running benchmark with 12 resampling iterations
INFO [16:53:58.282] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/3)
INFO [16:53:58.342] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/3)
INFO [16:53:58.409] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 3/3)
INFO [16:53:58.475] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 1/3)
INFO [16:53:58.567] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 2/3)
INFO [16:53:58.674] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 3/3)
INFO [16:53:58.718] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 1/3)
INFO [16:53:58.747] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 2/3)
INFO [16:53:58.778] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 3/3)
INFO [16:53:58.813] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 1/3)
INFO [16:53:58.841] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 2/3)
INFO [16:53:58.864] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 3/3)
INFO [16:53:58.903] [mlr3] Finished benchmark
[ FAIL 21 | WARN 14 | SKIP 30 | PASS 99 ]
══ Skipped tests (30) ══════════════════════════════════════════════════════════
• On CRAN (30): 'test_datasets.R:16:3', 'test_datasets.R:32:3',
'test_datasets.R:47:3', 'test_learners_fairml.R:2:5',
'test_learners_fairml.R:12:5', 'test_learners_fairml.R:25:5',
'test_learners_fairml.R:39:5', 'test_learners_fairml.R:51:5',
'test_learners_fairml_ptas.R:2:5', 'test_learners_fairml_ptas.R:17:5',
'test_measure_subgroup.R:47:3', 'test_measure_subgroup.R:66:3',
'test_pipeop_eod.R:2:3', 'test_pipeop_eod.R:17:3', 'test_pipeop_eod.R:57:3',
'test_pipeop_explicit_pta.R:3:5', 'test_pipeop_explicit_pta.R:17:5',
'test_pipeop_reweighing.R:2:3', 'test_pipeop_reweighing.R:15:3',
'test_pipeop_reweighing.R:25:3', 'test_pipeop_reweighing.R:34:3',
'test_pipeop_reweighing.R:51:3', 'test_pipeop_reweighing.R:61:3',
'test_report_modelcard_datasheet.R:2:3',
'test_report_modelcard_datasheet.R:18:3',
'test_report_modelcard_datasheet.R:34:3',
'test_use_modelcard_datasheet.R:2:3', 'test_use_modelcard_datasheet.R:17:3',
'test_use_modelcard_datasheet.R:31:3', 'test_write_files.R:2:3'
══ Failed tests ════════════════════════════════════════════════════════════════
── Error ('test_measure_subgroup.R:20:3'): measure ─────────────────────────────
Error in `prediction$clone()$filter(rws)$score(self$base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─l$train(t)$predict(t)$score(m, t) at test_measure_subgroup.R:20:3
2. └─mlr3:::.__Prediction__score(...)
3. └─mlr3misc::map_dbl(...)
4. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
5. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
6. └─mlr3 (local) FUN(X[[i]], ...)
7. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
8. └─mlr3:::.__Measure__score(...)
9. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
10. └─get_private(measure)$.score(...)
11. └─mlr3fairness:::.__MeasureSubgroup__.score(...)
── Error ('test_measure_subgroup.R:32:3'): measure ─────────────────────────────
Error in `prediction$clone()$filter(rws)$score(self$base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─l$train(t)$predict(t)$score(m, t) at test_measure_subgroup.R:32:3
2. └─mlr3:::.__Prediction__score(...)
3. └─mlr3misc::map_dbl(...)
4. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
5. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
6. └─mlr3 (local) FUN(X[[i]], ...)
7. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
8. └─mlr3:::.__Measure__score(...)
9. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
10. └─get_private(measure)$.score(...)
11. └─mlr3fairness:::.__MeasureSubgroup__.score(...)
── Error ('test_measures.R:51:9'): fairness measures work as expcted ───────────
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─prd$score(measures = ms, task = tsk) at test_measures.R:51:9
2. └─mlr3:::.__Prediction__score(...)
3. └─mlr3misc::map_dbl(...)
4. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
5. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
6. └─mlr3 (local) FUN(X[[i]], ...)
7. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
8. └─mlr3:::.__Measure__score(...)
9. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
10. └─get_private(measure)$.score(...)
11. └─mlr3fairness:::.__MeasureFairness__.score(...)
12. └─mlr3fairness:::score_groupwise(...)
13. └─mlr3misc::map_dbl(...)
14. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
15. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
16. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:71:9'): fairness measures work as expected - simulated data ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─prd$score(measures = ms, task = tsk) at test_measures.R:71:9
2. └─mlr3:::.__Prediction__score(...)
3. └─mlr3misc::map_dbl(...)
4. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
5. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
6. └─mlr3 (local) FUN(X[[i]], ...)
7. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
8. └─mlr3:::.__Measure__score(...)
9. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
10. └─get_private(measure)$.score(...)
11. └─mlr3fairness:::.__MeasureFairness__.score(...)
12. └─mlr3fairness:::score_groupwise(...)
13. └─mlr3misc::map_dbl(...)
14. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
15. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
16. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:92:3'): fairness errors on missing pta, works with ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_equal(...) at test_measures.R:92:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. ├─base::unname(prd$score(msr("fairness.acc"), task = task))
5. └─prd$score(msr("fairness.acc"), task = task)
6. └─mlr3:::.__Prediction__score(...)
7. └─mlr3misc::map_dbl(...)
8. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
9. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
10. └─mlr3 (local) FUN(X[[i]], ...)
11. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
12. └─mlr3:::.__Measure__score(...)
13. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
14. └─get_private(measure)$.score(...)
15. └─mlr3fairness:::.__MeasureFairness__.score(...)
16. └─mlr3fairness:::score_groupwise(...)
17. └─mlr3misc::map_dbl(...)
18. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
19. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
20. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:111:3'): fairness works with non-binary pta ─────────
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─checkmate::expect_number(...) at test_measures.R:111:3
2. └─prd$score(msr("fairness.acc"), task = task)
3. └─mlr3:::.__Prediction__score(...)
4. └─mlr3misc::map_dbl(...)
5. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
6. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
7. └─mlr3 (local) FUN(X[[i]], ...)
8. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
9. └─mlr3:::.__Measure__score(...)
10. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
11. └─get_private(measure)$.score(...)
12. └─mlr3fairness:::.__MeasureFairness__.score(...)
13. └─mlr3fairness:::score_groupwise(...)
14. └─mlr3misc::map_dbl(...)
15. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
16. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
17. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:129:3'): fairness works on non-binary target ────────
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─checkmate::expect_number(...) at test_measures.R:129:3
2. └─prd$score(msr("fairness.acc"), task = task)
3. └─mlr3:::.__Prediction__score(...)
4. └─mlr3misc::map_dbl(...)
5. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
6. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
7. └─mlr3 (local) FUN(X[[i]], ...)
8. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
9. └─mlr3:::.__Measure__score(...)
10. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
11. └─get_private(measure)$.score(...)
12. └─mlr3fairness:::.__MeasureFairness__.score(...)
13. └─mlr3fairness:::score_groupwise(...)
14. └─mlr3misc::map_dbl(...)
15. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
16. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
17. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:140:3'): fairness.fpr can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_equal(...) at test_measures.R:140:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. ├─base::unname(round(predictions$score(msr_obj, test_data), 4))
5. └─predictions$score(msr_obj, test_data)
6. └─mlr3:::.__Prediction__score(...)
7. └─mlr3misc::map_dbl(...)
8. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
9. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
10. └─mlr3 (local) FUN(X[[i]], ...)
11. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
12. └─mlr3:::.__Measure__score(...)
13. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
14. └─get_private(measure)$.score(...)
15. └─mlr3fairness:::.__MeasureFairness__.score(...)
16. └─mlr3fairness:::score_groupwise(...)
17. └─mlr3misc::map_dbl(...)
18. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
19. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
20. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:145:3'): fairness.acc can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_lt(...) at test_measures.R:145:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. └─predictions$score(msr_obj, test_data)
5. └─mlr3:::.__Prediction__score(...)
6. └─mlr3misc::map_dbl(...)
7. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
8. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
9. └─mlr3 (local) FUN(X[[i]], ...)
10. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
11. └─mlr3:::.__Measure__score(...)
12. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
13. └─get_private(measure)$.score(...)
14. └─mlr3fairness:::.__MeasureFairness__.score(...)
15. └─mlr3fairness:::score_groupwise(...)
16. └─mlr3misc::map_dbl(...)
17. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
18. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
19. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:150:3'): fairness.fnr can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_lt(...) at test_measures.R:150:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. └─predictions$score(msr_obj, test_data)
5. └─mlr3:::.__Prediction__score(...)
6. └─mlr3misc::map_dbl(...)
7. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
8. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
9. └─mlr3 (local) FUN(X[[i]], ...)
10. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
11. └─mlr3:::.__Measure__score(...)
12. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
13. └─get_private(measure)$.score(...)
14. └─mlr3fairness:::.__MeasureFairness__.score(...)
15. └─mlr3fairness:::score_groupwise(...)
16. └─mlr3misc::map_dbl(...)
17. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
18. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
19. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:155:3'): fairness.tpr can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_lt(...) at test_measures.R:155:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. └─predictions$score(msr_obj, test_data)
5. └─mlr3:::.__Prediction__score(...)
6. └─mlr3misc::map_dbl(...)
7. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
8. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
9. └─mlr3 (local) FUN(X[[i]], ...)
10. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
11. └─mlr3:::.__Measure__score(...)
12. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
13. └─get_private(measure)$.score(...)
14. └─mlr3fairness:::.__MeasureFairness__.score(...)
15. └─mlr3fairness:::score_groupwise(...)
16. └─mlr3misc::map_dbl(...)
17. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
18. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
19. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:160:3'): fairness.ppv can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_lt(...) at test_measures.R:160:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. └─predictions$score(msr_obj, test_data)
5. └─mlr3:::.__Prediction__score(...)
6. └─mlr3misc::map_dbl(...)
7. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
8. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
9. └─mlr3 (local) FUN(X[[i]], ...)
10. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
11. └─mlr3:::.__Measure__score(...)
12. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
13. └─get_private(measure)$.score(...)
14. └─mlr3fairness:::.__MeasureFairness__.score(...)
15. └─mlr3fairness:::score_groupwise(...)
16. └─mlr3misc::map_dbl(...)
17. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
18. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
19. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:165:3'): fairness.npv can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_lt(...) at test_measures.R:165:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. └─predictions$score(msr_obj, test_data)
5. └─mlr3:::.__Prediction__score(...)
6. └─mlr3misc::map_dbl(...)
7. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
8. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
9. └─mlr3 (local) FUN(X[[i]], ...)
10. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
11. └─mlr3:::.__Measure__score(...)
12. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
13. └─get_private(measure)$.score(...)
14. └─mlr3fairness:::.__MeasureFairness__.score(...)
15. └─mlr3fairness:::score_groupwise(...)
16. └─mlr3misc::map_dbl(...)
17. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
18. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
19. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:170:3'): fairness.fp can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_equal(...) at test_measures.R:170:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. ├─base::unname(predictions$score(msr_obj, test_data))
5. └─predictions$score(msr_obj, test_data)
6. └─mlr3:::.__Prediction__score(...)
7. └─mlr3misc::map_dbl(...)
8. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
9. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
10. └─mlr3 (local) FUN(X[[i]], ...)
11. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
12. └─mlr3:::.__Measure__score(...)
13. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
14. └─get_private(measure)$.score(...)
15. └─mlr3fairness:::.__MeasureFairness__.score(...)
16. └─mlr3fairness:::score_groupwise(...)
17. └─mlr3misc::map_dbl(...)
18. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
19. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
20. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:175:3'): fairness.fn can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_equal(...) at test_measures.R:175:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. ├─base::unname(predictions$score(msr_obj, test_data))
5. └─predictions$score(msr_obj, test_data)
6. └─mlr3:::.__Prediction__score(...)
7. └─mlr3misc::map_dbl(...)
8. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
9. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
10. └─mlr3 (local) FUN(X[[i]], ...)
11. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
12. └─mlr3:::.__Measure__score(...)
13. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
14. └─get_private(measure)$.score(...)
15. └─mlr3fairness:::.__MeasureFairness__.score(...)
16. └─mlr3fairness:::score_groupwise(...)
17. └─mlr3misc::map_dbl(...)
18. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
19. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
20. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:180:3'): fairness.pp (disparate impact score) can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_equal(...) at test_measures.R:180:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. ├─base::unname(predictions$score(msr_obj, test_data))
5. └─predictions$score(msr_obj, test_data)
6. └─mlr3:::.__Prediction__score(...)
7. └─mlr3misc::map_dbl(...)
8. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
9. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
10. └─mlr3 (local) FUN(X[[i]], ...)
11. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
12. └─mlr3:::.__Measure__score(...)
13. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
14. └─get_private(measure)$.score(...)
15. └─mlr3fairness:::.__MeasureFairness__.score(...)
16. └─mlr3fairness:::score_groupwise(...)
17. └─mlr3misc::map_dbl(...)
18. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
19. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
20. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:194:7'): fairness constraint measures - simulated data ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─mlr3misc::map(...) at test_measures.R:192:3
2. └─base::lapply(.x, .f, ...)
3. └─mlr3fairness (local) FUN(X[[i]], ...)
4. └─mlr3misc::map_dbl(...) at test_measures.R:193:5
5. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
6. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
7. └─mlr3fairness (local) FUN(X[[i]], ...)
8. └─prd$score(measures = msr(m), task = tsk) at test_measures.R:194:7
9. └─mlr3:::.__Prediction__score(...)
10. └─mlr3misc::map_dbl(...)
11. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
12. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
13. └─mlr3 (local) FUN(X[[i]], ...)
14. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
15. └─mlr3:::.__Measure__score(...)
16. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
17. └─get_private(measure)$.score(...)
18. └─mlr3fairness:::.__MeasureFairness__.score(...)
19. └─mlr3fairness:::score_groupwise(...)
20. └─mlr3misc::map_dbl(...)
21. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
22. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
23. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:249:3'): Args are passed on correctly ───────────────
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─prd$score(mfa, task = t, train_set = 1:10) at test_measures.R:249:3
2. └─mlr3:::.__Prediction__score(...)
3. └─mlr3misc::map_dbl(...)
4. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
5. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
6. └─mlr3 (local) FUN(X[[i]], ...)
7. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
8. └─mlr3:::.__Measure__score(...)
9. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
10. └─get_private(measure)$.score(...)
11. └─mlr3fairness:::.__MeasureFairness__.score(...)
12. └─mlr3fairness:::score_groupwise(...)
13. └─mlr3misc::map_dbl(...)
14. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
15. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
16. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:271:11'): fairness measures work as expected - simulated data ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─prd$score(measures = ms, task = tsk) at test_measures.R:271:11
2. └─mlr3:::.__Prediction__score(...)
3. └─mlr3misc::map_dbl(...)
4. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
5. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
6. └─mlr3 (local) FUN(X[[i]], ...)
7. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
8. └─mlr3:::.__Measure__score(...)
9. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
10. └─get_private(measure)$.score(...)
11. └─mlr3fairness:::.__MeasureFairness__.score(...)
12. └─mlr3fairness:::score_groupwise(...)
13. └─mlr3misc::map_dbl(...)
14. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
15. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
16. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_visualizations.R:10:5'): fairness_accuracy_tradeoff ────────────
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─mlr3misc::map(...) at test_visualizations.R:9:3
2. └─base::lapply(.x, .f, ...)
3. └─mlr3fairness (local) FUN(X[[i]], ...)
4. ├─mlr3fairness:::check_plots(fairness_accuracy_tradeoff(bmr, fmsr)) at test_visualizations.R:10:5
5. │ ├─testthat::expect_true(is.ggplot(ggplot_obj)) at tests/testthat/helper_test.R:4:3
6. │ │ └─testthat::quasi_label(enquo(object), label, arg = "object")
7. │ │ └─rlang::eval_bare(expr, quo_get_env(quo))
8. │ └─ggplot2::is.ggplot(ggplot_obj)
9. │ └─ggplot2::is_ggplot(x)
10. ├─mlr3fairness::fairness_accuracy_tradeoff(bmr, fmsr)
11. └─mlr3fairness:::fairness_accuracy_tradeoff.BenchmarkResult(...)
12. └─object$aggregate(list(acc_measure, fairness_measure))
13. └─mlr3:::.__BenchmarkResult__aggregate(...)
14. └─mlr3misc::map_dtr(...)
15. ├─data.table::rbindlist(...)
16. ├─base::unname(map(.x, .f, ...))
17. └─mlr3misc::map(.x, .f, ...)
18. └─base::lapply(.x, .f, ...)
19. └─mlr3 (local) FUN(X[[i]], ...)
20. ├─base::as.list(resample_result_aggregate(rr, measures))
21. └─mlr3:::resample_result_aggregate(rr, measures)
22. ├─... %??% set_names(numeric(), character())
23. ├─base::unlist(...)
24. └─mlr3misc::map(...)
25. └─base::lapply(.x, .f, ...)
26. └─mlr3 (local) FUN(X[[i]], ...)
27. └─m$aggregate(rr)
28. └─mlr3:::.__Measure__aggregate(...)
29. └─mlr3:::score_measures(...)
30. └─mlr3misc::pmap_dbl(...)
31. └─mlr3misc:::mapply_list(.f, .x, list(...))
32. └─base::.mapply(.f, .dots, .args)
33. └─mlr3 (local) `<fn>`(...)
34. └─mlr3:::score_single_measure(...)
35. └─get_private(measure)$.score(...)
36. └─mlr3fairness:::.__MeasureFairness__.score(...)
37. └─mlr3fairness:::score_groupwise(...)
38. └─mlr3misc::map_dbl(...)
39. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
40. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
41. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_visualizations.R:33:3'): compare_metrics ───────────────────────
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─mlr3fairness:::check_plots(compare_metrics(bmr, fairness_measures)) at test_visualizations.R:33:3
2. │ ├─testthat::expect_true(is.ggplot(ggplot_obj)) at tests/testthat/helper_test.R:4:3
3. │ │ └─testthat::quasi_label(enquo(object), label, arg = "object")
4. │ │ └─rlang::eval_bare(expr, quo_get_env(quo))
5. │ └─ggplot2::is.ggplot(ggplot_obj)
6. │ └─ggplot2::is_ggplot(x)
7. ├─mlr3fairness::compare_metrics(bmr, fairness_measures)
8. └─mlr3fairness:::compare_metrics.BenchmarkResult(bmr, fairness_measures)
9. └─object$aggregate(measures, ...)
10. └─mlr3:::.__BenchmarkResult__aggregate(...)
11. └─mlr3misc::map_dtr(...)
12. ├─data.table::rbindlist(...)
13. ├─base::unname(map(.x, .f, ...))
14. └─mlr3misc::map(.x, .f, ...)
15. └─base::lapply(.x, .f, ...)
16. └─mlr3 (local) FUN(X[[i]], ...)
17. ├─base::as.list(resample_result_aggregate(rr, measures))
18. └─mlr3:::resample_result_aggregate(rr, measures)
19. ├─... %??% set_names(numeric(), character())
20. ├─base::unlist(...)
21. └─mlr3misc::map(...)
22. └─base::lapply(.x, .f, ...)
23. └─mlr3 (local) FUN(X[[i]], ...)
24. └─m$aggregate(rr)
25. └─mlr3:::.__Measure__aggregate(...)
26. └─mlr3:::score_measures(...)
27. └─mlr3misc::pmap_dbl(...)
28. └─mlr3misc:::mapply_list(.f, .x, list(...))
29. └─base::.mapply(.f, .dots, .args)
30. └─mlr3 (local) `<fn>`(...)
31. └─mlr3:::score_single_measure(...)
32. └─get_private(measure)$.score(...)
33. └─mlr3fairness:::.__MeasureFairness__.score(...)
34. └─mlr3fairness:::score_groupwise(...)
35. └─mlr3misc::map_dbl(...)
36. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
37. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
38. └─mlr3fairness (local) FUN(X[[i]], ...)
[ FAIL 21 | WARN 14 | SKIP 30 | PASS 99 ]
Error: Test failures
Execution halted
Flavor: r-devel-linux-x86_64-debian-gcc
Version: 0.3.2
Check: re-building of vignette outputs
Result: ERROR
Error(s) in re-building vignettes:
...
--- re-building ‘debiasing-vignette.Rmd’ using rmarkdown
Quitting from debiasing-vignette.Rmd:55-57 [unnamed-chunk-4]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error in `task_set_roles()`:
! Assertion on 'roles' failed: Must be a subset of {'feature','target','name','order','stratum','group','offset','weights_learner','weights_measure','pta'}, but has additional elements {'weight'}.
This happened PipeOp reweighing_wts's $train()
---
Backtrace:
▆
1. ├─p1$train(list(task))
2. │ └─mlr3pipelines:::.__PipeOp__train(...)
3. │ ├─base::withCallingHandlers(...)
4. │ └─private$.train(input)
5. │ └─mlr3pipelines:::.__PipeOpTaskPreproc__.train(...)
6. │ └─private$.train_task(intask)
7. │ └─mlr3fairness:::.__PipeOpReweighingWeights__.train_task(...)
8. │ └─task$set_col_roles(weightcolname, "weight")
9. │ └─mlr3:::.__Task__set_col_roles(...)
10. │ └─mlr3:::task_set_roles(...)
11. │ └─checkmate::assert_subset(roles, names(li))
12. │ └─checkmate::makeAssertion(x, res, .var.name, add)
13. │ └─checkmate:::mstop(...)
14. │ └─base::stop(simpleError(sprintf(msg, ...), call.))
15. └─mlr3pipelines (local) `<fn>`(`<smplErrr>`)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'debiasing-vignette.Rmd' failed with diagnostics:
Assertion on 'roles' failed: Must be a subset of {'feature','target','name','order','stratum','group','offset','weights_learner','weights_measure','pta'}, but has additional elements {'weight'}.
This happened PipeOp reweighing_wts's $train()
--- failed re-building ‘debiasing-vignette.Rmd’
--- re-building ‘measures-vignette.Rmd’ using rmarkdown
Quitting from measures-vignette.Rmd:88-90 [unnamed-chunk-6]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error:
! unused argument (weights = NULL)
---
Backtrace:
▆
1. └─prd$score(msr("fairness.tpr"), task = test)
2. └─mlr3:::.__Prediction__score(...)
3. └─mlr3misc::map_dbl(...)
4. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
5. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
6. └─mlr3 (local) FUN(X[[i]], ...)
7. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
8. └─mlr3:::.__Measure__score(...)
9. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
10. └─get_private(measure)$.score(...)
11. └─mlr3fairness:::.__MeasureFairness__.score(...)
12. └─mlr3fairness:::score_groupwise(...)
13. └─mlr3misc::map_dbl(...)
14. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
15. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
16. └─mlr3fairness (local) FUN(X[[i]], ...)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'measures-vignette.Rmd' failed with diagnostics:
unused argument (weights = NULL)
--- failed re-building ‘measures-vignette.Rmd’
--- re-building ‘reports-vignette.Rmd’ using rmarkdown
Quitting from reports-vignette.Rmd:51-54 [build_modelcard_example_for_vignette]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error in `loadNamespace()`:
! there is no package called 'posterdown'
---
Backtrace:
▆
1. ├─rmarkdown::render(rmdfile)
2. │ └─rmarkdown:::create_output_format(output_format$name, output_format$options)
3. │ └─rmarkdown:::create_output_format_function(name)
4. │ └─base::eval(xfun::parse_only(name))
5. │ └─base::eval(xfun::parse_only(name))
6. └─base::loadNamespace(x)
7. └─base::withRestarts(stop(cond), retry_loadNamespace = function() NULL)
8. └─base (local) withOneRestart(expr, restarts[[1L]])
9. └─base (local) doWithOneRestart(return(expr), restart)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'reports-vignette.Rmd' failed with diagnostics:
there is no package called 'posterdown'
--- failed re-building ‘reports-vignette.Rmd’
--- re-building ‘visualization-vignette.Rmd’ using rmarkdown
** Processing: /home/hornik/tmp/R.check/r-devel-gcc/Work/PKGS/mlr3fairness.Rcheck/vign_test/mlr3fairness/vignettes/visualization-vignette_files/figure-html/unnamed-chunk-6-1.png
288x288 pixels, 3x8 bits/pixel, RGB
Input IDAT size = 15526 bytes
Input file size = 15616 bytes
Trying:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 12408
zc = 9 zm = 8 zs = 1 f = 0
zc = 1 zm = 8 zs = 2 f = 0
zc = 9 zm = 8 zs = 3 f = 0
zc = 9 zm = 8 zs = 0 f = 5
zc = 9 zm = 8 zs = 1 f = 5
zc = 1 zm = 8 zs = 2 f = 5
zc = 9 zm = 8 zs = 3 f = 5
Selecting parameters:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 12408
Output IDAT size = 12408 bytes (3118 bytes decrease)
Output file size = 12486 bytes (3130 bytes = 20.04% decrease)
** Processing: /home/hornik/tmp/R.check/r-devel-gcc/Work/PKGS/mlr3fairness.Rcheck/vign_test/mlr3fairness/vignettes/visualization-vignette_files/figure-html/unnamed-chunk-7-1.png
288x288 pixels, 3x8 bits/pixel, RGB
Input IDAT size = 18922 bytes
Input file size = 19024 bytes
Trying:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 14363
zc = 9 zm = 8 zs = 1 f = 0
zc = 1 zm = 8 zs = 2 f = 0
zc = 9 zm = 8 zs = 3 f = 0
zc = 9 zm = 8 zs = 0 f = 5
zc = 9 zm = 8 zs = 1 f = 5
zc = 1 zm = 8 zs = 2 f = 5
zc = 9 zm = 8 zs = 3 f = 5
Selecting parameters:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 14363
Output IDAT size = 14363 bytes (4559 bytes decrease)
Output file size = 14441 bytes (4583 bytes = 24.09% decrease)
Quitting from visualization-vignette.Rmd:88-90 [unnamed-chunk-8]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error:
! unused argument (weights = NULL)
---
Backtrace:
▆
1. ├─mlr3fairness::fairness_accuracy_tradeoff(bmr, msr("fairness.fpr"))
2. └─mlr3fairness:::fairness_accuracy_tradeoff.BenchmarkResult(...)
3. └─object$aggregate(list(acc_measure, fairness_measure))
4. └─mlr3:::.__BenchmarkResult__aggregate(...)
5. └─mlr3misc::map_dtr(...)
6. ├─data.table::rbindlist(...)
7. ├─base::unname(map(.x, .f, ...))
8. └─mlr3misc::map(.x, .f, ...)
9. └─base::lapply(.x, .f, ...)
10. └─mlr3 (local) FUN(X[[i]], ...)
11. ├─base::as.list(resample_result_aggregate(rr, measures))
12. └─mlr3:::resample_result_aggregate(rr, measures)
13. ├─... %??% set_names(numeric(), character())
14. ├─base::unlist(...)
15. └─mlr3misc::map(...)
16. └─base::lapply(.x, .f, ...)
17. └─mlr3 (local) FUN(X[[i]], ...)
18. └─m$aggregate(rr)
19. └─mlr3:::.__Measure__aggregate(...)
20. └─mlr3:::score_measures(...)
21. └─mlr3misc::pmap_dbl(...)
22. └─mlr3misc:::mapply_list(.f, .x, list(...))
23. └─base::.mapply(.f, .dots, .args)
24. └─mlr3 (local) `<fn>`(...)
25. └─mlr3:::score_single_measure(...)
26. └─get_private(measure)$.score(...)
27. └─mlr3fairness:::.__MeasureFairness__.score(...)
28. └─mlr3fairness:::score_groupwise(...)
29. └─mlr3misc::map_dbl(...)
30. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
31. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
32. └─mlr3fairness (local) FUN(X[[i]], ...)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'visualization-vignette.Rmd' failed with diagnostics:
unused argument (weights = NULL)
--- failed re-building ‘visualization-vignette.Rmd’
SUMMARY: processing the following files failed:
‘debiasing-vignette.Rmd’ ‘measures-vignette.Rmd’
‘reports-vignette.Rmd’ ‘visualization-vignette.Rmd’
Error: Vignette re-building failed.
Execution halted
Flavor: r-devel-linux-x86_64-debian-gcc
Version: 0.3.2
Check: examples
Result: ERROR
Running examples in ‘mlr3fairness-Ex.R’ failed
The error most likely occurred in:
> ### Name: MeasureFairness
> ### Title: Base Measure for Fairness
> ### Aliases: MeasureFairness
>
> ### ** Examples
>
> library("mlr3")
> # Create MeasureFairness to measure the Predictive Parity.
> t = tsk("adult_train")
> learner = lrn("classif.rpart", cp = .01)
> learner$train(t)
> measure = msr("fairness", base_measure = msr("classif.ppv"))
> predictions = learner$predict(t)
> predictions$score(measure, task = t)
Error in prediction$clone()$filter(rws)$score(base_measure, task = task, :
unused argument (weights = NULL)
Calls: <Anonymous> ... score_groupwise -> map_dbl -> map_mold -> vapply -> FUN
Execution halted
Flavors: r-devel-linux-x86_64-fedora-clang, r-devel-linux-x86_64-fedora-gcc, r-devel-windows-x86_64
Version: 0.3.2
Check: tests
Result: ERROR
Running ‘testthat.R’ [26s/54s]
Running the tests in ‘tests/testthat.R’ failed.
Complete output:
> if (requireNamespace("testthat", quietly = TRUE)) {
+ library("testthat")
+ library("checkmate")
+ library("mlr3")
+ library("mlr3pipelines")
+ library("mlr3fairness")
+ test_check("mlr3fairness")
+ }
INFO [12:15:07.047] [mlr3] Running benchmark with 12 resampling iterations
INFO [12:15:08.137] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/3)
INFO [12:15:08.508] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/3)
INFO [12:15:08.738] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 3/3)
INFO [12:15:08.956] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 1/3)
INFO [12:15:09.111] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 2/3)
INFO [12:15:09.340] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 3/3)
INFO [12:15:09.495] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 1/3)
INFO [12:15:09.728] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 2/3)
INFO [12:15:09.901] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 3/3)
INFO [12:15:10.086] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 1/3)
INFO [12:15:10.224] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 2/3)
INFO [12:15:10.330] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 3/3)
INFO [12:15:10.462] [mlr3] Finished benchmark
INFO [12:15:11.784] [mlr3] Running benchmark with 12 resampling iterations
INFO [12:15:12.198] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/3)
INFO [12:15:12.360] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/3)
INFO [12:15:12.550] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 3/3)
INFO [12:15:12.735] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 1/3)
INFO [12:15:12.876] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 2/3)
INFO [12:15:13.022] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 3/3)
INFO [12:15:13.150] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 1/3)
INFO [12:15:13.305] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 2/3)
INFO [12:15:13.400] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 3/3)
INFO [12:15:13.491] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 1/3)
INFO [12:15:13.542] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 2/3)
INFO [12:15:13.658] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 3/3)
INFO [12:15:13.713] [mlr3] Finished benchmark
INFO [12:15:14.190] [mlr3] Running benchmark with 12 resampling iterations
INFO [12:15:14.220] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/3)
INFO [12:15:14.382] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/3)
INFO [12:15:14.449] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 3/3)
INFO [12:15:14.516] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 1/3)
INFO [12:15:14.574] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 2/3)
INFO [12:15:14.623] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 3/3)
INFO [12:15:14.711] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 1/3)
INFO [12:15:15.040] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 2/3)
INFO [12:15:15.198] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 3/3)
INFO [12:15:15.329] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 1/3)
INFO [12:15:15.500] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 2/3)
INFO [12:15:15.630] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 3/3)
INFO [12:15:15.764] [mlr3] Finished benchmark
[ FAIL 21 | WARN 14 | SKIP 30 | PASS 99 ]
══ Skipped tests (30) ══════════════════════════════════════════════════════════
• On CRAN (30): 'test_datasets.R:16:3', 'test_datasets.R:32:3',
'test_datasets.R:47:3', 'test_learners_fairml.R:2:5',
'test_learners_fairml.R:12:5', 'test_learners_fairml.R:25:5',
'test_learners_fairml.R:39:5', 'test_learners_fairml.R:51:5',
'test_learners_fairml_ptas.R:2:5', 'test_learners_fairml_ptas.R:17:5',
'test_measure_subgroup.R:47:3', 'test_measure_subgroup.R:66:3',
'test_pipeop_eod.R:2:3', 'test_pipeop_eod.R:17:3', 'test_pipeop_eod.R:57:3',
'test_pipeop_explicit_pta.R:3:5', 'test_pipeop_explicit_pta.R:17:5',
'test_pipeop_reweighing.R:2:3', 'test_pipeop_reweighing.R:15:3',
'test_pipeop_reweighing.R:25:3', 'test_pipeop_reweighing.R:34:3',
'test_pipeop_reweighing.R:51:3', 'test_pipeop_reweighing.R:61:3',
'test_report_modelcard_datasheet.R:2:3',
'test_report_modelcard_datasheet.R:18:3',
'test_report_modelcard_datasheet.R:34:3',
'test_use_modelcard_datasheet.R:2:3', 'test_use_modelcard_datasheet.R:17:3',
'test_use_modelcard_datasheet.R:31:3', 'test_write_files.R:2:3'
══ Failed tests ════════════════════════════════════════════════════════════════
── Error ('test_measure_subgroup.R:20:3'): measure ─────────────────────────────
Error in `prediction$clone()$filter(rws)$score(self$base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─l$train(t)$predict(t)$score(m, t) at test_measure_subgroup.R:20:3
2. └─mlr3:::.__Prediction__score(...)
3. └─mlr3misc::map_dbl(...)
4. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
5. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
6. └─mlr3 (local) FUN(X[[i]], ...)
7. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
8. └─mlr3:::.__Measure__score(...)
9. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
10. └─get_private(measure)$.score(...)
11. └─mlr3fairness:::.__MeasureSubgroup__.score(...)
── Error ('test_measure_subgroup.R:32:3'): measure ─────────────────────────────
Error in `prediction$clone()$filter(rws)$score(self$base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─l$train(t)$predict(t)$score(m, t) at test_measure_subgroup.R:32:3
2. └─mlr3:::.__Prediction__score(...)
3. └─mlr3misc::map_dbl(...)
4. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
5. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
6. └─mlr3 (local) FUN(X[[i]], ...)
7. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
8. └─mlr3:::.__Measure__score(...)
9. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
10. └─get_private(measure)$.score(...)
11. └─mlr3fairness:::.__MeasureSubgroup__.score(...)
── Error ('test_measures.R:51:9'): fairness measures work as expcted ───────────
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─prd$score(measures = ms, task = tsk) at test_measures.R:51:9
2. └─mlr3:::.__Prediction__score(...)
3. └─mlr3misc::map_dbl(...)
4. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
5. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
6. └─mlr3 (local) FUN(X[[i]], ...)
7. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
8. └─mlr3:::.__Measure__score(...)
9. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
10. └─get_private(measure)$.score(...)
11. └─mlr3fairness:::.__MeasureFairness__.score(...)
12. └─mlr3fairness:::score_groupwise(...)
13. └─mlr3misc::map_dbl(...)
14. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
15. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
16. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:71:9'): fairness measures work as expected - simulated data ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─prd$score(measures = ms, task = tsk) at test_measures.R:71:9
2. └─mlr3:::.__Prediction__score(...)
3. └─mlr3misc::map_dbl(...)
4. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
5. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
6. └─mlr3 (local) FUN(X[[i]], ...)
7. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
8. └─mlr3:::.__Measure__score(...)
9. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
10. └─get_private(measure)$.score(...)
11. └─mlr3fairness:::.__MeasureFairness__.score(...)
12. └─mlr3fairness:::score_groupwise(...)
13. └─mlr3misc::map_dbl(...)
14. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
15. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
16. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:92:3'): fairness errors on missing pta, works with ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_equal(...) at test_measures.R:92:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. ├─base::unname(prd$score(msr("fairness.acc"), task = task))
5. └─prd$score(msr("fairness.acc"), task = task)
6. └─mlr3:::.__Prediction__score(...)
7. └─mlr3misc::map_dbl(...)
8. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
9. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
10. └─mlr3 (local) FUN(X[[i]], ...)
11. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
12. └─mlr3:::.__Measure__score(...)
13. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
14. └─get_private(measure)$.score(...)
15. └─mlr3fairness:::.__MeasureFairness__.score(...)
16. └─mlr3fairness:::score_groupwise(...)
17. └─mlr3misc::map_dbl(...)
18. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
19. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
20. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:111:3'): fairness works with non-binary pta ─────────
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─checkmate::expect_number(...) at test_measures.R:111:3
2. └─prd$score(msr("fairness.acc"), task = task)
3. └─mlr3:::.__Prediction__score(...)
4. └─mlr3misc::map_dbl(...)
5. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
6. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
7. └─mlr3 (local) FUN(X[[i]], ...)
8. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
9. └─mlr3:::.__Measure__score(...)
10. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
11. └─get_private(measure)$.score(...)
12. └─mlr3fairness:::.__MeasureFairness__.score(...)
13. └─mlr3fairness:::score_groupwise(...)
14. └─mlr3misc::map_dbl(...)
15. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
16. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
17. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:129:3'): fairness works on non-binary target ────────
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─checkmate::expect_number(...) at test_measures.R:129:3
2. └─prd$score(msr("fairness.acc"), task = task)
3. └─mlr3:::.__Prediction__score(...)
4. └─mlr3misc::map_dbl(...)
5. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
6. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
7. └─mlr3 (local) FUN(X[[i]], ...)
8. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
9. └─mlr3:::.__Measure__score(...)
10. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
11. └─get_private(measure)$.score(...)
12. └─mlr3fairness:::.__MeasureFairness__.score(...)
13. └─mlr3fairness:::score_groupwise(...)
14. └─mlr3misc::map_dbl(...)
15. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
16. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
17. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:140:3'): fairness.fpr can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_equal(...) at test_measures.R:140:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. ├─base::unname(round(predictions$score(msr_obj, test_data), 4))
5. └─predictions$score(msr_obj, test_data)
6. └─mlr3:::.__Prediction__score(...)
7. └─mlr3misc::map_dbl(...)
8. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
9. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
10. └─mlr3 (local) FUN(X[[i]], ...)
11. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
12. └─mlr3:::.__Measure__score(...)
13. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
14. └─get_private(measure)$.score(...)
15. └─mlr3fairness:::.__MeasureFairness__.score(...)
16. └─mlr3fairness:::score_groupwise(...)
17. └─mlr3misc::map_dbl(...)
18. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
19. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
20. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:145:3'): fairness.acc can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_lt(...) at test_measures.R:145:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. └─predictions$score(msr_obj, test_data)
5. └─mlr3:::.__Prediction__score(...)
6. └─mlr3misc::map_dbl(...)
7. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
8. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
9. └─mlr3 (local) FUN(X[[i]], ...)
10. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
11. └─mlr3:::.__Measure__score(...)
12. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
13. └─get_private(measure)$.score(...)
14. └─mlr3fairness:::.__MeasureFairness__.score(...)
15. └─mlr3fairness:::score_groupwise(...)
16. └─mlr3misc::map_dbl(...)
17. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
18. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
19. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:150:3'): fairness.fnr can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_lt(...) at test_measures.R:150:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. └─predictions$score(msr_obj, test_data)
5. └─mlr3:::.__Prediction__score(...)
6. └─mlr3misc::map_dbl(...)
7. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
8. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
9. └─mlr3 (local) FUN(X[[i]], ...)
10. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
11. └─mlr3:::.__Measure__score(...)
12. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
13. └─get_private(measure)$.score(...)
14. └─mlr3fairness:::.__MeasureFairness__.score(...)
15. └─mlr3fairness:::score_groupwise(...)
16. └─mlr3misc::map_dbl(...)
17. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
18. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
19. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:155:3'): fairness.tpr can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_lt(...) at test_measures.R:155:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. └─predictions$score(msr_obj, test_data)
5. └─mlr3:::.__Prediction__score(...)
6. └─mlr3misc::map_dbl(...)
7. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
8. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
9. └─mlr3 (local) FUN(X[[i]], ...)
10. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
11. └─mlr3:::.__Measure__score(...)
12. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
13. └─get_private(measure)$.score(...)
14. └─mlr3fairness:::.__MeasureFairness__.score(...)
15. └─mlr3fairness:::score_groupwise(...)
16. └─mlr3misc::map_dbl(...)
17. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
18. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
19. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:160:3'): fairness.ppv can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_lt(...) at test_measures.R:160:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. └─predictions$score(msr_obj, test_data)
5. └─mlr3:::.__Prediction__score(...)
6. └─mlr3misc::map_dbl(...)
7. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
8. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
9. └─mlr3 (local) FUN(X[[i]], ...)
10. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
11. └─mlr3:::.__Measure__score(...)
12. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
13. └─get_private(measure)$.score(...)
14. └─mlr3fairness:::.__MeasureFairness__.score(...)
15. └─mlr3fairness:::score_groupwise(...)
16. └─mlr3misc::map_dbl(...)
17. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
18. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
19. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:165:3'): fairness.npv can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_lt(...) at test_measures.R:165:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. └─predictions$score(msr_obj, test_data)
5. └─mlr3:::.__Prediction__score(...)
6. └─mlr3misc::map_dbl(...)
7. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
8. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
9. └─mlr3 (local) FUN(X[[i]], ...)
10. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
11. └─mlr3:::.__Measure__score(...)
12. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
13. └─get_private(measure)$.score(...)
14. └─mlr3fairness:::.__MeasureFairness__.score(...)
15. └─mlr3fairness:::score_groupwise(...)
16. └─mlr3misc::map_dbl(...)
17. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
18. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
19. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:170:3'): fairness.fp can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_equal(...) at test_measures.R:170:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. ├─base::unname(predictions$score(msr_obj, test_data))
5. └─predictions$score(msr_obj, test_data)
6. └─mlr3:::.__Prediction__score(...)
7. └─mlr3misc::map_dbl(...)
8. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
9. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
10. └─mlr3 (local) FUN(X[[i]], ...)
11. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
12. └─mlr3:::.__Measure__score(...)
13. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
14. └─get_private(measure)$.score(...)
15. └─mlr3fairness:::.__MeasureFairness__.score(...)
16. └─mlr3fairness:::score_groupwise(...)
17. └─mlr3misc::map_dbl(...)
18. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
19. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
20. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:175:3'): fairness.fn can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_equal(...) at test_measures.R:175:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. ├─base::unname(predictions$score(msr_obj, test_data))
5. └─predictions$score(msr_obj, test_data)
6. └─mlr3:::.__Prediction__score(...)
7. └─mlr3misc::map_dbl(...)
8. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
9. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
10. └─mlr3 (local) FUN(X[[i]], ...)
11. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
12. └─mlr3:::.__Measure__score(...)
13. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
14. └─get_private(measure)$.score(...)
15. └─mlr3fairness:::.__MeasureFairness__.score(...)
16. └─mlr3fairness:::score_groupwise(...)
17. └─mlr3misc::map_dbl(...)
18. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
19. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
20. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:180:3'): fairness.pp (disparate impact score) can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_equal(...) at test_measures.R:180:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. ├─base::unname(predictions$score(msr_obj, test_data))
5. └─predictions$score(msr_obj, test_data)
6. └─mlr3:::.__Prediction__score(...)
7. └─mlr3misc::map_dbl(...)
8. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
9. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
10. └─mlr3 (local) FUN(X[[i]], ...)
11. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
12. └─mlr3:::.__Measure__score(...)
13. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
14. └─get_private(measure)$.score(...)
15. └─mlr3fairness:::.__MeasureFairness__.score(...)
16. └─mlr3fairness:::score_groupwise(...)
17. └─mlr3misc::map_dbl(...)
18. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
19. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
20. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:194:7'): fairness constraint measures - simulated data ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─mlr3misc::map(...) at test_measures.R:192:3
2. └─base::lapply(.x, .f, ...)
3. └─mlr3fairness (local) FUN(X[[i]], ...)
4. └─mlr3misc::map_dbl(...) at test_measures.R:193:5
5. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
6. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
7. └─mlr3fairness (local) FUN(X[[i]], ...)
8. └─prd$score(measures = msr(m), task = tsk) at test_measures.R:194:7
9. └─mlr3:::.__Prediction__score(...)
10. └─mlr3misc::map_dbl(...)
11. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
12. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
13. └─mlr3 (local) FUN(X[[i]], ...)
14. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
15. └─mlr3:::.__Measure__score(...)
16. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
17. └─get_private(measure)$.score(...)
18. └─mlr3fairness:::.__MeasureFairness__.score(...)
19. └─mlr3fairness:::score_groupwise(...)
20. └─mlr3misc::map_dbl(...)
21. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
22. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
23. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:249:3'): Args are passed on correctly ───────────────
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─prd$score(mfa, task = t, train_set = 1:10) at test_measures.R:249:3
2. └─mlr3:::.__Prediction__score(...)
3. └─mlr3misc::map_dbl(...)
4. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
5. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
6. └─mlr3 (local) FUN(X[[i]], ...)
7. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
8. └─mlr3:::.__Measure__score(...)
9. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
10. └─get_private(measure)$.score(...)
11. └─mlr3fairness:::.__MeasureFairness__.score(...)
12. └─mlr3fairness:::score_groupwise(...)
13. └─mlr3misc::map_dbl(...)
14. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
15. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
16. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:271:11'): fairness measures work as expected - simulated data ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─prd$score(measures = ms, task = tsk) at test_measures.R:271:11
2. └─mlr3:::.__Prediction__score(...)
3. └─mlr3misc::map_dbl(...)
4. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
5. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
6. └─mlr3 (local) FUN(X[[i]], ...)
7. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
8. └─mlr3:::.__Measure__score(...)
9. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
10. └─get_private(measure)$.score(...)
11. └─mlr3fairness:::.__MeasureFairness__.score(...)
12. └─mlr3fairness:::score_groupwise(...)
13. └─mlr3misc::map_dbl(...)
14. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
15. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
16. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_visualizations.R:10:5'): fairness_accuracy_tradeoff ────────────
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─mlr3misc::map(...) at test_visualizations.R:9:3
2. └─base::lapply(.x, .f, ...)
3. └─mlr3fairness (local) FUN(X[[i]], ...)
4. ├─mlr3fairness:::check_plots(fairness_accuracy_tradeoff(bmr, fmsr)) at test_visualizations.R:10:5
5. │ ├─testthat::expect_true(is.ggplot(ggplot_obj)) at tests/testthat/helper_test.R:4:3
6. │ │ └─testthat::quasi_label(enquo(object), label, arg = "object")
7. │ │ └─rlang::eval_bare(expr, quo_get_env(quo))
8. │ └─ggplot2::is.ggplot(ggplot_obj)
9. │ └─ggplot2::is_ggplot(x)
10. ├─mlr3fairness::fairness_accuracy_tradeoff(bmr, fmsr)
11. └─mlr3fairness:::fairness_accuracy_tradeoff.BenchmarkResult(...)
12. └─object$aggregate(list(acc_measure, fairness_measure))
13. └─mlr3:::.__BenchmarkResult__aggregate(...)
14. └─mlr3misc::map_dtr(...)
15. ├─data.table::rbindlist(...)
16. ├─base::unname(map(.x, .f, ...))
17. └─mlr3misc::map(.x, .f, ...)
18. └─base::lapply(.x, .f, ...)
19. └─mlr3 (local) FUN(X[[i]], ...)
20. ├─base::as.list(resample_result_aggregate(rr, measures))
21. └─mlr3:::resample_result_aggregate(rr, measures)
22. ├─... %??% set_names(numeric(), character())
23. ├─base::unlist(...)
24. └─mlr3misc::map(...)
25. └─base::lapply(.x, .f, ...)
26. └─mlr3 (local) FUN(X[[i]], ...)
27. └─m$aggregate(rr)
28. └─mlr3:::.__Measure__aggregate(...)
29. └─mlr3:::score_measures(...)
30. └─mlr3misc::pmap_dbl(...)
31. └─mlr3misc:::mapply_list(.f, .x, list(...))
32. └─base::.mapply(.f, .dots, .args)
33. └─mlr3 (local) `<fn>`(...)
34. └─mlr3:::score_single_measure(...)
35. └─get_private(measure)$.score(...)
36. └─mlr3fairness:::.__MeasureFairness__.score(...)
37. └─mlr3fairness:::score_groupwise(...)
38. └─mlr3misc::map_dbl(...)
39. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
40. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
41. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_visualizations.R:33:3'): compare_metrics ───────────────────────
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─mlr3fairness:::check_plots(compare_metrics(bmr, fairness_measures)) at test_visualizations.R:33:3
2. │ ├─testthat::expect_true(is.ggplot(ggplot_obj)) at tests/testthat/helper_test.R:4:3
3. │ │ └─testthat::quasi_label(enquo(object), label, arg = "object")
4. │ │ └─rlang::eval_bare(expr, quo_get_env(quo))
5. │ └─ggplot2::is.ggplot(ggplot_obj)
6. │ └─ggplot2::is_ggplot(x)
7. ├─mlr3fairness::compare_metrics(bmr, fairness_measures)
8. └─mlr3fairness:::compare_metrics.BenchmarkResult(bmr, fairness_measures)
9. └─object$aggregate(measures, ...)
10. └─mlr3:::.__BenchmarkResult__aggregate(...)
11. └─mlr3misc::map_dtr(...)
12. ├─data.table::rbindlist(...)
13. ├─base::unname(map(.x, .f, ...))
14. └─mlr3misc::map(.x, .f, ...)
15. └─base::lapply(.x, .f, ...)
16. └─mlr3 (local) FUN(X[[i]], ...)
17. ├─base::as.list(resample_result_aggregate(rr, measures))
18. └─mlr3:::resample_result_aggregate(rr, measures)
19. ├─... %??% set_names(numeric(), character())
20. ├─base::unlist(...)
21. └─mlr3misc::map(...)
22. └─base::lapply(.x, .f, ...)
23. └─mlr3 (local) FUN(X[[i]], ...)
24. └─m$aggregate(rr)
25. └─mlr3:::.__Measure__aggregate(...)
26. └─mlr3:::score_measures(...)
27. └─mlr3misc::pmap_dbl(...)
28. └─mlr3misc:::mapply_list(.f, .x, list(...))
29. └─base::.mapply(.f, .dots, .args)
30. └─mlr3 (local) `<fn>`(...)
31. └─mlr3:::score_single_measure(...)
32. └─get_private(measure)$.score(...)
33. └─mlr3fairness:::.__MeasureFairness__.score(...)
34. └─mlr3fairness:::score_groupwise(...)
35. └─mlr3misc::map_dbl(...)
36. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
37. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
38. └─mlr3fairness (local) FUN(X[[i]], ...)
[ FAIL 21 | WARN 14 | SKIP 30 | PASS 99 ]
Error: Test failures
Execution halted
Flavor: r-devel-linux-x86_64-fedora-clang
Version: 0.3.2
Check: re-building of vignette outputs
Result: ERROR
Error(s) in re-building vignettes:
--- re-building ‘debiasing-vignette.Rmd’ using rmarkdown
Quitting from debiasing-vignette.Rmd:55-57 [unnamed-chunk-4]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error in `task_set_roles()`:
! Assertion on 'roles' failed: Must be a subset of {'feature','target','name','order','stratum','group','offset','weights_learner','weights_measure','pta'}, but has additional elements {'weight'}.
This happened PipeOp reweighing_wts's $train()
---
Backtrace:
▆
1. ├─p1$train(list(task))
2. │ └─mlr3pipelines:::.__PipeOp__train(...)
3. │ ├─base::withCallingHandlers(...)
4. │ └─private$.train(input)
5. │ └─mlr3pipelines:::.__PipeOpTaskPreproc__.train(...)
6. │ └─private$.train_task(intask)
7. │ └─mlr3fairness:::.__PipeOpReweighingWeights__.train_task(...)
8. │ └─task$set_col_roles(weightcolname, "weight")
9. │ └─mlr3:::.__Task__set_col_roles(...)
10. │ └─mlr3:::task_set_roles(...)
11. │ └─checkmate::assert_subset(roles, names(li))
12. │ └─checkmate::makeAssertion(x, res, .var.name, add)
13. │ └─checkmate:::mstop(...)
14. │ └─base::stop(simpleError(sprintf(msg, ...), call.))
15. └─mlr3pipelines (local) `<fn>`(`<smplErrr>`)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'debiasing-vignette.Rmd' failed with diagnostics:
Assertion on 'roles' failed: Must be a subset of {'feature','target','name','order','stratum','group','offset','weights_learner','weights_measure','pta'}, but has additional elements {'weight'}.
This happened PipeOp reweighing_wts's $train()
--- failed re-building ‘debiasing-vignette.Rmd’
--- re-building ‘measures-vignette.Rmd’ using rmarkdown
Quitting from measures-vignette.Rmd:88-90 [unnamed-chunk-6]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error:
! unused argument (weights = NULL)
---
Backtrace:
▆
1. └─prd$score(msr("fairness.tpr"), task = test)
2. └─mlr3:::.__Prediction__score(...)
3. └─mlr3misc::map_dbl(...)
4. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
5. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
6. └─mlr3 (local) FUN(X[[i]], ...)
7. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
8. └─mlr3:::.__Measure__score(...)
9. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
10. └─get_private(measure)$.score(...)
11. └─mlr3fairness:::.__MeasureFairness__.score(...)
12. └─mlr3fairness:::score_groupwise(...)
13. └─mlr3misc::map_dbl(...)
14. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
15. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
16. └─mlr3fairness (local) FUN(X[[i]], ...)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'measures-vignette.Rmd' failed with diagnostics:
unused argument (weights = NULL)
--- failed re-building ‘measures-vignette.Rmd’
--- re-building ‘reports-vignette.Rmd’ using rmarkdown
Quitting from reports-vignette.Rmd:51-54 [build_modelcard_example_for_vignette]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error in `loadNamespace()`:
! there is no package called 'posterdown'
---
Backtrace:
▆
1. ├─rmarkdown::render(rmdfile)
2. │ └─rmarkdown:::create_output_format(output_format$name, output_format$options)
3. │ └─rmarkdown:::create_output_format_function(name)
4. │ └─base::eval(xfun::parse_only(name))
5. │ └─base::eval(xfun::parse_only(name))
6. └─base::loadNamespace(x)
7. └─base::withRestarts(stop(cond), retry_loadNamespace = function() NULL)
8. └─base (local) withOneRestart(expr, restarts[[1L]])
9. └─base (local) doWithOneRestart(return(expr), restart)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'reports-vignette.Rmd' failed with diagnostics:
there is no package called 'posterdown'
--- failed re-building ‘reports-vignette.Rmd’
--- re-building ‘visualization-vignette.Rmd’ using rmarkdown
Quitting from visualization-vignette.Rmd:88-90 [unnamed-chunk-8]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error:
! unused argument (weights = NULL)
---
Backtrace:
▆
1. ├─mlr3fairness::fairness_accuracy_tradeoff(bmr, msr("fairness.fpr"))
2. └─mlr3fairness:::fairness_accuracy_tradeoff.BenchmarkResult(...)
3. └─object$aggregate(list(acc_measure, fairness_measure))
4. └─mlr3:::.__BenchmarkResult__aggregate(...)
5. └─mlr3misc::map_dtr(...)
6. ├─data.table::rbindlist(...)
7. ├─base::unname(map(.x, .f, ...))
8. └─mlr3misc::map(.x, .f, ...)
9. └─base::lapply(.x, .f, ...)
10. └─mlr3 (local) FUN(X[[i]], ...)
11. ├─base::as.list(resample_result_aggregate(rr, measures))
12. └─mlr3:::resample_result_aggregate(rr, measures)
13. ├─... %??% set_names(numeric(), character())
14. ├─base::unlist(...)
15. └─mlr3misc::map(...)
16. └─base::lapply(.x, .f, ...)
17. └─mlr3 (local) FUN(X[[i]], ...)
18. └─m$aggregate(rr)
19. └─mlr3:::.__Measure__aggregate(...)
20. └─mlr3:::score_measures(...)
21. └─mlr3misc::pmap_dbl(...)
22. └─mlr3misc:::mapply_list(.f, .x, list(...))
23. └─base::.mapply(.f, .dots, .args)
24. └─mlr3 (local) `<fn>`(...)
25. └─mlr3:::score_single_measure(...)
26. └─get_private(measure)$.score(...)
27. └─mlr3fairness:::.__MeasureFairness__.score(...)
28. └─mlr3fairness:::score_groupwise(...)
29. └─mlr3misc::map_dbl(...)
30. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
31. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
32. └─mlr3fairness (local) FUN(X[[i]], ...)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'visualization-vignette.Rmd' failed with diagnostics:
unused argument (weights = NULL)
--- failed re-building ‘visualization-vignette.Rmd’
SUMMARY: processing the following files failed:
‘debiasing-vignette.Rmd’ ‘measures-vignette.Rmd’
‘reports-vignette.Rmd’ ‘visualization-vignette.Rmd’
Error: Vignette re-building failed.
Execution halted
Flavors: r-devel-linux-x86_64-fedora-clang, r-devel-linux-x86_64-fedora-gcc
Version: 0.3.2
Check: tests
Result: ERROR
Running ‘testthat.R’ [25s/150s]
Running the tests in ‘tests/testthat.R’ failed.
Complete output:
> if (requireNamespace("testthat", quietly = TRUE)) {
+ library("testthat")
+ library("checkmate")
+ library("mlr3")
+ library("mlr3pipelines")
+ library("mlr3fairness")
+ test_check("mlr3fairness")
+ }
INFO [11:15:15.370] [mlr3] Running benchmark with 12 resampling iterations
INFO [11:15:18.125] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/3)
INFO [11:15:19.664] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/3)
INFO [11:15:20.500] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 3/3)
INFO [11:15:21.030] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 1/3)
INFO [11:15:21.478] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 2/3)
INFO [11:15:21.808] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 3/3)
INFO [11:15:22.113] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 1/3)
INFO [11:15:22.485] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 2/3)
INFO [11:15:22.791] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 3/3)
INFO [11:15:23.192] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 1/3)
INFO [11:15:23.441] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 2/3)
INFO [11:15:23.636] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 3/3)
INFO [11:15:24.157] [mlr3] Finished benchmark
INFO [11:15:27.920] [mlr3] Running benchmark with 12 resampling iterations
INFO [11:15:28.993] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/3)
INFO [11:15:29.393] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/3)
INFO [11:15:30.154] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 3/3)
INFO [11:15:30.850] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 1/3)
INFO [11:15:31.536] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 2/3)
INFO [11:15:32.177] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 3/3)
INFO [11:15:32.712] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 1/3)
INFO [11:15:33.061] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 2/3)
INFO [11:15:33.458] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 3/3)
INFO [11:15:34.612] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 1/3)
INFO [11:15:35.203] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 2/3)
INFO [11:15:35.732] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 3/3)
INFO [11:15:36.205] [mlr3] Finished benchmark
INFO [11:15:39.218] [mlr3] Running benchmark with 12 resampling iterations
INFO [11:15:39.356] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/3)
INFO [11:15:39.718] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/3)
INFO [11:15:41.113] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 3/3)
INFO [11:15:41.529] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 1/3)
INFO [11:15:41.818] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 2/3)
INFO [11:15:42.074] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 3/3)
INFO [11:15:42.432] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 1/3)
INFO [11:15:42.873] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 2/3)
INFO [11:15:43.243] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 3/3)
INFO [11:15:43.601] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 1/3)
INFO [11:15:43.941] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 2/3)
INFO [11:15:44.416] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 3/3)
INFO [11:15:44.814] [mlr3] Finished benchmark
[ FAIL 21 | WARN 14 | SKIP 30 | PASS 99 ]
══ Skipped tests (30) ══════════════════════════════════════════════════════════
• On CRAN (30): 'test_datasets.R:16:3', 'test_datasets.R:32:3',
'test_datasets.R:47:3', 'test_learners_fairml.R:2:5',
'test_learners_fairml.R:12:5', 'test_learners_fairml.R:25:5',
'test_learners_fairml.R:39:5', 'test_learners_fairml.R:51:5',
'test_learners_fairml_ptas.R:2:5', 'test_learners_fairml_ptas.R:17:5',
'test_measure_subgroup.R:47:3', 'test_measure_subgroup.R:66:3',
'test_pipeop_eod.R:2:3', 'test_pipeop_eod.R:17:3', 'test_pipeop_eod.R:57:3',
'test_pipeop_explicit_pta.R:3:5', 'test_pipeop_explicit_pta.R:17:5',
'test_pipeop_reweighing.R:2:3', 'test_pipeop_reweighing.R:15:3',
'test_pipeop_reweighing.R:25:3', 'test_pipeop_reweighing.R:34:3',
'test_pipeop_reweighing.R:51:3', 'test_pipeop_reweighing.R:61:3',
'test_report_modelcard_datasheet.R:2:3',
'test_report_modelcard_datasheet.R:18:3',
'test_report_modelcard_datasheet.R:34:3',
'test_use_modelcard_datasheet.R:2:3', 'test_use_modelcard_datasheet.R:17:3',
'test_use_modelcard_datasheet.R:31:3', 'test_write_files.R:2:3'
══ Failed tests ════════════════════════════════════════════════════════════════
── Error ('test_measure_subgroup.R:20:3'): measure ─────────────────────────────
Error in `prediction$clone()$filter(rws)$score(self$base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─l$train(t)$predict(t)$score(m, t) at test_measure_subgroup.R:20:3
2. └─mlr3:::.__Prediction__score(...)
3. └─mlr3misc::map_dbl(...)
4. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
5. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
6. └─mlr3 (local) FUN(X[[i]], ...)
7. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
8. └─mlr3:::.__Measure__score(...)
9. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
10. └─get_private(measure)$.score(...)
11. └─mlr3fairness:::.__MeasureSubgroup__.score(...)
── Error ('test_measure_subgroup.R:32:3'): measure ─────────────────────────────
Error in `prediction$clone()$filter(rws)$score(self$base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─l$train(t)$predict(t)$score(m, t) at test_measure_subgroup.R:32:3
2. └─mlr3:::.__Prediction__score(...)
3. └─mlr3misc::map_dbl(...)
4. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
5. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
6. └─mlr3 (local) FUN(X[[i]], ...)
7. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
8. └─mlr3:::.__Measure__score(...)
9. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
10. └─get_private(measure)$.score(...)
11. └─mlr3fairness:::.__MeasureSubgroup__.score(...)
── Error ('test_measures.R:51:9'): fairness measures work as expcted ───────────
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─prd$score(measures = ms, task = tsk) at test_measures.R:51:9
2. └─mlr3:::.__Prediction__score(...)
3. └─mlr3misc::map_dbl(...)
4. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
5. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
6. └─mlr3 (local) FUN(X[[i]], ...)
7. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
8. └─mlr3:::.__Measure__score(...)
9. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
10. └─get_private(measure)$.score(...)
11. └─mlr3fairness:::.__MeasureFairness__.score(...)
12. └─mlr3fairness:::score_groupwise(...)
13. └─mlr3misc::map_dbl(...)
14. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
15. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
16. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:71:9'): fairness measures work as expected - simulated data ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─prd$score(measures = ms, task = tsk) at test_measures.R:71:9
2. └─mlr3:::.__Prediction__score(...)
3. └─mlr3misc::map_dbl(...)
4. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
5. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
6. └─mlr3 (local) FUN(X[[i]], ...)
7. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
8. └─mlr3:::.__Measure__score(...)
9. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
10. └─get_private(measure)$.score(...)
11. └─mlr3fairness:::.__MeasureFairness__.score(...)
12. └─mlr3fairness:::score_groupwise(...)
13. └─mlr3misc::map_dbl(...)
14. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
15. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
16. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:92:3'): fairness errors on missing pta, works with ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_equal(...) at test_measures.R:92:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. ├─base::unname(prd$score(msr("fairness.acc"), task = task))
5. └─prd$score(msr("fairness.acc"), task = task)
6. └─mlr3:::.__Prediction__score(...)
7. └─mlr3misc::map_dbl(...)
8. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
9. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
10. └─mlr3 (local) FUN(X[[i]], ...)
11. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
12. └─mlr3:::.__Measure__score(...)
13. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
14. └─get_private(measure)$.score(...)
15. └─mlr3fairness:::.__MeasureFairness__.score(...)
16. └─mlr3fairness:::score_groupwise(...)
17. └─mlr3misc::map_dbl(...)
18. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
19. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
20. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:111:3'): fairness works with non-binary pta ─────────
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─checkmate::expect_number(...) at test_measures.R:111:3
2. └─prd$score(msr("fairness.acc"), task = task)
3. └─mlr3:::.__Prediction__score(...)
4. └─mlr3misc::map_dbl(...)
5. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
6. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
7. └─mlr3 (local) FUN(X[[i]], ...)
8. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
9. └─mlr3:::.__Measure__score(...)
10. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
11. └─get_private(measure)$.score(...)
12. └─mlr3fairness:::.__MeasureFairness__.score(...)
13. └─mlr3fairness:::score_groupwise(...)
14. └─mlr3misc::map_dbl(...)
15. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
16. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
17. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:129:3'): fairness works on non-binary target ────────
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─checkmate::expect_number(...) at test_measures.R:129:3
2. └─prd$score(msr("fairness.acc"), task = task)
3. └─mlr3:::.__Prediction__score(...)
4. └─mlr3misc::map_dbl(...)
5. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
6. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
7. └─mlr3 (local) FUN(X[[i]], ...)
8. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
9. └─mlr3:::.__Measure__score(...)
10. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
11. └─get_private(measure)$.score(...)
12. └─mlr3fairness:::.__MeasureFairness__.score(...)
13. └─mlr3fairness:::score_groupwise(...)
14. └─mlr3misc::map_dbl(...)
15. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
16. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
17. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:140:3'): fairness.fpr can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_equal(...) at test_measures.R:140:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. ├─base::unname(round(predictions$score(msr_obj, test_data), 4))
5. └─predictions$score(msr_obj, test_data)
6. └─mlr3:::.__Prediction__score(...)
7. └─mlr3misc::map_dbl(...)
8. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
9. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
10. └─mlr3 (local) FUN(X[[i]], ...)
11. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
12. └─mlr3:::.__Measure__score(...)
13. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
14. └─get_private(measure)$.score(...)
15. └─mlr3fairness:::.__MeasureFairness__.score(...)
16. └─mlr3fairness:::score_groupwise(...)
17. └─mlr3misc::map_dbl(...)
18. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
19. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
20. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:145:3'): fairness.acc can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_lt(...) at test_measures.R:145:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. └─predictions$score(msr_obj, test_data)
5. └─mlr3:::.__Prediction__score(...)
6. └─mlr3misc::map_dbl(...)
7. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
8. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
9. └─mlr3 (local) FUN(X[[i]], ...)
10. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
11. └─mlr3:::.__Measure__score(...)
12. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
13. └─get_private(measure)$.score(...)
14. └─mlr3fairness:::.__MeasureFairness__.score(...)
15. └─mlr3fairness:::score_groupwise(...)
16. └─mlr3misc::map_dbl(...)
17. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
18. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
19. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:150:3'): fairness.fnr can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_lt(...) at test_measures.R:150:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. └─predictions$score(msr_obj, test_data)
5. └─mlr3:::.__Prediction__score(...)
6. └─mlr3misc::map_dbl(...)
7. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
8. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
9. └─mlr3 (local) FUN(X[[i]], ...)
10. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
11. └─mlr3:::.__Measure__score(...)
12. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
13. └─get_private(measure)$.score(...)
14. └─mlr3fairness:::.__MeasureFairness__.score(...)
15. └─mlr3fairness:::score_groupwise(...)
16. └─mlr3misc::map_dbl(...)
17. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
18. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
19. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:155:3'): fairness.tpr can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_lt(...) at test_measures.R:155:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. └─predictions$score(msr_obj, test_data)
5. └─mlr3:::.__Prediction__score(...)
6. └─mlr3misc::map_dbl(...)
7. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
8. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
9. └─mlr3 (local) FUN(X[[i]], ...)
10. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
11. └─mlr3:::.__Measure__score(...)
12. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
13. └─get_private(measure)$.score(...)
14. └─mlr3fairness:::.__MeasureFairness__.score(...)
15. └─mlr3fairness:::score_groupwise(...)
16. └─mlr3misc::map_dbl(...)
17. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
18. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
19. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:160:3'): fairness.ppv can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_lt(...) at test_measures.R:160:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. └─predictions$score(msr_obj, test_data)
5. └─mlr3:::.__Prediction__score(...)
6. └─mlr3misc::map_dbl(...)
7. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
8. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
9. └─mlr3 (local) FUN(X[[i]], ...)
10. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
11. └─mlr3:::.__Measure__score(...)
12. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
13. └─get_private(measure)$.score(...)
14. └─mlr3fairness:::.__MeasureFairness__.score(...)
15. └─mlr3fairness:::score_groupwise(...)
16. └─mlr3misc::map_dbl(...)
17. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
18. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
19. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:165:3'): fairness.npv can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_lt(...) at test_measures.R:165:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. └─predictions$score(msr_obj, test_data)
5. └─mlr3:::.__Prediction__score(...)
6. └─mlr3misc::map_dbl(...)
7. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
8. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
9. └─mlr3 (local) FUN(X[[i]], ...)
10. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
11. └─mlr3:::.__Measure__score(...)
12. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
13. └─get_private(measure)$.score(...)
14. └─mlr3fairness:::.__MeasureFairness__.score(...)
15. └─mlr3fairness:::score_groupwise(...)
16. └─mlr3misc::map_dbl(...)
17. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
18. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
19. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:170:3'): fairness.fp can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_equal(...) at test_measures.R:170:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. ├─base::unname(predictions$score(msr_obj, test_data))
5. └─predictions$score(msr_obj, test_data)
6. └─mlr3:::.__Prediction__score(...)
7. └─mlr3misc::map_dbl(...)
8. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
9. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
10. └─mlr3 (local) FUN(X[[i]], ...)
11. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
12. └─mlr3:::.__Measure__score(...)
13. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
14. └─get_private(measure)$.score(...)
15. └─mlr3fairness:::.__MeasureFairness__.score(...)
16. └─mlr3fairness:::score_groupwise(...)
17. └─mlr3misc::map_dbl(...)
18. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
19. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
20. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:175:3'): fairness.fn can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_equal(...) at test_measures.R:175:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. ├─base::unname(predictions$score(msr_obj, test_data))
5. └─predictions$score(msr_obj, test_data)
6. └─mlr3:::.__Prediction__score(...)
7. └─mlr3misc::map_dbl(...)
8. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
9. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
10. └─mlr3 (local) FUN(X[[i]], ...)
11. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
12. └─mlr3:::.__Measure__score(...)
13. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
14. └─get_private(measure)$.score(...)
15. └─mlr3fairness:::.__MeasureFairness__.score(...)
16. └─mlr3fairness:::score_groupwise(...)
17. └─mlr3misc::map_dbl(...)
18. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
19. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
20. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:180:3'): fairness.pp (disparate impact score) can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_equal(...) at test_measures.R:180:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. ├─base::unname(predictions$score(msr_obj, test_data))
5. └─predictions$score(msr_obj, test_data)
6. └─mlr3:::.__Prediction__score(...)
7. └─mlr3misc::map_dbl(...)
8. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
9. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
10. └─mlr3 (local) FUN(X[[i]], ...)
11. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
12. └─mlr3:::.__Measure__score(...)
13. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
14. └─get_private(measure)$.score(...)
15. └─mlr3fairness:::.__MeasureFairness__.score(...)
16. └─mlr3fairness:::score_groupwise(...)
17. └─mlr3misc::map_dbl(...)
18. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
19. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
20. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:194:7'): fairness constraint measures - simulated data ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─mlr3misc::map(...) at test_measures.R:192:3
2. └─base::lapply(.x, .f, ...)
3. └─mlr3fairness (local) FUN(X[[i]], ...)
4. └─mlr3misc::map_dbl(...) at test_measures.R:193:5
5. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
6. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
7. └─mlr3fairness (local) FUN(X[[i]], ...)
8. └─prd$score(measures = msr(m), task = tsk) at test_measures.R:194:7
9. └─mlr3:::.__Prediction__score(...)
10. └─mlr3misc::map_dbl(...)
11. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
12. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
13. └─mlr3 (local) FUN(X[[i]], ...)
14. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
15. └─mlr3:::.__Measure__score(...)
16. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
17. └─get_private(measure)$.score(...)
18. └─mlr3fairness:::.__MeasureFairness__.score(...)
19. └─mlr3fairness:::score_groupwise(...)
20. └─mlr3misc::map_dbl(...)
21. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
22. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
23. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:249:3'): Args are passed on correctly ───────────────
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─prd$score(mfa, task = t, train_set = 1:10) at test_measures.R:249:3
2. └─mlr3:::.__Prediction__score(...)
3. └─mlr3misc::map_dbl(...)
4. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
5. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
6. └─mlr3 (local) FUN(X[[i]], ...)
7. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
8. └─mlr3:::.__Measure__score(...)
9. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
10. └─get_private(measure)$.score(...)
11. └─mlr3fairness:::.__MeasureFairness__.score(...)
12. └─mlr3fairness:::score_groupwise(...)
13. └─mlr3misc::map_dbl(...)
14. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
15. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
16. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:271:11'): fairness measures work as expected - simulated data ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─prd$score(measures = ms, task = tsk) at test_measures.R:271:11
2. └─mlr3:::.__Prediction__score(...)
3. └─mlr3misc::map_dbl(...)
4. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
5. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
6. └─mlr3 (local) FUN(X[[i]], ...)
7. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
8. └─mlr3:::.__Measure__score(...)
9. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
10. └─get_private(measure)$.score(...)
11. └─mlr3fairness:::.__MeasureFairness__.score(...)
12. └─mlr3fairness:::score_groupwise(...)
13. └─mlr3misc::map_dbl(...)
14. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
15. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
16. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_visualizations.R:10:5'): fairness_accuracy_tradeoff ────────────
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─mlr3misc::map(...) at test_visualizations.R:9:3
2. └─base::lapply(.x, .f, ...)
3. └─mlr3fairness (local) FUN(X[[i]], ...)
4. ├─mlr3fairness:::check_plots(fairness_accuracy_tradeoff(bmr, fmsr)) at test_visualizations.R:10:5
5. │ ├─testthat::expect_true(is.ggplot(ggplot_obj)) at tests/testthat/helper_test.R:4:3
6. │ │ └─testthat::quasi_label(enquo(object), label, arg = "object")
7. │ │ └─rlang::eval_bare(expr, quo_get_env(quo))
8. │ └─ggplot2::is.ggplot(ggplot_obj)
9. │ └─ggplot2::is_ggplot(x)
10. ├─mlr3fairness::fairness_accuracy_tradeoff(bmr, fmsr)
11. └─mlr3fairness:::fairness_accuracy_tradeoff.BenchmarkResult(...)
12. └─object$aggregate(list(acc_measure, fairness_measure))
13. └─mlr3:::.__BenchmarkResult__aggregate(...)
14. └─mlr3misc::map_dtr(...)
15. ├─data.table::rbindlist(...)
16. ├─base::unname(map(.x, .f, ...))
17. └─mlr3misc::map(.x, .f, ...)
18. └─base::lapply(.x, .f, ...)
19. └─mlr3 (local) FUN(X[[i]], ...)
20. ├─base::as.list(resample_result_aggregate(rr, measures))
21. └─mlr3:::resample_result_aggregate(rr, measures)
22. ├─... %??% set_names(numeric(), character())
23. ├─base::unlist(...)
24. └─mlr3misc::map(...)
25. └─base::lapply(.x, .f, ...)
26. └─mlr3 (local) FUN(X[[i]], ...)
27. └─m$aggregate(rr)
28. └─mlr3:::.__Measure__aggregate(...)
29. └─mlr3:::score_measures(...)
30. └─mlr3misc::pmap_dbl(...)
31. └─mlr3misc:::mapply_list(.f, .x, list(...))
32. └─base::.mapply(.f, .dots, .args)
33. └─mlr3 (local) `<fn>`(...)
34. └─mlr3:::score_single_measure(...)
35. └─get_private(measure)$.score(...)
36. └─mlr3fairness:::.__MeasureFairness__.score(...)
37. └─mlr3fairness:::score_groupwise(...)
38. └─mlr3misc::map_dbl(...)
39. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
40. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
41. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_visualizations.R:33:3'): compare_metrics ───────────────────────
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─mlr3fairness:::check_plots(compare_metrics(bmr, fairness_measures)) at test_visualizations.R:33:3
2. │ ├─testthat::expect_true(is.ggplot(ggplot_obj)) at tests/testthat/helper_test.R:4:3
3. │ │ └─testthat::quasi_label(enquo(object), label, arg = "object")
4. │ │ └─rlang::eval_bare(expr, quo_get_env(quo))
5. │ └─ggplot2::is.ggplot(ggplot_obj)
6. │ └─ggplot2::is_ggplot(x)
7. ├─mlr3fairness::compare_metrics(bmr, fairness_measures)
8. └─mlr3fairness:::compare_metrics.BenchmarkResult(bmr, fairness_measures)
9. └─object$aggregate(measures, ...)
10. └─mlr3:::.__BenchmarkResult__aggregate(...)
11. └─mlr3misc::map_dtr(...)
12. ├─data.table::rbindlist(...)
13. ├─base::unname(map(.x, .f, ...))
14. └─mlr3misc::map(.x, .f, ...)
15. └─base::lapply(.x, .f, ...)
16. └─mlr3 (local) FUN(X[[i]], ...)
17. ├─base::as.list(resample_result_aggregate(rr, measures))
18. └─mlr3:::resample_result_aggregate(rr, measures)
19. ├─... %??% set_names(numeric(), character())
20. ├─base::unlist(...)
21. └─mlr3misc::map(...)
22. └─base::lapply(.x, .f, ...)
23. └─mlr3 (local) FUN(X[[i]], ...)
24. └─m$aggregate(rr)
25. └─mlr3:::.__Measure__aggregate(...)
26. └─mlr3:::score_measures(...)
27. └─mlr3misc::pmap_dbl(...)
28. └─mlr3misc:::mapply_list(.f, .x, list(...))
29. └─base::.mapply(.f, .dots, .args)
30. └─mlr3 (local) `<fn>`(...)
31. └─mlr3:::score_single_measure(...)
32. └─get_private(measure)$.score(...)
33. └─mlr3fairness:::.__MeasureFairness__.score(...)
34. └─mlr3fairness:::score_groupwise(...)
35. └─mlr3misc::map_dbl(...)
36. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
37. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
38. └─mlr3fairness (local) FUN(X[[i]], ...)
[ FAIL 21 | WARN 14 | SKIP 30 | PASS 99 ]
Error: Test failures
Execution halted
Flavor: r-devel-linux-x86_64-fedora-gcc
Version: 0.3.2
Check: tests
Result: ERROR
Running 'testthat.R' [12s]
Running the tests in 'tests/testthat.R' failed.
Complete output:
> if (requireNamespace("testthat", quietly = TRUE)) {
+ library("testthat")
+ library("checkmate")
+ library("mlr3")
+ library("mlr3pipelines")
+ library("mlr3fairness")
+ test_check("mlr3fairness")
+ }
INFO [07:01:51.275] [mlr3] Running benchmark with 12 resampling iterations
INFO [07:01:51.433] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/3)
INFO [07:01:51.493] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/3)
INFO [07:01:51.522] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 3/3)
INFO [07:01:51.561] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 1/3)
INFO [07:01:51.582] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 2/3)
INFO [07:01:51.608] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 3/3)
INFO [07:01:51.644] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 1/3)
INFO [07:01:51.686] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 2/3)
INFO [07:01:51.727] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 3/3)
INFO [07:01:51.780] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 1/3)
INFO [07:01:51.815] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 2/3)
INFO [07:01:51.856] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 3/3)
INFO [07:01:51.884] [mlr3] Finished benchmark
INFO [07:01:52.195] [mlr3] Running benchmark with 12 resampling iterations
INFO [07:01:52.241] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/3)
INFO [07:01:52.284] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/3)
INFO [07:01:52.333] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 3/3)
INFO [07:01:52.373] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 1/3)
INFO [07:01:52.404] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 2/3)
INFO [07:01:52.436] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 3/3)
INFO [07:01:52.468] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 1/3)
INFO [07:01:52.510] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 2/3)
INFO [07:01:52.550] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 3/3)
INFO [07:01:52.595] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 1/3)
INFO [07:01:52.623] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 2/3)
INFO [07:01:52.658] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 3/3)
INFO [07:01:52.691] [mlr3] Finished benchmark
INFO [07:01:52.908] [mlr3] Running benchmark with 12 resampling iterations
INFO [07:01:52.929] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/3)
INFO [07:01:52.972] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/3)
INFO [07:01:53.012] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 3/3)
INFO [07:01:53.053] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 1/3)
INFO [07:01:53.085] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 2/3)
INFO [07:01:53.104] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 3/3)
INFO [07:01:53.129] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 1/3)
INFO [07:01:53.159] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 2/3)
INFO [07:01:53.199] [mlr3] Applying learner 'classif.rpart' on task 'compas' (iter 3/3)
INFO [07:01:53.239] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 1/3)
INFO [07:01:53.269] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 2/3)
INFO [07:01:53.306] [mlr3] Applying learner 'classif.featureless' on task 'compas' (iter 3/3)
INFO [07:01:53.337] [mlr3] Finished benchmark
[ FAIL 21 | WARN 14 | SKIP 30 | PASS 99 ]
══ Skipped tests (30) ══════════════════════════════════════════════════════════
• On CRAN (30): 'test_datasets.R:16:3', 'test_datasets.R:32:3',
'test_datasets.R:47:3', 'test_learners_fairml.R:2:5',
'test_learners_fairml.R:12:5', 'test_learners_fairml.R:25:5',
'test_learners_fairml.R:39:5', 'test_learners_fairml.R:51:5',
'test_learners_fairml_ptas.R:2:5', 'test_learners_fairml_ptas.R:17:5',
'test_measure_subgroup.R:47:3', 'test_measure_subgroup.R:66:3',
'test_pipeop_eod.R:2:3', 'test_pipeop_eod.R:17:3', 'test_pipeop_eod.R:57:3',
'test_pipeop_explicit_pta.R:3:5', 'test_pipeop_explicit_pta.R:17:5',
'test_pipeop_reweighing.R:2:3', 'test_pipeop_reweighing.R:15:3',
'test_pipeop_reweighing.R:25:3', 'test_pipeop_reweighing.R:34:3',
'test_pipeop_reweighing.R:51:3', 'test_pipeop_reweighing.R:61:3',
'test_report_modelcard_datasheet.R:2:3',
'test_report_modelcard_datasheet.R:18:3',
'test_report_modelcard_datasheet.R:34:3',
'test_use_modelcard_datasheet.R:2:3', 'test_use_modelcard_datasheet.R:17:3',
'test_use_modelcard_datasheet.R:31:3', 'test_write_files.R:2:3'
══ Failed tests ════════════════════════════════════════════════════════════════
── Error ('test_measure_subgroup.R:20:3'): measure ─────────────────────────────
Error in `prediction$clone()$filter(rws)$score(self$base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─l$train(t)$predict(t)$score(m, t) at test_measure_subgroup.R:20:3
2. └─mlr3:::.__Prediction__score(...)
3. └─mlr3misc::map_dbl(...)
4. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
5. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
6. └─mlr3 (local) FUN(X[[i]], ...)
7. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
8. └─mlr3:::.__Measure__score(...)
9. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
10. └─get_private(measure)$.score(...)
11. └─mlr3fairness:::.__MeasureSubgroup__.score(...)
── Error ('test_measure_subgroup.R:32:3'): measure ─────────────────────────────
Error in `prediction$clone()$filter(rws)$score(self$base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─l$train(t)$predict(t)$score(m, t) at test_measure_subgroup.R:32:3
2. └─mlr3:::.__Prediction__score(...)
3. └─mlr3misc::map_dbl(...)
4. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
5. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
6. └─mlr3 (local) FUN(X[[i]], ...)
7. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
8. └─mlr3:::.__Measure__score(...)
9. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
10. └─get_private(measure)$.score(...)
11. └─mlr3fairness:::.__MeasureSubgroup__.score(...)
── Error ('test_measures.R:51:9'): fairness measures work as expcted ───────────
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─prd$score(measures = ms, task = tsk) at test_measures.R:51:9
2. └─mlr3:::.__Prediction__score(...)
3. └─mlr3misc::map_dbl(...)
4. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
5. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
6. └─mlr3 (local) FUN(X[[i]], ...)
7. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
8. └─mlr3:::.__Measure__score(...)
9. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
10. └─get_private(measure)$.score(...)
11. └─mlr3fairness:::.__MeasureFairness__.score(...)
12. └─mlr3fairness:::score_groupwise(...)
13. └─mlr3misc::map_dbl(...)
14. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
15. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
16. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:71:9'): fairness measures work as expected - simulated data ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─prd$score(measures = ms, task = tsk) at test_measures.R:71:9
2. └─mlr3:::.__Prediction__score(...)
3. └─mlr3misc::map_dbl(...)
4. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
5. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
6. └─mlr3 (local) FUN(X[[i]], ...)
7. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
8. └─mlr3:::.__Measure__score(...)
9. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
10. └─get_private(measure)$.score(...)
11. └─mlr3fairness:::.__MeasureFairness__.score(...)
12. └─mlr3fairness:::score_groupwise(...)
13. └─mlr3misc::map_dbl(...)
14. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
15. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
16. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:92:3'): fairness errors on missing pta, works with ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_equal(...) at test_measures.R:92:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. ├─base::unname(prd$score(msr("fairness.acc"), task = task))
5. └─prd$score(msr("fairness.acc"), task = task)
6. └─mlr3:::.__Prediction__score(...)
7. └─mlr3misc::map_dbl(...)
8. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
9. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
10. └─mlr3 (local) FUN(X[[i]], ...)
11. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
12. └─mlr3:::.__Measure__score(...)
13. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
14. └─get_private(measure)$.score(...)
15. └─mlr3fairness:::.__MeasureFairness__.score(...)
16. └─mlr3fairness:::score_groupwise(...)
17. └─mlr3misc::map_dbl(...)
18. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
19. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
20. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:111:3'): fairness works with non-binary pta ─────────
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─checkmate::expect_number(...) at test_measures.R:111:3
2. └─prd$score(msr("fairness.acc"), task = task)
3. └─mlr3:::.__Prediction__score(...)
4. └─mlr3misc::map_dbl(...)
5. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
6. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
7. └─mlr3 (local) FUN(X[[i]], ...)
8. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
9. └─mlr3:::.__Measure__score(...)
10. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
11. └─get_private(measure)$.score(...)
12. └─mlr3fairness:::.__MeasureFairness__.score(...)
13. └─mlr3fairness:::score_groupwise(...)
14. └─mlr3misc::map_dbl(...)
15. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
16. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
17. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:129:3'): fairness works on non-binary target ────────
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─checkmate::expect_number(...) at test_measures.R:129:3
2. └─prd$score(msr("fairness.acc"), task = task)
3. └─mlr3:::.__Prediction__score(...)
4. └─mlr3misc::map_dbl(...)
5. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
6. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
7. └─mlr3 (local) FUN(X[[i]], ...)
8. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
9. └─mlr3:::.__Measure__score(...)
10. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
11. └─get_private(measure)$.score(...)
12. └─mlr3fairness:::.__MeasureFairness__.score(...)
13. └─mlr3fairness:::score_groupwise(...)
14. └─mlr3misc::map_dbl(...)
15. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
16. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
17. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:140:3'): fairness.fpr can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_equal(...) at test_measures.R:140:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. ├─base::unname(round(predictions$score(msr_obj, test_data), 4))
5. └─predictions$score(msr_obj, test_data)
6. └─mlr3:::.__Prediction__score(...)
7. └─mlr3misc::map_dbl(...)
8. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
9. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
10. └─mlr3 (local) FUN(X[[i]], ...)
11. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
12. └─mlr3:::.__Measure__score(...)
13. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
14. └─get_private(measure)$.score(...)
15. └─mlr3fairness:::.__MeasureFairness__.score(...)
16. └─mlr3fairness:::score_groupwise(...)
17. └─mlr3misc::map_dbl(...)
18. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
19. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
20. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:145:3'): fairness.acc can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_lt(...) at test_measures.R:145:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. └─predictions$score(msr_obj, test_data)
5. └─mlr3:::.__Prediction__score(...)
6. └─mlr3misc::map_dbl(...)
7. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
8. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
9. └─mlr3 (local) FUN(X[[i]], ...)
10. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
11. └─mlr3:::.__Measure__score(...)
12. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
13. └─get_private(measure)$.score(...)
14. └─mlr3fairness:::.__MeasureFairness__.score(...)
15. └─mlr3fairness:::score_groupwise(...)
16. └─mlr3misc::map_dbl(...)
17. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
18. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
19. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:150:3'): fairness.fnr can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_lt(...) at test_measures.R:150:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. └─predictions$score(msr_obj, test_data)
5. └─mlr3:::.__Prediction__score(...)
6. └─mlr3misc::map_dbl(...)
7. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
8. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
9. └─mlr3 (local) FUN(X[[i]], ...)
10. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
11. └─mlr3:::.__Measure__score(...)
12. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
13. └─get_private(measure)$.score(...)
14. └─mlr3fairness:::.__MeasureFairness__.score(...)
15. └─mlr3fairness:::score_groupwise(...)
16. └─mlr3misc::map_dbl(...)
17. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
18. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
19. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:155:3'): fairness.tpr can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_lt(...) at test_measures.R:155:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. └─predictions$score(msr_obj, test_data)
5. └─mlr3:::.__Prediction__score(...)
6. └─mlr3misc::map_dbl(...)
7. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
8. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
9. └─mlr3 (local) FUN(X[[i]], ...)
10. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
11. └─mlr3:::.__Measure__score(...)
12. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
13. └─get_private(measure)$.score(...)
14. └─mlr3fairness:::.__MeasureFairness__.score(...)
15. └─mlr3fairness:::score_groupwise(...)
16. └─mlr3misc::map_dbl(...)
17. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
18. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
19. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:160:3'): fairness.ppv can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_lt(...) at test_measures.R:160:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. └─predictions$score(msr_obj, test_data)
5. └─mlr3:::.__Prediction__score(...)
6. └─mlr3misc::map_dbl(...)
7. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
8. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
9. └─mlr3 (local) FUN(X[[i]], ...)
10. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
11. └─mlr3:::.__Measure__score(...)
12. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
13. └─get_private(measure)$.score(...)
14. └─mlr3fairness:::.__MeasureFairness__.score(...)
15. └─mlr3fairness:::score_groupwise(...)
16. └─mlr3misc::map_dbl(...)
17. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
18. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
19. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:165:3'): fairness.npv can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_lt(...) at test_measures.R:165:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. └─predictions$score(msr_obj, test_data)
5. └─mlr3:::.__Prediction__score(...)
6. └─mlr3misc::map_dbl(...)
7. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
8. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
9. └─mlr3 (local) FUN(X[[i]], ...)
10. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
11. └─mlr3:::.__Measure__score(...)
12. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
13. └─get_private(measure)$.score(...)
14. └─mlr3fairness:::.__MeasureFairness__.score(...)
15. └─mlr3fairness:::score_groupwise(...)
16. └─mlr3misc::map_dbl(...)
17. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
18. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
19. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:170:3'): fairness.fp can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_equal(...) at test_measures.R:170:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. ├─base::unname(predictions$score(msr_obj, test_data))
5. └─predictions$score(msr_obj, test_data)
6. └─mlr3:::.__Prediction__score(...)
7. └─mlr3misc::map_dbl(...)
8. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
9. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
10. └─mlr3 (local) FUN(X[[i]], ...)
11. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
12. └─mlr3:::.__Measure__score(...)
13. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
14. └─get_private(measure)$.score(...)
15. └─mlr3fairness:::.__MeasureFairness__.score(...)
16. └─mlr3fairness:::score_groupwise(...)
17. └─mlr3misc::map_dbl(...)
18. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
19. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
20. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:175:3'): fairness.fn can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_equal(...) at test_measures.R:175:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. ├─base::unname(predictions$score(msr_obj, test_data))
5. └─predictions$score(msr_obj, test_data)
6. └─mlr3:::.__Prediction__score(...)
7. └─mlr3misc::map_dbl(...)
8. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
9. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
10. └─mlr3 (local) FUN(X[[i]], ...)
11. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
12. └─mlr3:::.__Measure__score(...)
13. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
14. └─get_private(measure)$.score(...)
15. └─mlr3fairness:::.__MeasureFairness__.score(...)
16. └─mlr3fairness:::score_groupwise(...)
17. └─mlr3misc::map_dbl(...)
18. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
19. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
20. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:180:3'): fairness.pp (disparate impact score) can be loaded and work as expected ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─testthat::expect_equal(...) at test_measures.R:180:3
2. │ └─testthat::quasi_label(enquo(object), label, arg = "object")
3. │ └─rlang::eval_bare(expr, quo_get_env(quo))
4. ├─base::unname(predictions$score(msr_obj, test_data))
5. └─predictions$score(msr_obj, test_data)
6. └─mlr3:::.__Prediction__score(...)
7. └─mlr3misc::map_dbl(...)
8. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
9. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
10. └─mlr3 (local) FUN(X[[i]], ...)
11. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
12. └─mlr3:::.__Measure__score(...)
13. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
14. └─get_private(measure)$.score(...)
15. └─mlr3fairness:::.__MeasureFairness__.score(...)
16. └─mlr3fairness:::score_groupwise(...)
17. └─mlr3misc::map_dbl(...)
18. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
19. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
20. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:194:7'): fairness constraint measures - simulated data ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─mlr3misc::map(...) at test_measures.R:192:3
2. └─base::lapply(.x, .f, ...)
3. └─mlr3fairness (local) FUN(X[[i]], ...)
4. └─mlr3misc::map_dbl(...) at test_measures.R:193:5
5. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
6. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
7. └─mlr3fairness (local) FUN(X[[i]], ...)
8. └─prd$score(measures = msr(m), task = tsk) at test_measures.R:194:7
9. └─mlr3:::.__Prediction__score(...)
10. └─mlr3misc::map_dbl(...)
11. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
12. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
13. └─mlr3 (local) FUN(X[[i]], ...)
14. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
15. └─mlr3:::.__Measure__score(...)
16. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
17. └─get_private(measure)$.score(...)
18. └─mlr3fairness:::.__MeasureFairness__.score(...)
19. └─mlr3fairness:::score_groupwise(...)
20. └─mlr3misc::map_dbl(...)
21. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
22. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
23. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:249:3'): Args are passed on correctly ───────────────
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─prd$score(mfa, task = t, train_set = 1:10) at test_measures.R:249:3
2. └─mlr3:::.__Prediction__score(...)
3. └─mlr3misc::map_dbl(...)
4. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
5. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
6. └─mlr3 (local) FUN(X[[i]], ...)
7. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
8. └─mlr3:::.__Measure__score(...)
9. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
10. └─get_private(measure)$.score(...)
11. └─mlr3fairness:::.__MeasureFairness__.score(...)
12. └─mlr3fairness:::score_groupwise(...)
13. └─mlr3misc::map_dbl(...)
14. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
15. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
16. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_measures.R:271:11'): fairness measures work as expected - simulated data ──
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─prd$score(measures = ms, task = tsk) at test_measures.R:271:11
2. └─mlr3:::.__Prediction__score(...)
3. └─mlr3misc::map_dbl(...)
4. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
5. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
6. └─mlr3 (local) FUN(X[[i]], ...)
7. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
8. └─mlr3:::.__Measure__score(...)
9. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
10. └─get_private(measure)$.score(...)
11. └─mlr3fairness:::.__MeasureFairness__.score(...)
12. └─mlr3fairness:::score_groupwise(...)
13. └─mlr3misc::map_dbl(...)
14. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
15. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
16. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_visualizations.R:10:5'): fairness_accuracy_tradeoff ────────────
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. └─mlr3misc::map(...) at test_visualizations.R:9:3
2. └─base::lapply(.x, .f, ...)
3. └─mlr3fairness (local) FUN(X[[i]], ...)
4. ├─mlr3fairness:::check_plots(fairness_accuracy_tradeoff(bmr, fmsr)) at test_visualizations.R:10:5
5. │ ├─testthat::expect_true(is.ggplot(ggplot_obj)) at D:\RCompile\CRANpkg\local\4.6\mlr3fairness.Rcheck\tests\testthat\helper_test.R:4:3
6. │ │ └─testthat::quasi_label(enquo(object), label, arg = "object")
7. │ │ └─rlang::eval_bare(expr, quo_get_env(quo))
8. │ └─ggplot2::is.ggplot(ggplot_obj)
9. │ └─ggplot2::is_ggplot(x)
10. ├─mlr3fairness::fairness_accuracy_tradeoff(bmr, fmsr)
11. └─mlr3fairness:::fairness_accuracy_tradeoff.BenchmarkResult(...)
12. └─object$aggregate(list(acc_measure, fairness_measure))
13. └─mlr3:::.__BenchmarkResult__aggregate(...)
14. └─mlr3misc::map_dtr(...)
15. ├─data.table::rbindlist(...)
16. ├─base::unname(map(.x, .f, ...))
17. └─mlr3misc::map(.x, .f, ...)
18. └─base::lapply(.x, .f, ...)
19. └─mlr3 (local) FUN(X[[i]], ...)
20. ├─base::as.list(resample_result_aggregate(rr, measures))
21. └─mlr3:::resample_result_aggregate(rr, measures)
22. ├─... %??% set_names(numeric(), character())
23. ├─base::unlist(...)
24. └─mlr3misc::map(...)
25. └─base::lapply(.x, .f, ...)
26. └─mlr3 (local) FUN(X[[i]], ...)
27. └─m$aggregate(rr)
28. └─mlr3:::.__Measure__aggregate(...)
29. └─mlr3:::score_measures(...)
30. └─mlr3misc::pmap_dbl(...)
31. └─mlr3misc:::mapply_list(.f, .x, list(...))
32. └─base::.mapply(.f, .dots, .args)
33. └─mlr3 (local) `<fn>`(...)
34. └─mlr3:::score_single_measure(...)
35. └─get_private(measure)$.score(...)
36. └─mlr3fairness:::.__MeasureFairness__.score(...)
37. └─mlr3fairness:::score_groupwise(...)
38. └─mlr3misc::map_dbl(...)
39. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
40. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
41. └─mlr3fairness (local) FUN(X[[i]], ...)
── Error ('test_visualizations.R:33:3'): compare_metrics ───────────────────────
Error in `prediction$clone()$filter(rws)$score(base_measure, task = task,
...)`: unused argument (weights = NULL)
Backtrace:
▆
1. ├─mlr3fairness:::check_plots(compare_metrics(bmr, fairness_measures)) at test_visualizations.R:33:3
2. │ ├─testthat::expect_true(is.ggplot(ggplot_obj)) at D:\RCompile\CRANpkg\local\4.6\mlr3fairness.Rcheck\tests\testthat\helper_test.R:4:3
3. │ │ └─testthat::quasi_label(enquo(object), label, arg = "object")
4. │ │ └─rlang::eval_bare(expr, quo_get_env(quo))
5. │ └─ggplot2::is.ggplot(ggplot_obj)
6. │ └─ggplot2::is_ggplot(x)
7. ├─mlr3fairness::compare_metrics(bmr, fairness_measures)
8. └─mlr3fairness:::compare_metrics.BenchmarkResult(bmr, fairness_measures)
9. └─object$aggregate(measures, ...)
10. └─mlr3:::.__BenchmarkResult__aggregate(...)
11. └─mlr3misc::map_dtr(...)
12. ├─data.table::rbindlist(...)
13. ├─base::unname(map(.x, .f, ...))
14. └─mlr3misc::map(.x, .f, ...)
15. └─base::lapply(.x, .f, ...)
16. └─mlr3 (local) FUN(X[[i]], ...)
17. ├─base::as.list(resample_result_aggregate(rr, measures))
18. └─mlr3:::resample_result_aggregate(rr, measures)
19. ├─... %??% set_names(numeric(), character())
20. ├─base::unlist(...)
21. └─mlr3misc::map(...)
22. └─base::lapply(.x, .f, ...)
23. └─mlr3 (local) FUN(X[[i]], ...)
24. └─m$aggregate(rr)
25. └─mlr3:::.__Measure__aggregate(...)
26. └─mlr3:::score_measures(...)
27. └─mlr3misc::pmap_dbl(...)
28. └─mlr3misc:::mapply_list(.f, .x, list(...))
29. └─base::.mapply(.f, .dots, .args)
30. └─mlr3 (local) `<fn>`(...)
31. └─mlr3:::score_single_measure(...)
32. └─get_private(measure)$.score(...)
33. └─mlr3fairness:::.__MeasureFairness__.score(...)
34. └─mlr3fairness:::score_groupwise(...)
35. └─mlr3misc::map_dbl(...)
36. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
37. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
38. └─mlr3fairness (local) FUN(X[[i]], ...)
[ FAIL 21 | WARN 14 | SKIP 30 | PASS 99 ]
Error: Test failures
Execution halted
Flavor: r-devel-windows-x86_64
Version: 0.3.2
Check: re-building of vignette outputs
Result: ERROR
Error(s) in re-building vignettes:
--- re-building 'debiasing-vignette.Rmd' using rmarkdown
Quitting from debiasing-vignette.Rmd:55-57 [unnamed-chunk-4]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error in `task_set_roles()`:
! Assertion on 'roles' failed: Must be a subset of {'feature','target','name','order','stratum','group','offset','weights_learner','weights_measure','pta'}, but has additional elements {'weight'}.
This happened PipeOp reweighing_wts's $train()
---
Backtrace:
▆
1. ├─p1$train(list(task))
2. │ └─mlr3pipelines:::.__PipeOp__train(...)
3. │ ├─base::withCallingHandlers(...)
4. │ └─private$.train(input)
5. │ └─mlr3pipelines:::.__PipeOpTaskPreproc__.train(...)
6. │ └─private$.train_task(intask)
7. │ └─mlr3fairness:::.__PipeOpReweighingWeights__.train_task(...)
8. │ └─task$set_col_roles(weightcolname, "weight")
9. │ └─mlr3:::.__Task__set_col_roles(...)
10. │ └─mlr3:::task_set_roles(...)
11. │ └─checkmate::assert_subset(roles, names(li))
12. │ └─checkmate::makeAssertion(x, res, .var.name, add)
13. │ └─checkmate:::mstop(...)
14. │ └─base::stop(simpleError(sprintf(msg, ...), call.))
15. └─mlr3pipelines (local) `<fn>`(`<smplErrr>`)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'debiasing-vignette.Rmd' failed with diagnostics:
Assertion on 'roles' failed: Must be a subset of {'feature','target','name','order','stratum','group','offset','weights_learner','weights_measure','pta'}, but has additional elements {'weight'}.
This happened PipeOp reweighing_wts's $train()
--- failed re-building 'debiasing-vignette.Rmd'
--- re-building 'measures-vignette.Rmd' using rmarkdown
Quitting from measures-vignette.Rmd:88-90 [unnamed-chunk-6]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error:
! unused argument (weights = NULL)
---
Backtrace:
▆
1. └─prd$score(msr("fairness.tpr"), task = test)
2. └─mlr3:::.__Prediction__score(...)
3. └─mlr3misc::map_dbl(...)
4. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
5. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
6. └─mlr3 (local) FUN(X[[i]], ...)
7. └─m$score(prediction = self, task = task, learner = learner, train_set = train_set)
8. └─mlr3:::.__Measure__score(...)
9. └─mlr3:::score_single_measure(self, task, learner, train_set, prediction)
10. └─get_private(measure)$.score(...)
11. └─mlr3fairness:::.__MeasureFairness__.score(...)
12. └─mlr3fairness:::score_groupwise(...)
13. └─mlr3misc::map_dbl(...)
14. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
15. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
16. └─mlr3fairness (local) FUN(X[[i]], ...)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'measures-vignette.Rmd' failed with diagnostics:
unused argument (weights = NULL)
--- failed re-building 'measures-vignette.Rmd'
--- re-building 'reports-vignette.Rmd' using rmarkdown
Quitting from reports-vignette.Rmd:69-75 [build_fairness_example_for_vignette]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error:
! unused argument (weights = NULL)
---
Backtrace:
▆
1. ├─... %>% kable_paper("hover", full_width = F)
2. ├─kableExtra::kable_paper(., "hover", full_width = F)
3. │ └─kableExtra:::kable_light(...)
4. │ └─kableExtra::kable_styling(...)
5. ├─kableExtra::kbl(., col.names = c("value"))
6. │ └─knitr::kable(...)
7. └─resample_result$aggregate(fair_metrics)
8. └─mlr3:::.__ResampleResult__aggregate(...)
9. └─mlr3:::resample_result_aggregate(self, measures)
10. ├─... %??% set_names(numeric(), character())
11. ├─base::unlist(...)
12. └─mlr3misc::map(...)
13. └─base::lapply(.x, .f, ...)
14. └─mlr3 (local) FUN(X[[i]], ...)
15. └─m$aggregate(rr)
16. └─mlr3:::.__Measure__aggregate(...)
17. └─mlr3:::score_measures(...)
18. └─mlr3misc::pmap_dbl(...)
19. └─mlr3misc:::mapply_list(.f, .x, list(...))
20. └─base::.mapply(.f, .dots, .args)
21. └─mlr3 (local) `<fn>`(...)
22. └─mlr3:::score_single_measure(...)
23. └─get_private(measure)$.score(...)
24. └─mlr3fairness:::.__MeasureFairness__.score(...)
25. └─mlr3fairness:::score_groupwise(...)
26. └─mlr3misc::map_dbl(...)
27. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
28. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
29. └─mlr3fairness (local) FUN(X[[i]], ...)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'reports-vignette.Rmd' failed with diagnostics:
unused argument (weights = NULL)
--- failed re-building 'reports-vignette.Rmd'
--- re-building 'visualization-vignette.Rmd' using rmarkdown
Quitting from visualization-vignette.Rmd:88-90 [unnamed-chunk-8]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error:
! unused argument (weights = NULL)
---
Backtrace:
▆
1. ├─mlr3fairness::fairness_accuracy_tradeoff(bmr, msr("fairness.fpr"))
2. └─mlr3fairness:::fairness_accuracy_tradeoff.BenchmarkResult(...)
3. └─object$aggregate(list(acc_measure, fairness_measure))
4. └─mlr3:::.__BenchmarkResult__aggregate(...)
5. └─mlr3misc::map_dtr(...)
6. ├─data.table::rbindlist(...)
7. ├─base::unname(map(.x, .f, ...))
8. └─mlr3misc::map(.x, .f, ...)
9. └─base::lapply(.x, .f, ...)
10. └─mlr3 (local) FUN(X[[i]], ...)
11. ├─base::as.list(resample_result_aggregate(rr, measures))
12. └─mlr3:::resample_result_aggregate(rr, measures)
13. ├─... %??% set_names(numeric(), character())
14. ├─base::unlist(...)
15. └─mlr3misc::map(...)
16. └─base::lapply(.x, .f, ...)
17. └─mlr3 (local) FUN(X[[i]], ...)
18. └─m$aggregate(rr)
19. └─mlr3:::.__Measure__aggregate(...)
20. └─mlr3:::score_measures(...)
21. └─mlr3misc::pmap_dbl(...)
22. └─mlr3misc:::mapply_list(.f, .x, list(...))
23. └─base::.mapply(.f, .dots, .args)
24. └─mlr3 (local) `<fn>`(...)
25. └─mlr3:::score_single_measure(...)
26. └─get_private(measure)$.score(...)
27. └─mlr3fairness:::.__MeasureFairness__.score(...)
28. └─mlr3fairness:::score_groupwise(...)
29. └─mlr3misc::map_dbl(...)
30. └─mlr3misc:::map_mold(.x, .f, NA_real_, ...)
31. └─base::vapply(.x, .f, FUN.VALUE = .value, USE.NAMES = FALSE, ...)
32. └─mlr3fairness (local) FUN(X[[i]], ...)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'visualization-vignette.Rmd' failed with diagnostics:
unused argument (weights = NULL)
--- failed re-building 'visualization-vignette.Rmd'
SUMMARY: processing the following files failed:
'debiasing-vignette.Rmd' 'measures-vignette.Rmd'
'reports-vignette.Rmd' 'visualization-vignette.Rmd'
Error: Vignette re-building failed.
Execution halted
Flavor: r-devel-windows-x86_64
Version: 0.3.2
Check: re-building of vignette outputs
Result: ERROR
Error(s) in re-building vignettes:
...
--- re-building ‘debiasing-vignette.Rmd’ using rmarkdown
** Processing: /home/hornik/tmp/R.check/r-patched-gcc/Work/PKGS/mlr3fairness.Rcheck/vign_test/mlr3fairness/vignettes/debiasing-vignette_files/figure-html/unnamed-chunk-7-1.png
288x288 pixels, 3x8 bits/pixel, RGB
Input IDAT size = 13804 bytes
Input file size = 13894 bytes
Trying:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 10650
zc = 9 zm = 8 zs = 1 f = 0
zc = 1 zm = 8 zs = 2 f = 0
zc = 9 zm = 8 zs = 3 f = 0
zc = 9 zm = 8 zs = 0 f = 5
zc = 9 zm = 8 zs = 1 f = 5
zc = 1 zm = 8 zs = 2 f = 5
zc = 9 zm = 8 zs = 3 f = 5
Selecting parameters:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 10650
Output IDAT size = 10650 bytes (3154 bytes decrease)
Output file size = 10728 bytes (3166 bytes = 22.79% decrease)
--- finished re-building ‘debiasing-vignette.Rmd’
--- re-building ‘measures-vignette.Rmd’ using rmarkdown
--- finished re-building ‘measures-vignette.Rmd’
--- re-building ‘reports-vignette.Rmd’ using rmarkdown
Quitting from reports-vignette.Rmd:51-54 [build_modelcard_example_for_vignette]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error in `loadNamespace()`:
! there is no package called 'posterdown'
---
Backtrace:
▆
1. ├─rmarkdown::render(rmdfile)
2. │ └─rmarkdown:::create_output_format(output_format$name, output_format$options)
3. │ └─rmarkdown:::create_output_format_function(name)
4. │ └─base::eval(xfun::parse_only(name))
5. │ └─base::eval(xfun::parse_only(name))
6. └─base::loadNamespace(x)
7. └─base::withRestarts(stop(cond), retry_loadNamespace = function() NULL)
8. └─base (local) withOneRestart(expr, restarts[[1L]])
9. └─base (local) doWithOneRestart(return(expr), restart)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'reports-vignette.Rmd' failed with diagnostics:
there is no package called 'posterdown'
--- failed re-building ‘reports-vignette.Rmd’
--- re-building ‘visualization-vignette.Rmd’ using rmarkdown
** Processing: /home/hornik/tmp/R.check/r-patched-gcc/Work/PKGS/mlr3fairness.Rcheck/vign_test/mlr3fairness/vignettes/visualization-vignette_files/figure-html/unnamed-chunk-6-1.png
288x288 pixels, 3x8 bits/pixel, RGB
Input IDAT size = 15644 bytes
Input file size = 15734 bytes
Trying:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 12463
zc = 9 zm = 8 zs = 1 f = 0
zc = 1 zm = 8 zs = 2 f = 0
zc = 9 zm = 8 zs = 3 f = 0
zc = 9 zm = 8 zs = 0 f = 5
zc = 9 zm = 8 zs = 1 f = 5
zc = 1 zm = 8 zs = 2 f = 5
zc = 9 zm = 8 zs = 3 f = 5
Selecting parameters:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 12463
Output IDAT size = 12463 bytes (3181 bytes decrease)
Output file size = 12541 bytes (3193 bytes = 20.29% decrease)
** Processing: /home/hornik/tmp/R.check/r-patched-gcc/Work/PKGS/mlr3fairness.Rcheck/vign_test/mlr3fairness/vignettes/visualization-vignette_files/figure-html/unnamed-chunk-7-1.png
288x288 pixels, 3x8 bits/pixel, RGB
Input IDAT size = 17998 bytes
Input file size = 18100 bytes
Trying:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 13421
zc = 9 zm = 8 zs = 1 f = 0
zc = 1 zm = 8 zs = 2 f = 0
zc = 9 zm = 8 zs = 3 f = 0
zc = 9 zm = 8 zs = 0 f = 5
zc = 9 zm = 8 zs = 1 f = 5
zc = 1 zm = 8 zs = 2 f = 5
zc = 9 zm = 8 zs = 3 f = 5
Selecting parameters:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 13421
Output IDAT size = 13421 bytes (4577 bytes decrease)
Output file size = 13499 bytes (4601 bytes = 25.42% decrease)
** Processing: /home/hornik/tmp/R.check/r-patched-gcc/Work/PKGS/mlr3fairness.Rcheck/vign_test/mlr3fairness/vignettes/visualization-vignette_files/figure-html/unnamed-chunk-8-1.png
288x288 pixels, 3x8 bits/pixel, RGB
Input IDAT size = 17899 bytes
Input file size = 18001 bytes
Trying:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 13031
zc = 9 zm = 8 zs = 1 f = 0
zc = 1 zm = 8 zs = 2 f = 0
zc = 9 zm = 8 zs = 3 f = 0
zc = 9 zm = 8 zs = 0 f = 5
zc = 9 zm = 8 zs = 1 f = 5
zc = 1 zm = 8 zs = 2 f = 5
zc = 9 zm = 8 zs = 3 f = 5
Selecting parameters:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 13031
Output IDAT size = 13031 bytes (4868 bytes decrease)
Output file size = 13109 bytes (4892 bytes = 27.18% decrease)
** Processing: /home/hornik/tmp/R.check/r-patched-gcc/Work/PKGS/mlr3fairness.Rcheck/vign_test/mlr3fairness/vignettes/visualization-vignette_files/figure-html/unnamed-chunk-9-1.png
288x288 pixels, 8 bits/pixel, 234 colors in palette
Reducing image to 8 bits/pixel, grayscale
Input IDAT size = 2764 bytes
Input file size = 3556 bytes
Trying:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 2595
zc = 9 zm = 8 zs = 1 f = 0
zc = 1 zm = 8 zs = 2 f = 0
zc = 9 zm = 8 zs = 3 f = 0
zc = 9 zm = 8 zs = 0 f = 5
zc = 9 zm = 8 zs = 1 f = 5
zc = 1 zm = 8 zs = 2 f = 5
zc = 9 zm = 8 zs = 3 f = 5
Selecting parameters:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 2595
Output IDAT size = 2595 bytes (169 bytes decrease)
Output file size = 2673 bytes (883 bytes = 24.83% decrease)
** Processing: /home/hornik/tmp/R.check/r-patched-gcc/Work/PKGS/mlr3fairness.Rcheck/vign_test/mlr3fairness/vignettes/visualization-vignette_files/figure-html/unnamed-chunk-10-1.png
288x288 pixels, 3x8 bits/pixel, RGB
Input IDAT size = 10082 bytes
Input file size = 10172 bytes
Trying:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 8053
zc = 9 zm = 8 zs = 1 f = 0
zc = 1 zm = 8 zs = 2 f = 0
zc = 9 zm = 8 zs = 3 f = 0
zc = 9 zm = 8 zs = 0 f = 5
zc = 9 zm = 8 zs = 1 f = 5
zc = 1 zm = 8 zs = 2 f = 5
zc = 9 zm = 8 zs = 3 f = 5
Selecting parameters:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 8053
Output IDAT size = 8053 bytes (2029 bytes decrease)
Output file size = 8131 bytes (2041 bytes = 20.06% decrease)
** Processing: /home/hornik/tmp/R.check/r-patched-gcc/Work/PKGS/mlr3fairness.Rcheck/vign_test/mlr3fairness/vignettes/visualization-vignette_files/figure-html/unnamed-chunk-12-1.png
288x288 pixels, 3x8 bits/pixel, RGB
Input IDAT size = 12711 bytes
Input file size = 12801 bytes
Trying:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 9267
zc = 9 zm = 8 zs = 1 f = 0
zc = 1 zm = 8 zs = 2 f = 0
zc = 9 zm = 8 zs = 3 f = 0
zc = 9 zm = 8 zs = 0 f = 5
zc = 9 zm = 8 zs = 1 f = 5
zc = 1 zm = 8 zs = 2 f = 5
zc = 9 zm = 8 zs = 3 f = 5
Selecting parameters:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 9267
Output IDAT size = 9267 bytes (3444 bytes decrease)
Output file size = 9345 bytes (3456 bytes = 27.00% decrease)
--- finished re-building ‘visualization-vignette.Rmd’
SUMMARY: processing the following file failed:
‘reports-vignette.Rmd’
Error: Vignette re-building failed.
Execution halted
Flavor: r-patched-linux-x86_64
Version: 0.3.2
Check: re-building of vignette outputs
Result: ERROR
Error(s) in re-building vignettes:
...
--- re-building ‘debiasing-vignette.Rmd’ using rmarkdown
** Processing: /home/hornik/tmp/R.check/r-release-gcc/Work/PKGS/mlr3fairness.Rcheck/vign_test/mlr3fairness/vignettes/debiasing-vignette_files/figure-html/unnamed-chunk-7-1.png
288x288 pixels, 3x8 bits/pixel, RGB
Input IDAT size = 13804 bytes
Input file size = 13894 bytes
Trying:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 10650
zc = 9 zm = 8 zs = 1 f = 0
zc = 1 zm = 8 zs = 2 f = 0
zc = 9 zm = 8 zs = 3 f = 0
zc = 9 zm = 8 zs = 0 f = 5
zc = 9 zm = 8 zs = 1 f = 5
zc = 1 zm = 8 zs = 2 f = 5
zc = 9 zm = 8 zs = 3 f = 5
Selecting parameters:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 10650
Output IDAT size = 10650 bytes (3154 bytes decrease)
Output file size = 10728 bytes (3166 bytes = 22.79% decrease)
--- finished re-building ‘debiasing-vignette.Rmd’
--- re-building ‘measures-vignette.Rmd’ using rmarkdown
--- finished re-building ‘measures-vignette.Rmd’
--- re-building ‘reports-vignette.Rmd’ using rmarkdown
Quitting from reports-vignette.Rmd:51-54 [build_modelcard_example_for_vignette]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error in `loadNamespace()`:
! there is no package called 'posterdown'
---
Backtrace:
▆
1. ├─rmarkdown::render(rmdfile)
2. │ └─rmarkdown:::create_output_format(output_format$name, output_format$options)
3. │ └─rmarkdown:::create_output_format_function(name)
4. │ └─base::eval(xfun::parse_only(name))
5. │ └─base::eval(xfun::parse_only(name))
6. └─base::loadNamespace(x)
7. └─base::withRestarts(stop(cond), retry_loadNamespace = function() NULL)
8. └─base (local) withOneRestart(expr, restarts[[1L]])
9. └─base (local) doWithOneRestart(return(expr), restart)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'reports-vignette.Rmd' failed with diagnostics:
there is no package called 'posterdown'
--- failed re-building ‘reports-vignette.Rmd’
--- re-building ‘visualization-vignette.Rmd’ using rmarkdown
** Processing: /home/hornik/tmp/R.check/r-release-gcc/Work/PKGS/mlr3fairness.Rcheck/vign_test/mlr3fairness/vignettes/visualization-vignette_files/figure-html/unnamed-chunk-6-1.png
288x288 pixels, 3x8 bits/pixel, RGB
Input IDAT size = 15566 bytes
Input file size = 15656 bytes
Trying:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 12341
zc = 9 zm = 8 zs = 1 f = 0
zc = 1 zm = 8 zs = 2 f = 0
zc = 9 zm = 8 zs = 3 f = 0
zc = 9 zm = 8 zs = 0 f = 5
zc = 9 zm = 8 zs = 1 f = 5
zc = 1 zm = 8 zs = 2 f = 5
zc = 9 zm = 8 zs = 3 f = 5
Selecting parameters:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 12341
Output IDAT size = 12341 bytes (3225 bytes decrease)
Output file size = 12419 bytes (3237 bytes = 20.68% decrease)
** Processing: /home/hornik/tmp/R.check/r-release-gcc/Work/PKGS/mlr3fairness.Rcheck/vign_test/mlr3fairness/vignettes/visualization-vignette_files/figure-html/unnamed-chunk-7-1.png
288x288 pixels, 3x8 bits/pixel, RGB
Input IDAT size = 18274 bytes
Input file size = 18376 bytes
Trying:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 13673
zc = 9 zm = 8 zs = 1 f = 0
zc = 1 zm = 8 zs = 2 f = 0
zc = 9 zm = 8 zs = 3 f = 0
zc = 9 zm = 8 zs = 0 f = 5
zc = 9 zm = 8 zs = 1 f = 5
zc = 1 zm = 8 zs = 2 f = 5
zc = 9 zm = 8 zs = 3 f = 5
Selecting parameters:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 13673
Output IDAT size = 13673 bytes (4601 bytes decrease)
Output file size = 13751 bytes (4625 bytes = 25.17% decrease)
** Processing: /home/hornik/tmp/R.check/r-release-gcc/Work/PKGS/mlr3fairness.Rcheck/vign_test/mlr3fairness/vignettes/visualization-vignette_files/figure-html/unnamed-chunk-8-1.png
288x288 pixels, 3x8 bits/pixel, RGB
Input IDAT size = 15431 bytes
Input file size = 15521 bytes
Trying:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 11702
zc = 9 zm = 8 zs = 1 f = 0
zc = 1 zm = 8 zs = 2 f = 0
zc = 9 zm = 8 zs = 3 f = 0
zc = 9 zm = 8 zs = 0 f = 5
zc = 9 zm = 8 zs = 1 f = 5
zc = 1 zm = 8 zs = 2 f = 5
zc = 9 zm = 8 zs = 3 f = 5
Selecting parameters:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 11702
Output IDAT size = 11702 bytes (3729 bytes decrease)
Output file size = 11780 bytes (3741 bytes = 24.10% decrease)
** Processing: /home/hornik/tmp/R.check/r-release-gcc/Work/PKGS/mlr3fairness.Rcheck/vign_test/mlr3fairness/vignettes/visualization-vignette_files/figure-html/unnamed-chunk-9-1.png
288x288 pixels, 8 bits/pixel, 235 colors in palette
Reducing image to 8 bits/pixel, grayscale
Input IDAT size = 2829 bytes
Input file size = 3624 bytes
Trying:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 2678
zc = 9 zm = 8 zs = 1 f = 0
zc = 1 zm = 8 zs = 2 f = 0
zc = 9 zm = 8 zs = 3 f = 0
zc = 9 zm = 8 zs = 0 f = 5
zc = 9 zm = 8 zs = 1 f = 5
zc = 1 zm = 8 zs = 2 f = 5
zc = 9 zm = 8 zs = 3 f = 5
Selecting parameters:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 2678
Output IDAT size = 2678 bytes (151 bytes decrease)
Output file size = 2756 bytes (868 bytes = 23.95% decrease)
** Processing: /home/hornik/tmp/R.check/r-release-gcc/Work/PKGS/mlr3fairness.Rcheck/vign_test/mlr3fairness/vignettes/visualization-vignette_files/figure-html/unnamed-chunk-10-1.png
288x288 pixels, 3x8 bits/pixel, RGB
Input IDAT size = 10500 bytes
Input file size = 10590 bytes
Trying:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 8108
zc = 9 zm = 8 zs = 1 f = 0
zc = 1 zm = 8 zs = 2 f = 0
zc = 9 zm = 8 zs = 3 f = 0
zc = 9 zm = 8 zs = 0 f = 5
zc = 9 zm = 8 zs = 1 f = 5
zc = 1 zm = 8 zs = 2 f = 5
zc = 9 zm = 8 zs = 3 f = 5
Selecting parameters:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 8108
Output IDAT size = 8108 bytes (2392 bytes decrease)
Output file size = 8186 bytes (2404 bytes = 22.70% decrease)
** Processing: /home/hornik/tmp/R.check/r-release-gcc/Work/PKGS/mlr3fairness.Rcheck/vign_test/mlr3fairness/vignettes/visualization-vignette_files/figure-html/unnamed-chunk-12-1.png
288x288 pixels, 3x8 bits/pixel, RGB
Input IDAT size = 12711 bytes
Input file size = 12801 bytes
Trying:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 9267
zc = 9 zm = 8 zs = 1 f = 0
zc = 1 zm = 8 zs = 2 f = 0
zc = 9 zm = 8 zs = 3 f = 0
zc = 9 zm = 8 zs = 0 f = 5
zc = 9 zm = 8 zs = 1 f = 5
zc = 1 zm = 8 zs = 2 f = 5
zc = 9 zm = 8 zs = 3 f = 5
Selecting parameters:
zc = 9 zm = 8 zs = 0 f = 0 IDAT size = 9267
Output IDAT size = 9267 bytes (3444 bytes decrease)
Output file size = 9345 bytes (3456 bytes = 27.00% decrease)
--- finished re-building ‘visualization-vignette.Rmd’
SUMMARY: processing the following file failed:
‘reports-vignette.Rmd’
Error: Vignette re-building failed.
Execution halted
Flavor: r-release-linux-x86_64