CRAN Package Check Results for Package mlr3benchmark

Last updated on 2026-08-12 08:59:09 CEST.

Flavor Version Tinstall Tcheck Ttotal Status Flags
r-devel-linux-x86_64-debian-clang ERROR
r-devel-linux-x86_64-debian-gcc 0.1.7 5.34 52.50 57.84 ERROR
r-devel-linux-x86_64-fedora-clang 0.1.7 51.73 ERROR
r-devel-linux-x86_64-fedora-gcc 0.1.7 48.51 ERROR
r-devel-windows-x86_64 0.1.7 9.00 78.00 87.00 ERROR
r-patched-linux-x86_64 0.1.7 6.54 62.83 69.37 ERROR
r-release-linux-x86_64 0.1.7 6.40 63.46 69.86 ERROR
r-release-macos-arm64 0.1.7 2.00 21.00 23.00 OK
r-release-macos-x86_64 0.1.7 5.00 84.00 89.00 OK
r-release-windows-x86_64 0.1.7 9.00 76.00 85.00 ERROR
r-oldrel-macos-arm64 0.1.7 OK
r-oldrel-macos-x86_64 0.1.7 4.00 59.00 63.00 OK
r-oldrel-windows-x86_64 0.1.7 11.00 100.00 111.00 ERROR

Check Details

Version: 0.1.7
Check: examples
Result: ERROR Running examples in ‘mlr3benchmark-Ex.R’ failed The error most likely occurred in: > base::assign(".ptime", proc.time(), pos = "CheckExEnv") > ### Name: BenchmarkAggr > ### Title: Aggregated Benchmark Result Object > ### Aliases: BenchmarkAggr > > ### ** Examples > > # Not restricted to mlr3 objects > df = data.frame(tasks = factor(rep(c("A", "B"), each = 5), + levels = c("A", "B")), + learners = factor(paste0("L", 1:5)), + RMSE = runif(10), MAE = runif(10)) > as_benchmark_aggr(df, task_id = "tasks", learner_id = "learners") <BenchmarkAggr> of 10 rows with 2 tasks, 5 learners and 2 measures tasks learners RMSE MAE <fctr> <fctr> <num> <num> 1: A L1 0.26550866 0.2059746 2: A L2 0.37212390 0.1765568 3: A L3 0.57285336 0.6870228 4: A L4 0.90820779 0.3841037 5: A L5 0.20168193 0.7698414 6: B L1 0.89838968 0.4976992 7: B L2 0.94467527 0.7176185 8: B L3 0.66079779 0.9919061 9: B L4 0.62911404 0.3800352 10: B L5 0.06178627 0.7774452 > > if (requireNamespaces(c("mlr3", "rpart"))) { + library(mlr3) + task = tsks(c("pima", "spam")) + learns = lrns(c("classif.featureless", "classif.rpart")) + bm = benchmark(benchmark_grid(task, learns, rsmp("cv", folds = 2))) + + # coercion + as_benchmark_aggr(bm) + } Warning in data(list = id, package = package, envir = ee) : data set ‘PimaIndiansDiabetes2’ not found Error in UseMethod("as_data_backend") : no applicable method for 'as_data_backend' applied to an object of class "NULL" Calls: tsks ... dictionary_initialize_item -> do.call -> <Anonymous> -> as_data_backend Execution halted Flavors: r-devel-linux-x86_64-debian-clang, r-devel-linux-x86_64-debian-gcc, r-patched-linux-x86_64, r-release-linux-x86_64

Version: 0.1.7
Check: tests
Result: ERROR Running ‘testthat.R’ [8s/8s] Running the tests in ‘tests/testthat.R’ failed. Complete output: > if (requireNamespace("testthat", quietly = TRUE)) { + library("testthat") + library("checkmate") # for more expect_*() functions + library("mlr3benchmark") + test_check("mlr3benchmark") + } Saving _problems/test_BenchmarkAggr-99.R INFO [07:03:02.433] [mlr3] Running benchmark with 18 resampling iterations INFO [07:03:02.679] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 1/3) INFO [07:03:02.758] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 2/3) INFO [07:03:02.803] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 3/3) INFO [07:03:02.846] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 1/3) INFO [07:03:02.900] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 2/3) INFO [07:03:02.939] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 3/3) INFO [07:03:02.981] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 1/3) INFO [07:03:03.023] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 2/3) INFO [07:03:03.073] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 3/3) INFO [07:03:03.115] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 1/3) INFO [07:03:03.161] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 2/3) INFO [07:03:03.213] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 3/3) INFO [07:03:03.251] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 1/3) INFO [07:03:03.317] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 2/3) INFO [07:03:03.377] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 3/3) INFO [07:03:03.444] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 1/3) INFO [07:03:03.503] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 2/3) INFO [07:03:03.562] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 3/3) INFO [07:03:03.639] [mlr3] Finished benchmark [ FAIL 1 | WARN 2 | SKIP 0 | PASS 50 ] ══ Failed tests ════════════════════════════════════════════════════════════════ ── Error ('test_BenchmarkAggr.R:99:3'): mlr3 coercions ───────────────────────── Error in `UseMethod("as_data_backend")`: no applicable method for 'as_data_backend' applied to an object of class "NULL" Backtrace: ▆ 1. └─mlr3::tsks(c("pima", "spam")) at test_BenchmarkAggr.R:99:3 2. └─mlr3misc::dictionary_sugar_mget(dict = mlr_tasks, .keys, ...) 3. └─base::lapply(...) 4. └─mlr3misc (local) FUN(X[[i]], ...) 5. └─mlr3misc:::dictionary_get(dict, .key, .dicts_suggest = .dicts_suggest) 6. └─mlr3misc:::dictionary_initialize_item(key, obj, dots) 7. ├─base::do.call(constructor, cargs) 8. └─mlr3 (local) `<fn>`() 9. └─mlr3::as_data_backend(load_dataset("PimaIndiansDiabetes2", "mlbench")) [ FAIL 1 | WARN 2 | SKIP 0 | PASS 50 ] Error: ! Test failures. Execution halted Flavor: r-devel-linux-x86_64-debian-clang

Version: 0.1.7
Check: tests
Result: ERROR Running ‘testthat.R’ [6s/8s] Running the tests in ‘tests/testthat.R’ failed. Complete output: > if (requireNamespace("testthat", quietly = TRUE)) { + library("testthat") + library("checkmate") # for more expect_*() functions + library("mlr3benchmark") + test_check("mlr3benchmark") + } Saving _problems/test_BenchmarkAggr-99.R INFO [18:18:56.500] [mlr3] Running benchmark with 18 resampling iterations INFO [18:18:57.144] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 1/3) INFO [18:18:57.205] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 2/3) INFO [18:18:57.248] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 3/3) INFO [18:18:57.282] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 1/3) INFO [18:18:57.325] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 2/3) INFO [18:18:57.362] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 3/3) INFO [18:18:57.402] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 1/3) INFO [18:18:57.440] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 2/3) INFO [18:18:57.479] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 3/3) INFO [18:18:57.521] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 1/3) INFO [18:18:57.561] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 2/3) INFO [18:18:57.607] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 3/3) INFO [18:18:57.637] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 1/3) INFO [18:18:57.681] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 2/3) INFO [18:18:57.725] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 3/3) INFO [18:18:57.778] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 1/3) INFO [18:18:57.832] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 2/3) INFO [18:18:57.879] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 3/3) INFO [18:18:57.933] [mlr3] Finished benchmark [ FAIL 1 | WARN 2 | SKIP 0 | PASS 50 ] ══ Failed tests ════════════════════════════════════════════════════════════════ ── Error ('test_BenchmarkAggr.R:99:3'): mlr3 coercions ───────────────────────── Error in `UseMethod("as_data_backend")`: no applicable method for 'as_data_backend' applied to an object of class "NULL" Backtrace: ▆ 1. └─mlr3::tsks(c("pima", "spam")) at test_BenchmarkAggr.R:99:3 2. └─mlr3misc::dictionary_sugar_mget(dict = mlr_tasks, .keys, ...) 3. └─base::lapply(...) 4. └─mlr3misc (local) FUN(X[[i]], ...) 5. └─mlr3misc:::dictionary_get(dict, .key, .dicts_suggest = .dicts_suggest) 6. └─mlr3misc:::dictionary_initialize_item(key, obj, dots) 7. ├─base::do.call(constructor, cargs) 8. └─mlr3 (local) `<fn>`() 9. └─mlr3::as_data_backend(load_dataset("PimaIndiansDiabetes2", "mlbench")) [ FAIL 1 | WARN 2 | SKIP 0 | PASS 50 ] Error: ! Test failures. Execution halted Flavor: r-devel-linux-x86_64-debian-gcc

Version: 0.1.7
Check: examples
Result: ERROR Running examples in ‘mlr3benchmark-Ex.R’ failed The error most likely occurred in: > ### Name: BenchmarkAggr > ### Title: Aggregated Benchmark Result Object > ### Aliases: BenchmarkAggr > > ### ** Examples > > # Not restricted to mlr3 objects > df = data.frame(tasks = factor(rep(c("A", "B"), each = 5), + levels = c("A", "B")), + learners = factor(paste0("L", 1:5)), + RMSE = runif(10), MAE = runif(10)) > as_benchmark_aggr(df, task_id = "tasks", learner_id = "learners") <BenchmarkAggr> of 10 rows with 2 tasks, 5 learners and 2 measures tasks learners RMSE MAE <fctr> <fctr> <num> <num> 1: A L1 0.26550866 0.2059746 2: A L2 0.37212390 0.1765568 3: A L3 0.57285336 0.6870228 4: A L4 0.90820779 0.3841037 5: A L5 0.20168193 0.7698414 6: B L1 0.89838968 0.4976992 7: B L2 0.94467527 0.7176185 8: B L3 0.66079779 0.9919061 9: B L4 0.62911404 0.3800352 10: B L5 0.06178627 0.7774452 > > if (requireNamespaces(c("mlr3", "rpart"))) { + library(mlr3) + task = tsks(c("pima", "spam")) + learns = lrns(c("classif.featureless", "classif.rpart")) + bm = benchmark(benchmark_grid(task, learns, rsmp("cv", folds = 2))) + + # coercion + as_benchmark_aggr(bm) + } Warning in data(list = id, package = package, envir = ee) : data set ‘PimaIndiansDiabetes2’ not found Error in UseMethod("as_data_backend") : no applicable method for 'as_data_backend' applied to an object of class "NULL" Calls: tsks ... dictionary_initialize_item -> do.call -> <Anonymous> -> as_data_backend Execution halted Flavors: r-devel-linux-x86_64-fedora-clang, r-devel-linux-x86_64-fedora-gcc, r-devel-windows-x86_64, r-release-windows-x86_64, r-oldrel-windows-x86_64

Version: 0.1.7
Check: tests
Result: ERROR Running ‘testthat.R’ Running the tests in ‘tests/testthat.R’ failed. Complete output: > if (requireNamespace("testthat", quietly = TRUE)) { + library("testthat") + library("checkmate") # for more expect_*() functions + library("mlr3benchmark") + test_check("mlr3benchmark") + } Saving _problems/test_BenchmarkAggr-99.R INFO [09:52:16.922] [mlr3] Running benchmark with 18 resampling iterations INFO [09:52:17.245] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 1/3) INFO [09:52:17.297] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 2/3) INFO [09:52:17.324] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 3/3) INFO [09:52:17.378] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 1/3) INFO [09:52:17.449] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 2/3) INFO [09:52:17.522] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 3/3) INFO [09:52:17.594] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 1/3) INFO [09:52:17.666] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 2/3) INFO [09:52:17.717] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 3/3) INFO [09:52:17.748] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 1/3) INFO [09:52:17.777] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 2/3) INFO [09:52:17.812] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 3/3) INFO [09:52:17.843] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 1/3) INFO [09:52:17.884] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 2/3) INFO [09:52:17.942] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 3/3) INFO [09:52:17.989] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 1/3) INFO [09:52:18.033] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 2/3) INFO [09:52:18.076] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 3/3) INFO [09:52:18.127] [mlr3] Finished benchmark [ FAIL 1 | WARN 2 | SKIP 0 | PASS 50 ] ══ Failed tests ════════════════════════════════════════════════════════════════ ── Error ('test_BenchmarkAggr.R:99:3'): mlr3 coercions ───────────────────────── Error in `UseMethod("as_data_backend")`: no applicable method for 'as_data_backend' applied to an object of class "NULL" Backtrace: ▆ 1. └─mlr3::tsks(c("pima", "spam")) at test_BenchmarkAggr.R:99:3 2. └─mlr3misc::dictionary_sugar_mget(dict = mlr_tasks, .keys, ...) 3. └─base::lapply(...) 4. └─mlr3misc (local) FUN(X[[i]], ...) 5. └─mlr3misc:::dictionary_get(dict, .key, .dicts_suggest = .dicts_suggest) 6. └─mlr3misc:::dictionary_initialize_item(key, obj, dots) 7. ├─base::do.call(constructor, cargs) 8. └─mlr3 (local) `<fn>`() 9. └─mlr3::as_data_backend(load_dataset("PimaIndiansDiabetes2", "mlbench")) [ FAIL 1 | WARN 2 | SKIP 0 | PASS 50 ] Error: ! Test failures. Execution halted Flavor: r-devel-linux-x86_64-fedora-clang

Version: 0.1.7
Check: tests
Result: ERROR Running ‘testthat.R’ Running the tests in ‘tests/testthat.R’ failed. Complete output: > if (requireNamespace("testthat", quietly = TRUE)) { + library("testthat") + library("checkmate") # for more expect_*() functions + library("mlr3benchmark") + test_check("mlr3benchmark") + } Saving _problems/test_BenchmarkAggr-99.R INFO [12:03:36.795] [mlr3] Running benchmark with 18 resampling iterations INFO [12:03:37.147] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 1/3) INFO [12:03:37.213] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 2/3) INFO [12:03:37.250] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 3/3) INFO [12:03:37.275] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 1/3) INFO [12:03:37.309] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 2/3) INFO [12:03:37.339] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 3/3) INFO [12:03:37.370] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 1/3) INFO [12:03:37.400] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 2/3) INFO [12:03:37.431] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 3/3) INFO [12:03:37.460] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 1/3) INFO [12:03:37.487] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 2/3) INFO [12:03:37.530] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 3/3) INFO [12:03:37.573] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 1/3) INFO [12:03:37.617] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 2/3) INFO [12:03:37.653] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 3/3) INFO [12:03:37.696] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 1/3) INFO [12:03:37.775] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 2/3) INFO [12:03:37.851] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 3/3) INFO [12:03:37.923] [mlr3] Finished benchmark [ FAIL 1 | WARN 2 | SKIP 0 | PASS 50 ] ══ Failed tests ════════════════════════════════════════════════════════════════ ── Error ('test_BenchmarkAggr.R:99:3'): mlr3 coercions ───────────────────────── Error in `UseMethod("as_data_backend")`: no applicable method for 'as_data_backend' applied to an object of class "NULL" Backtrace: ▆ 1. └─mlr3::tsks(c("pima", "spam")) at test_BenchmarkAggr.R:99:3 2. └─mlr3misc::dictionary_sugar_mget(dict = mlr_tasks, .keys, ...) 3. └─base::lapply(...) 4. └─mlr3misc (local) FUN(X[[i]], ...) 5. └─mlr3misc:::dictionary_get(dict, .key, .dicts_suggest = .dicts_suggest) 6. └─mlr3misc:::dictionary_initialize_item(key, obj, dots) 7. ├─base::do.call(constructor, cargs) 8. └─mlr3 (local) `<fn>`() 9. └─mlr3::as_data_backend(load_dataset("PimaIndiansDiabetes2", "mlbench")) [ FAIL 1 | WARN 2 | SKIP 0 | PASS 50 ] Error: ! Test failures. Execution halted Flavor: r-devel-linux-x86_64-fedora-gcc

Version: 0.1.7
Check: tests
Result: ERROR Running 'testthat.R' [7s] Running the tests in 'tests/testthat.R' failed. Complete output: > if (requireNamespace("testthat", quietly = TRUE)) { + library("testthat") + library("checkmate") # for more expect_*() functions + library("mlr3benchmark") + test_check("mlr3benchmark") + } Saving _problems/test_BenchmarkAggr-99.R INFO [22:09:54.099] [mlr3] Running benchmark with 18 resampling iterations INFO [22:09:54.261] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 1/3) INFO [22:09:54.330] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 2/3) INFO [22:09:54.370] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 3/3) INFO [22:09:54.411] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 1/3) INFO [22:09:54.465] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 2/3) INFO [22:09:54.515] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 3/3) INFO [22:09:54.581] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 1/3) INFO [22:09:54.639] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 2/3) INFO [22:09:54.694] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 3/3) INFO [22:09:54.749] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 1/3) INFO [22:09:54.803] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 2/3) INFO [22:09:54.837] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 3/3) INFO [22:09:54.862] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 1/3) INFO [22:09:54.901] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 2/3) INFO [22:09:54.950] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 3/3) INFO [22:09:55.009] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 1/3) INFO [22:09:55.062] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 2/3) INFO [22:09:55.114] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 3/3) INFO [22:09:55.171] [mlr3] Finished benchmark [ FAIL 1 | WARN 2 | SKIP 0 | PASS 50 ] ══ Failed tests ════════════════════════════════════════════════════════════════ ── Error ('test_BenchmarkAggr.R:99:3'): mlr3 coercions ───────────────────────── Error in `UseMethod("as_data_backend")`: no applicable method for 'as_data_backend' applied to an object of class "NULL" Backtrace: ▆ 1. └─mlr3::tsks(c("pima", "spam")) at test_BenchmarkAggr.R:99:3 2. └─mlr3misc::dictionary_sugar_mget(dict = mlr_tasks, .keys, ...) 3. └─base::lapply(...) 4. └─mlr3misc (local) FUN(X[[i]], ...) 5. └─mlr3misc:::dictionary_get(dict, .key, .dicts_suggest = .dicts_suggest) 6. └─mlr3misc:::dictionary_initialize_item(key, obj, dots) 7. ├─base::do.call(constructor, cargs) 8. └─mlr3 (local) `<fn>`() 9. └─mlr3::as_data_backend(load_dataset("PimaIndiansDiabetes2", "mlbench")) [ FAIL 1 | WARN 2 | SKIP 0 | PASS 50 ] Error: ! Test failures. Execution halted Flavor: r-devel-windows-x86_64

Version: 0.1.7
Check: tests
Result: ERROR Running ‘testthat.R’ [7s/10s] Running the tests in ‘tests/testthat.R’ failed. Complete output: > if (requireNamespace("testthat", quietly = TRUE)) { + library("testthat") + library("checkmate") # for more expect_*() functions + library("mlr3benchmark") + test_check("mlr3benchmark") + } Saving _problems/test_BenchmarkAggr-99.R INFO [18:13:44.470] [mlr3] Running benchmark with 18 resampling iterations INFO [18:13:44.901] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 1/3) INFO [18:13:45.020] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 2/3) INFO [18:13:45.086] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 3/3) INFO [18:13:45.154] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 1/3) INFO [18:13:45.261] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 2/3) INFO [18:13:45.347] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 3/3) INFO [18:13:45.424] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 1/3) INFO [18:13:45.466] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 2/3) INFO [18:13:45.512] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 3/3) INFO [18:13:45.568] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 1/3) INFO [18:13:45.664] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 2/3) INFO [18:13:45.733] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 3/3) INFO [18:13:45.785] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 1/3) INFO [18:13:45.840] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 2/3) INFO [18:13:45.900] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 3/3) INFO [18:13:45.976] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 1/3) INFO [18:13:46.065] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 2/3) INFO [18:13:46.127] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 3/3) INFO [18:13:46.203] [mlr3] Finished benchmark [ FAIL 1 | WARN 2 | SKIP 0 | PASS 50 ] ══ Failed tests ════════════════════════════════════════════════════════════════ ── Error ('test_BenchmarkAggr.R:99:3'): mlr3 coercions ───────────────────────── Error in `UseMethod("as_data_backend")`: no applicable method for 'as_data_backend' applied to an object of class "NULL" Backtrace: ▆ 1. └─mlr3::tsks(c("pima", "spam")) at test_BenchmarkAggr.R:99:3 2. └─mlr3misc::dictionary_sugar_mget(dict = mlr_tasks, .keys, ...) 3. └─base::lapply(...) 4. └─mlr3misc (local) FUN(X[[i]], ...) 5. └─mlr3misc:::dictionary_get(dict, .key, .dicts_suggest = .dicts_suggest) 6. └─mlr3misc:::dictionary_initialize_item(key, obj, dots) 7. ├─base::do.call(constructor, cargs) 8. └─mlr3 (local) `<fn>`() 9. └─mlr3::as_data_backend(load_dataset("PimaIndiansDiabetes2", "mlbench")) [ FAIL 1 | WARN 2 | SKIP 0 | PASS 50 ] Error: ! Test failures. Execution halted Flavor: r-patched-linux-x86_64

Version: 0.1.7
Check: tests
Result: ERROR Running ‘testthat.R’ [8s/11s] Running the tests in ‘tests/testthat.R’ failed. Complete output: > if (requireNamespace("testthat", quietly = TRUE)) { + library("testthat") + library("checkmate") # for more expect_*() functions + library("mlr3benchmark") + test_check("mlr3benchmark") + } Saving _problems/test_BenchmarkAggr-99.R INFO [18:18:23.218] [mlr3] Running benchmark with 18 resampling iterations INFO [18:18:24.024] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 1/3) INFO [18:18:24.133] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 2/3) INFO [18:18:24.191] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 3/3) INFO [18:18:24.265] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 1/3) INFO [18:18:24.331] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 2/3) INFO [18:18:24.376] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 3/3) INFO [18:18:24.420] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 1/3) INFO [18:18:24.475] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 2/3) INFO [18:18:24.523] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 3/3) INFO [18:18:24.571] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 1/3) INFO [18:18:24.635] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 2/3) INFO [18:18:24.730] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 3/3) INFO [18:18:24.797] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 1/3) INFO [18:18:24.854] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 2/3) INFO [18:18:24.926] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 3/3) INFO [18:18:25.040] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 1/3) INFO [18:18:25.124] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 2/3) INFO [18:18:25.199] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 3/3) INFO [18:18:25.345] [mlr3] Finished benchmark [ FAIL 1 | WARN 2 | SKIP 0 | PASS 50 ] ══ Failed tests ════════════════════════════════════════════════════════════════ ── Error ('test_BenchmarkAggr.R:99:3'): mlr3 coercions ───────────────────────── Error in `UseMethod("as_data_backend")`: no applicable method for 'as_data_backend' applied to an object of class "NULL" Backtrace: ▆ 1. └─mlr3::tsks(c("pima", "spam")) at test_BenchmarkAggr.R:99:3 2. └─mlr3misc::dictionary_sugar_mget(dict = mlr_tasks, .keys, ...) 3. └─base::lapply(...) 4. └─mlr3misc (local) FUN(X[[i]], ...) 5. └─mlr3misc:::dictionary_get(dict, .key, .dicts_suggest = .dicts_suggest) 6. └─mlr3misc:::dictionary_initialize_item(key, obj, dots) 7. ├─base::do.call(constructor, cargs) 8. └─mlr3 (local) `<fn>`() 9. └─mlr3::as_data_backend(load_dataset("PimaIndiansDiabetes2", "mlbench")) [ FAIL 1 | WARN 2 | SKIP 0 | PASS 50 ] Error: ! Test failures. Execution halted Flavor: r-release-linux-x86_64

Version: 0.1.7
Check: tests
Result: ERROR Running 'testthat.R' [6s] Running the tests in 'tests/testthat.R' failed. Complete output: > if (requireNamespace("testthat", quietly = TRUE)) { + library("testthat") + library("checkmate") # for more expect_*() functions + library("mlr3benchmark") + test_check("mlr3benchmark") + } Saving _problems/test_BenchmarkAggr-99.R INFO [16:07:40.055] [mlr3] Running benchmark with 18 resampling iterations INFO [16:07:40.305] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 1/3) INFO [16:07:40.363] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 2/3) INFO [16:07:40.411] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 3/3) INFO [16:07:40.454] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 1/3) INFO [16:07:40.504] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 2/3) INFO [16:07:40.537] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 3/3) INFO [16:07:40.569] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 1/3) INFO [16:07:40.620] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 2/3) INFO [16:07:40.668] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 3/3) INFO [16:07:40.707] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 1/3) INFO [16:07:40.753] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 2/3) INFO [16:07:40.796] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 3/3) INFO [16:07:40.831] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 1/3) INFO [16:07:40.877] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 2/3) INFO [16:07:40.930] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 3/3) INFO [16:07:40.986] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 1/3) INFO [16:07:41.034] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 2/3) INFO [16:07:41.085] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 3/3) INFO [16:07:41.149] [mlr3] Finished benchmark [ FAIL 1 | WARN 2 | SKIP 0 | PASS 50 ] ══ Failed tests ════════════════════════════════════════════════════════════════ ── Error ('test_BenchmarkAggr.R:99:3'): mlr3 coercions ───────────────────────── Error in `UseMethod("as_data_backend")`: no applicable method for 'as_data_backend' applied to an object of class "NULL" Backtrace: ▆ 1. └─mlr3::tsks(c("pima", "spam")) at test_BenchmarkAggr.R:99:3 2. └─mlr3misc::dictionary_sugar_mget(dict = mlr_tasks, .keys, ...) 3. └─base::lapply(...) 4. └─mlr3misc (local) FUN(X[[i]], ...) 5. └─mlr3misc:::dictionary_get(dict, .key, .dicts_suggest = .dicts_suggest) 6. └─mlr3misc:::dictionary_initialize_item(key, obj, dots) 7. ├─base::do.call(constructor, cargs) 8. └─mlr3 (local) `<fn>`() 9. └─mlr3::as_data_backend(load_dataset("PimaIndiansDiabetes2", "mlbench")) [ FAIL 1 | WARN 2 | SKIP 0 | PASS 50 ] Error: ! Test failures. Execution halted Flavor: r-release-windows-x86_64

Version: 0.1.7
Check: tests
Result: ERROR Running 'testthat.R' [10s] Running the tests in 'tests/testthat.R' failed. Complete output: > if (requireNamespace("testthat", quietly = TRUE)) { + library("testthat") + library("checkmate") # for more expect_*() functions + library("mlr3benchmark") + test_check("mlr3benchmark") + } Saving _problems/test_BenchmarkAggr-99.R INFO [20:00:03.446] [mlr3] Running benchmark with 18 resampling iterations INFO [20:00:03.719] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 1/3) INFO [20:00:03.824] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 2/3) INFO [20:00:03.885] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 3/3) INFO [20:00:03.946] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 1/3) INFO [20:00:04.017] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 2/3) INFO [20:00:04.077] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 3/3) INFO [20:00:04.138] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 1/3) INFO [20:00:04.203] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 2/3) INFO [20:00:04.273] [mlr3] Applying learner 'rpart2' on task 'iris' (iter 3/3) INFO [20:00:04.329] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 1/3) INFO [20:00:04.399] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 2/3) INFO [20:00:04.441] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 3/3) INFO [20:00:04.494] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 1/3) INFO [20:00:04.574] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 2/3) INFO [20:00:04.657] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 3/3) INFO [20:00:04.741] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 1/3) INFO [20:00:04.821] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 2/3) INFO [20:00:04.902] [mlr3] Applying learner 'rpart2' on task 'sonar' (iter 3/3) INFO [20:00:04.995] [mlr3] Finished benchmark [ FAIL 1 | WARN 2 | SKIP 0 | PASS 50 ] ══ Failed tests ════════════════════════════════════════════════════════════════ ── Error ('test_BenchmarkAggr.R:99:3'): mlr3 coercions ───────────────────────── Error in `UseMethod("as_data_backend")`: no applicable method for 'as_data_backend' applied to an object of class "NULL" Backtrace: ▆ 1. └─mlr3::tsks(c("pima", "spam")) at test_BenchmarkAggr.R:99:3 2. └─mlr3misc::dictionary_sugar_mget(dict = mlr_tasks, .keys, ...) 3. └─base::lapply(...) 4. └─mlr3misc (local) FUN(X[[i]], ...) 5. └─mlr3misc:::dictionary_get(dict, .key, .dicts_suggest = .dicts_suggest) 6. └─mlr3misc:::dictionary_initialize_item(key, obj, dots) 7. ├─base::do.call(constructor, cargs) 8. └─mlr3 (local) `<fn>`() 9. └─mlr3::as_data_backend(load_dataset("PimaIndiansDiabetes2", "mlbench")) [ FAIL 1 | WARN 2 | SKIP 0 | PASS 50 ] Error: ! Test failures. Execution halted Flavor: r-oldrel-windows-x86_64