Skip to content

Conversation

JoshuaSloan
Copy link

@JoshuaSloan JoshuaSloan commented Sep 9, 2025

Fixes #7498

The NumberOfLeaves hyperparameter was not updating in FastForest AutoML experiments for regression and multiclass classification tasks (see regression example in the associated issue, which was trained on the California Housing dataset and optimizing for root mean squared error).

Consequently, the trial parameters reported via an experiment monitor's final ReportBestTrial() method were not aligning with the actual model produced by the experiment. Additionally, model performance was hurt due to the static hyperparameter constraint.

  • There's a descriptive title that will make sense to other developers some time from now.
  • There's associated issues. All PR's should have issue(s) associated - unless a trivial self-evident change such as fixing a typo. You can use the format Fixes #nnnn in your description to cause GitHub to automatically close the issue(s) when your PR is merged.
  • Your change description explains what the change does, why you chose your approach, and anything else that reviewers should know.
  • You have included any necessary tests in the same PR.

Copy link

codecov bot commented Sep 9, 2025

Codecov Report

❌ Patch coverage is 50.00000% with 1 line in your changes missing coverage. Please review.
✅ Project coverage is 69.00%. Comparing base (fb39755) to head (b232462).

Files with missing lines Patch % Lines
...AutoML/SweepableEstimator/Estimators/FastForest.cs 50.00% 1 Missing ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##             main    #7499      +/-   ##
==========================================
- Coverage   69.01%   69.00%   -0.01%     
==========================================
  Files        1482     1482              
  Lines      273999   274001       +2     
  Branches    28258    28258              
==========================================
- Hits       189093   189083      -10     
- Misses      77520    77533      +13     
+ Partials     7386     7385       -1     
Flag Coverage Δ
Debug 69.00% <50.00%> (-0.01%) ⬇️
production 63.30% <50.00%> (-0.01%) ⬇️
test 89.45% <ø> (-0.01%) ⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

Files with missing lines Coverage Δ
...AutoML/SweepableEstimator/Estimators/FastForest.cs 33.33% <50.00%> (-34.24%) ⬇️

... and 6 files with indirect coverage changes

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant