This is a cool one, Machine Learning .Net (ML.Net) now support ranking scenario in AutoML. As an Machine Learning aficionado, this is amazing. I can now process my problems with AutoML, and then learn the specifics of the best produced models.
Note: a couple of weeks ago, someone asked a question around ranking scenarios. My knowledge is low here, so I kindly shared a couple of starting points. With AutoML now supporting ranking scenarios, the response is completely different!
So I picked up the sample for the current version (1.5.1), the sample for standard ranking scenarios from ML.Net and a data source based on a public datasets provided by Microsoft originally provided Microsoft Bing (see references); and I created this sample
The sample run for 10 minutes and evaluates 33 models.
The test file is 266MB and the train data file is 799 MBs.
At the end, the best trainer is [FastTreeRanking].
The output is also very clear about the tested models and the best one. (I trimmed this to make it clearer).
Start ... Running AutoML recommendation experiment for 600 seconds... ===================================================== Total models produced: 33 1 - TrainerName: LightGbmRanking Runtime In Seconds: 10.6167636 2 - TrainerName: FastTreeRanking Runtime In Seconds: 11.1055165 3 - TrainerName: FastTreeRanking Runtime In Seconds: 35.0196598 4 - TrainerName: FastTreeRanking Runtime In Seconds: 6.0401781 ... ===================================================== Best model's trainer: FastTreeRanking Press any key to continue...
Super cool feature !