Split your training data for both models.So how should one go about conducting a fair comparison? If youve ever lost a game of Fortnite to someone. Now you might ask, "so what's the point of best_model.best_score_? Well, that score is used to compare all the models used when searching for the optimal hyperparameters in your search space, but in no way should be used to compare against a model that was trained outside of the grid search context. Aimbot hacks do indeed exist for Fortnite, and some of them are good enough to make even the most novice player aim like Tfue, or even better. So your score for the grid search is going to be worse than your baseline. Compound that with the fact that it's getting trained with even less data due to the 5 folds (it's training with only 4/5 of X_val per fold).It's working with less data since you have split the X_train sample.The grid searched model is at a disadvantage because: ![]() ![]() ![]() This is like cheating because the model is going to already perform the best since you're evaluating it based on data that it has already seen. Then you're using the fitted model to score the X_train sample. Your baseline model used X_train to fit the model.
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |