-
Notifications
You must be signed in to change notification settings - Fork 52
Use logits per default when explaining models like tabpfn. #426
Copy link
Copy link
Closed
Labels
explainer 🔍All issues that are linked to explainersAll issues that are linked to explainersfeature 💡New feature or enhancement requestNew feature or enhancement requestgood first issue 👌An issue which should be a good first issue for getting into the library.An issue which should be a good first issue for getting into the library.help wanted 🙏Extra attention is neededExtra attention is needed
Milestone
Metadata
Metadata
Assignees
Labels
explainer 🔍All issues that are linked to explainersAll issues that are linked to explainersfeature 💡New feature or enhancement requestNew feature or enhancement requestgood first issue 👌An issue which should be a good first issue for getting into the library.An issue which should be a good first issue for getting into the library.help wanted 🙏Extra attention is neededExtra attention is needed
Projects
Status
✅ Done
Describe the workflow you want to enable
If a model has a
predict_logitsfunction then this should be explained per default.Explanations for classifiers should happen in the logits space and not in the probabilities space per default. Currently users can pass a model's
predict_logitsfunction to shapiq and get this explained. However, novice users may pass the model, where we currently are not using thepredict_logitsfunction as default.Describe your proposed solution
Suggested implementation:
Implementation
Prioritize the
predict_logitsfunction when parsing a model over predict and predict_probaTest
Test weather
predict_logitsgets picked overpredict_probaand explained for a (lightweight) model that implements both.Describe alternatives you've considered, if relevant
No response
Additional context
This got recently discussed/addressed in tabpfn (PriorLabs/TabPFN#374). Newer tabpfn versions should expose predict_logits now.
Impact
High (Major improvement)