Skip to content

Use logits per default when explaining models like tabpfn. #426

@mmschlk

Description

@mmschlk

Describe the workflow you want to enable

If a model has a predict_logits function then this should be explained per default.

Explanations for classifiers should happen in the logits space and not in the probabilities space per default. Currently users can pass a model's predict_logits function to shapiq and get this explained. However, novice users may pass the model, where we currently are not using the predict_logits function as default.

Describe your proposed solution

Suggested implementation:

Implementation

Prioritize the predict_logits function when parsing a model over predict and predict_proba

Test

Test weather predict_logits gets picked over predict_proba and explained for a (lightweight) model that implements both.

Describe alternatives you've considered, if relevant

No response

Additional context

This got recently discussed/addressed in tabpfn (PriorLabs/TabPFN#374). Newer tabpfn versions should expose predict_logits now.

Impact

High (Major improvement)

Metadata

Metadata

Assignees

No one assigned

    Labels

    explainer 🔍All issues that are linked to explainersfeature 💡New feature or enhancement requestgood first issue 👌An issue which should be a good first issue for getting into the library.help wanted 🙏Extra attention is needed

    Projects

    Status

    ✅ Done

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions