training_args module won't load with Transformers 5.0

[dwvisser]

This affects v1.1.3, as can be seen below.

Repro Steps

❯ cd `mktemp -d`

❯ uv venv --python 3.12
Using CPython 3.12.12
Creating virtual environment at: .venv
Activate with: source .venv/bin/activate

❯ source .venv/bin/activate

❯ uv pip install setfit
Resolved 75 packages in 55ms
Prepared 1 package in 34.26s
Installed 75 packages in 355ms
…
 + setfit==1.1.3
…
 + transformers==5.0.0
 + triton==3.6.0
 + typer-slim==0.21.1
 + typing-extensions==4.15.0
 + urllib3==2.6.3
 + xxhash==3.6.0
 + yarl==1.22.0

❯ python -c "from setfit.training_args import TrainingArguments"
Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "/tmp/tmp.5gxvjzF3Sa/.venv/lib/python3.12/site-packages/setfit/__init__.py", line 10, in <module>
    from .span import AbsaModel, AbsaTrainer, AspectExtractor, AspectModel, PolarityModel
  File "/tmp/tmp.5gxvjzF3Sa/.venv/lib/python3.12/site-packages/setfit/span/__init__.py", line 3, in <module>
    from .trainer import AbsaTrainer
  File "/tmp/tmp.5gxvjzF3Sa/.venv/lib/python3.12/site-packages/setfit/span/trainer.py", line 8, in <module>
    from setfit.training_args import TrainingArguments
  File "/tmp/tmp.5gxvjzF3Sa/.venv/lib/python3.12/site-packages/setfit/training_args.py", line 13, in <module>
    from transformers.training_args import default_logdir
ImportError: cannot import name 'default_logdir' from 'transformers.training_args' (/tmp/tmp.5gxvjzF3Sa/.venv/lib/python3.12/site-packages/transformers/training_args.py)

Installing an older version of transformers fixed the error:

❯ uv pip install "transformers<5.0"
Resolved 18 packages in 26ms
Uninstalled 2 packages in 62ms
Installed 2 packages in 414ms
 - huggingface-hub==1.3.4
 + huggingface-hub==0.36.0
 - transformers==5.0.0
 + transformers==4.57.6

❯ python -c "from setfit.training_args import TrainingArguments"

That last command returned with a "good" zero return code.

[leomaurodesenv]

Similar here.. it is not working with the following packages, uv package management

dependencies = [
    "accelerate~=0.30.1",
    "datasets~=4.5.0",
    "huggingface-hub~=1.4.1",
    "optimum~=2.0.0",
    "optimum-intel~=1.15.0",
    "setfit~=1.1.3",
    "tokenizers~=0.22.2",
    "tqdm~=4.67.1",
    "transformers~=5.2.0",
]

Code

from setfit import (
    SetFitModel,
    TrainingArguments,
    Trainer,
    sample_dataset,
)

# Set random seed
DATASET_SEED = 42
DATASET_UNLABELED_SIZE = 100
TRAIN_BATCH_SIZE = 16
MAX_STEPS = 100

# Prepare dataset
data = MyDatasetLoader()
dataset = data.get_cleaned_data().shuffle(seed=DATASET_SEED)

eval_dataset = dataset["train"]
unlabeled_train_dataset = (
    dataset["train"].select(range(DATASET_UNLABELED_SIZE)).remove_columns("label")
)
train_dataset = sample_dataset(
    dataset["train"], label_column="label", num_samples=TRAIN_BATCH_SIZE
)

# Prepare model
teacher_model = SetFitModel.from_pretrained(
    "sentence-transformers/paraphrase-MiniLM-L3-v2"
)

# Teacher training
training_args = TrainingArguments(
    batch_size=TRAIN_BATCH_SIZE,
    max_steps=MAX_STEPS,
)

teacher_trainer = Trainer(
    model=teacher_model,
    args=training_args,
    train_dataset=train_dataset,
    eval_dataset=eval_dataset,
)

# Train teacher model
teacher_trainer.train()
teacher_metrics = teacher_trainer.evaluate()
print(teacher_metrics)

Error in terminal

$ uv run main.py
Traceback (most recent call last):
  File "/home/leomaurodesenv/repository/slm/main.py", line 1, in <module>
    from setfit import (
  File "/home/leomaurodesenv/repository/slm/.venv/lib/python3.10/site-packages/setfit/__init__.py", line 10, in <module>
    from .span import AbsaModel, AbsaTrainer, AspectExtractor, AspectModel, PolarityModel
  File "/home/leomaurodesenv/repository/slm/.venv/lib/python3.10/site-packages/setfit/span/__init__.py", line 3, in <module>
    from .trainer import AbsaTrainer
  File "/home/leomaurodesenv/repository/slm/.venv/lib/python3.10/site-packages/setfit/span/trainer.py", line 8, in <module>
    from setfit.training_args import TrainingArguments
  File "/home/leomaurodesenv/repository/slm/.venv/lib/python3.10/site-packages/setfit/training_args.py", line 13, in <module>
    from transformers.training_args import default_logdir
ImportError: cannot import name 'default_logdir' from 'transformers.training_args' (/home/leomaurodesenv/repository/slm/.venv/lib/python3.10/site-packages/transformers/training_args.py)

[motine]

i ended up installing transformers < 5

+1

I experience the same issue while trying with uv, python 3.14 and transformers 5.5.4 (latest as of writing).