IndexError: list index out of range

[zkailinzhang]

query_embeddings = model_emd.encode([response])
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^

File "/home/zhangkailin/.conda/envs/easyr1/lib/python3.12/site-packages/torch/utils/_contextlib.py", line 120, in decorate_context
return func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File "/home/zhangkailin/.conda/envs/easyr1/lib/python3.12/site-packages/sentence_transformers/SentenceTransformer.py", line 1062, in encode
features = self.tokenize(sentences_batch, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/zhangkailin/.conda/envs/easyr1/lib/python3.12/site-packages/sentence_transformers/SentenceTransformer.py", line 1621, in tokenize
return self[0].tokenize(texts, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/zhangkailin/.conda/envs/easyr1/lib/python3.12/site-packages/sentence_transformers/models/Transformer.py", line 309, in tokenize
batch2.append(text_tuple[1])
~~~~~~~~~~^^^
IndexError: list index out of range

[Samoed]

Can you share full code to reproduce an error?

[tomaarsen]

Specifically, is response a string, or a list/tuple? I feel like it might be a list of length 1, and then you're accidentally passing a nested list to encode instead of just a string or a single list.

Consider

query_embeddings = model_emd.encode(response)

or if you know it's always a query:

query_embeddings = model_emd.encode_query(response)

This method just calls encode, but uses a query prompt if it's defined in the model configuration.

• Tom Aarsen