What do you want to do?
Tell us about your request.
The pooling_mode parameter in the Register Model API documentation (_ml-commons-plugin/api/model-apis/register-model.md) currently lists supported values as mean, mean_sqrt_len, max, weightedmean, and cls.
A new none pooling mode is being added in ml-commons (opensearch-project/ml-commons#4710) to fix a bug where MEAN pooling was applied by default even for models that already provide pre-pooled sentence_embedding output. This caused embeddings to not match Python inference output.
The documentation should be updated to:
- Add
none to the list of supported pooling_mode values in the model_config object table
- Describe that
none uses pre-pooled output from the model directly without additional pooling computation, suitable for models that already provide pooled embeddings (e.g., sentence_embedding or pooler_output)
Version: 3.4
What other resources are available?
What do you want to do?
Tell us about your request.
The
pooling_modeparameter in the Register Model API documentation (_ml-commons-plugin/api/model-apis/register-model.md) currently lists supported values asmean,mean_sqrt_len,max,weightedmean, andcls.A new
nonepooling mode is being added in ml-commons (opensearch-project/ml-commons#4710) to fix a bug where MEAN pooling was applied by default even for models that already provide pre-pooledsentence_embeddingoutput. This caused embeddings to not match Python inference output.The documentation should be updated to:
noneto the list of supportedpooling_modevalues in themodel_configobject tablenoneuses pre-pooled output from the model directly without additional pooling computation, suitable for models that already provide pooled embeddings (e.g.,sentence_embeddingorpooler_output)Version: 3.4
What other resources are available?