Skip to content

first pass of dedicated tutorial for LLM as a Judge, and documenting the apis in SRW page.#12083

Draft
epugh wants to merge 17 commits intoopensearch-project:mainfrom
o19s:add_llm_as_a_judge_docs
Draft

first pass of dedicated tutorial for LLM as a Judge, and documenting the apis in SRW page.#12083
epugh wants to merge 17 commits intoopensearch-project:mainfrom
o19s:add_llm_as_a_judge_docs

Conversation

@epugh
Copy link
Copy Markdown
Collaborator

@epugh epugh commented Mar 10, 2026

Description

Documentation in SRW about this new judgment creation capabilty, and then a dedicated tutorial inspired by tutorials/vector-search/neural-search-tutorial example.

Issues Resolved

n/a

Version

3.5

Frontend features

n/a

Checklist

  • [x ] By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license and subject to the Developers Certificate of Origin.
    For more information on following Developer Certificate of Origin and signing off your commits, please check here.

@github-actions
Copy link
Copy Markdown

Thank you for submitting your PR. The PR states are In progress (or Draft) -> Tech review -> Doc review -> Merged.

Before you submit your PR for doc review, make sure the content is technically accurate. If you need help finding a tech reviewer, tag a maintainer.

When you're ready for doc review, tag the assignee of this PR. The doc reviewer may push edits to the PR directly or leave comments and editorial suggestions for you to address (let us know in a comment if you have a preference).

@epugh
Copy link
Copy Markdown
Collaborator Author

epugh commented Mar 10, 2026

cc @wrigleyDan @heemin32

gweyeratlassian and others added 17 commits April 6, 2026 09:14
* Add RomanianAnalyzer to 3.x breaking changes

Signed-off-by: Gabriel Weyer <159976942+gweyeratlassian@users.noreply.github.com>

* Improve Romanian analyzer breaking change wording

Co-authored-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
Signed-off-by: Gabriel Weyer <159976942+gweyeratlassian@users.noreply.github.com>

---------

Signed-off-by: Gabriel Weyer <159976942+gweyeratlassian@users.noreply.github.com>
Co-authored-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
Signed-off-by: Eric Pugh <epugh@opensourceconnections.com>
Signed-off-by: Eric Pugh <epugh@opensourceconnections.com>
Signed-off-by: Eric Pugh <epugh@opensourceconnections.com>
Signed-off-by: Eric Pugh <epugh@opensourceconnections.com>
Signed-off-by: Eric Pugh <epugh@opensourceconnections.com>
…-project#11978)

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
Signed-off-by: Eric Pugh <epugh@opensourceconnections.com>
…11981)

* Add warning about truncation to ML documentation

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Apply suggestions from code review

Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>

* Apply suggestion from @kolchfa-aws

Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>

---------

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
Signed-off-by: Eric Pugh <epugh@opensourceconnections.com>
Signed-off-by: xiaoyuan0821 <yuan13215@163.com>
Co-authored-by: x00815292 <niklaus.xiao@huawei.com>
Signed-off-by: Eric Pugh <epugh@opensourceconnections.com>
…#12065)

Signed-off-by: Mykola Shestopal <nick4eva@users.noreply.github.com>
Signed-off-by: Eric Pugh <epugh@opensourceconnections.com>
…project#12020)

* Add restoring snapshot from a remote-backed cluster docs

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Formatting

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Link fix and reword

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

---------

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
Signed-off-by: Eric Pugh <epugh@opensourceconnections.com>
…roject#12071)

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
Signed-off-by: Eric Pugh <epugh@opensourceconnections.com>
* Add 2.19.5 to version history

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Updated release description

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

---------

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
Signed-off-by: Eric Pugh <epugh@opensourceconnections.com>
…ct#11982)

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
Signed-off-by: Eric Pugh <epugh@opensourceconnections.com>
…pensearch-project#12089)

* Fix create sparse vector index error

Signed-off-by: xiaoyuan0821 <yuan13215@163.com>

* Create index with explicit mapping for sort by geo distance example

Signed-off-by: xiaoyuan0821 <yuan13215@163.com>

* Add copy buttons and intro sentence to mapping

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

---------

Signed-off-by: xiaoyuan0821 <yuan13215@163.com>
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
Co-authored-by: x00815292 <niklaus.xiao@huawei.com>
Co-authored-by: Fanit Kolchina <kolchfa@amazon.com>
Signed-off-by: Eric Pugh <epugh@opensourceconnections.com>
)

* Adding rerank documentation for agentic search

Signed-off-by: Joshua Palis <jpalis@amazon.com>

* Doc review

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Reformat requests and clarify steps

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Apply suggestion from @kolchfa-aws

Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>

---------

Signed-off-by: Joshua Palis <jpalis@amazon.com>
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
Co-authored-by: Fanit Kolchina <kolchfa@amazon.com>
Co-authored-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
Signed-off-by: Eric Pugh <epugh@opensourceconnections.com>
Signed-off-by: Eric Pugh <epugh@opensourceconnections.com>
Signed-off-by: Eric Pugh <epugh@opensourceconnections.com>
@epugh epugh force-pushed the add_llm_as_a_judge_docs branch from 735a0a0 to 223dfef Compare April 6, 2026 07:14
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

backport 3.6 In progress Issue/PR: The issue or PR is in progress.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants