Commit 38e51eb
[SPARK-41398][SQL][FOLLOWUP] Update runtime filtering javadoc to reflect relaxed partition constraints
Update the javadoc for `SupportsRuntimeV2Filtering.filter()` and `SupportsRuntimeFiltering.filter()` to reflect the changes made in [SPARK-41398](https://issues.apache.org/jira/browse/SPARK-41398), which relaxed the constraint on partition values during runtime filtering.
After that change, scans can now either:
- Replace partitions with no matching data with empty InputPartitions, or
- Report only a subset of the original partition values (omitting those with no data)
The previous documentation stated that the "overall number of partitions" must be preserved, which is no longer required. The only constraint is that new partition values not present in the original partitioning cannot be introduced.
### What changes were proposed in this pull request?
A javadoc update to follow up on #38924
### Why are the changes needed?
To make the java doc up to date for future implementer
### Does this PR introduce _any_ user-facing change?
No
### How was this patch tested?
compile and checkstyle
### Was this patch authored or co-authored using generative AI tooling?
Yes - Claude Opus 4.5
Closes #54046 from yyanyy/spark-41398-update-javadoc.
Authored-by: Yan Yan <[email protected]>
Signed-off-by: Wenchen Fan <[email protected]>1 parent 3d1188a commit 38e51eb
File tree
2 files changed
+8
-5
lines changed- sql/catalyst/src/main/java/org/apache/spark/sql/connector/read
2 files changed
+8
-5
lines changedLines changed: 4 additions & 2 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
51 | 51 | | |
52 | 52 | | |
53 | 53 | | |
54 | | - | |
55 | | - | |
| 54 | + | |
| 55 | + | |
| 56 | + | |
| 57 | + | |
56 | 58 | | |
57 | 59 | | |
58 | 60 | | |
| |||
Lines changed: 4 additions & 3 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
55 | 55 | | |
56 | 56 | | |
57 | 57 | | |
58 | | - | |
59 | | - | |
60 | | - | |
| 58 | + | |
| 59 | + | |
| 60 | + | |
| 61 | + | |
61 | 62 | | |
62 | 63 | | |
63 | 64 | | |
| |||
0 commit comments