Skip to content

Ballista refactor QueryStageExec in preparation for map-side shuffle #458

@andygrove

Description

@andygrove

Is your feature request related to a problem or challenge? Please describe what you are trying to do.
This issue is to track some refactoring work in preparation for implementing map-side shuffle.

Describe the solution you'd like
We have Ballista executor code that executes a partition and streams results to disk. I would like to move this code to QueryStageExec instead and structure it so that we can implement map-side shuffle.

Describe alternatives you've considered
None

Additional context
None

Metadata

Metadata

Assignees

Labels

enhancementNew feature or request

Type

No type
No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions