Skip to content

refactor(proto): migrate UnionExec and InterleaveExec serde#23782

Merged
adriangb merged 6 commits into
apache:mainfrom
buraksenn:buraksen/23503-proto-unions
Jul 23, 2026
Merged

refactor(proto): migrate UnionExec and InterleaveExec serde#23782
adriangb merged 6 commits into
apache:mainfrom
buraksenn:buraksen/23503-proto-unions

Conversation

@buraksenn

Copy link
Copy Markdown
Contributor

Which issue does this PR close?

Rationale for this change

Part of epic #23494. Moves UnionExec and InterleaveExec protobuf serialization from central dispatch

What changes are included in this PR?

add new proto functions in physical plan and deprecate proto ones

Are these changes tested?

yes existing round trip tests pass

Are there any user-facing changes?

existing methods are deprecated with no immediate api change

@github-actions github-actions Bot added proto Related to proto crate physical-plan Changes to the physical-plan crate labels Jul 22, 2026
@github-actions

github-actions Bot commented Jul 22, 2026

Copy link
Copy Markdown

Thank you for opening this pull request!

Reviewer note: cargo-semver-checks reported the current version number is not SemVer-compatible with the changes in this pull request (compared against the base branch).

Details
     Cloning apache/main
    Building datafusion-physical-plan v54.1.0 (current)
       Built [  38.927s] (current)
     Parsing datafusion-physical-plan v54.1.0 (current)
      Parsed [   0.140s] (current)
    Building datafusion-physical-plan v54.1.0 (baseline)
       Built [  37.591s] (baseline)
     Parsing datafusion-physical-plan v54.1.0 (baseline)
      Parsed [   0.139s] (baseline)
    Checking datafusion-physical-plan v54.1.0 -> v54.1.0 (no change; assume patch)
     Checked [   0.708s] 223 checks: 223 pass, 30 skip
     Summary no semver update required
    Finished [  78.803s] datafusion-physical-plan
    Building datafusion-proto v54.1.0 (current)
       Built [  61.291s] (current)
     Parsing datafusion-proto v54.1.0 (current)
      Parsed [   0.019s] (current)
    Building datafusion-proto v54.1.0 (baseline)
       Built [  61.174s] (baseline)
     Parsing datafusion-proto v54.1.0 (baseline)
      Parsed [   0.020s] (baseline)
    Checking datafusion-proto v54.1.0 -> v54.1.0 (no change; assume patch)
     Checked [   0.222s] 223 checks: 222 pass, 1 fail, 0 warn, 30 skip

--- failure trait_method_marked_deprecated: trait method #[deprecated] added ---

Description:
A trait method is now #[deprecated]. Downstream crates will get a compiler warning when using this method.
        ref: https://doc.rust-lang.org/reference/attributes/diagnostics.html#the-deprecated-attribute
       impl: https://github.com/obi1kenobi/cargo-semver-checks/tree/v0.49.0/src/lints/trait_method_marked_deprecated.ron

Failed in:
  method try_into_union_physical_plan in trait datafusion_proto::physical_plan::PhysicalPlanNodeExt in /home/runner/work/datafusion/datafusion/datafusion/proto/src/physical_plan/mod.rs:716
  method try_into_interleave_physical_plan in trait datafusion_proto::physical_plan::PhysicalPlanNodeExt in /home/runner/work/datafusion/datafusion/datafusion/proto/src/physical_plan/mod.rs:716
  method try_from_union_exec in trait datafusion_proto::physical_plan::PhysicalPlanNodeExt in /home/runner/work/datafusion/datafusion/datafusion/proto/src/physical_plan/mod.rs:716
  method try_from_interleave_exec in trait datafusion_proto::physical_plan::PhysicalPlanNodeExt in /home/runner/work/datafusion/datafusion/datafusion/proto/src/physical_plan/mod.rs:716

     Summary semver requires new minor version: 0 major and 1 minor checks failed
    Finished [ 123.931s] datafusion-proto

@github-actions github-actions Bot added the auto detected api change Auto detected API change label Jul 22, 2026

@Phoenix500526 Phoenix500526 left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@adriangb
adriangb added this pull request to the merge queue Jul 23, 2026
@github-merge-queue
github-merge-queue Bot removed this pull request from the merge queue due to failed status checks Jul 23, 2026
@adriangb
adriangb added this pull request to the merge queue Jul 23, 2026
@github-merge-queue
github-merge-queue Bot removed this pull request from the merge queue due to a conflict with the base branch Jul 23, 2026
@adriangb

Copy link
Copy Markdown
Contributor

Need conflict resolution here too 🙏🏻

…lve-pr-23782

# Conflicts:
#	datafusion/proto/src/physical_plan/mod.rs
…lve-pr-23782

# Conflicts:
#	datafusion/proto/src/physical_plan/mod.rs
@adriangb
adriangb enabled auto-merge July 23, 2026 20:05
@adriangb
adriangb added this pull request to the merge queue Jul 23, 2026
@codecov-commenter

Copy link
Copy Markdown

Codecov Report

❌ Patch coverage is 54.65116% with 39 lines in your changes missing coverage. Please review.
✅ Project coverage is 80.71%. Comparing base (dd1ebde) to head (c38ad74).

Files with missing lines Patch % Lines
datafusion/proto/src/physical_plan/mod.rs 5.55% 34 Missing ⚠️
datafusion/physical-plan/src/union.rs 90.00% 0 Missing and 5 partials ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##             main   #23782      +/-   ##
==========================================
- Coverage   80.72%   80.71%   -0.02%     
==========================================
  Files        1090     1090              
  Lines      369357   369393      +36     
  Branches   369357   369393      +36     
==========================================
- Hits       298173   298147      -26     
- Misses      53415    53471      +56     
- Partials    17769    17775       +6     

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

Merged via the queue into apache:main with commit 1763417 Jul 23, 2026
40 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

auto detected api change Auto detected API change physical-plan Changes to the physical-plan crate proto Related to proto crate

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Proto: migrate UnionExec + InterleaveExec

4 participants