Skip to content

Conversation

@Adamyuanyuan
Copy link
Contributor

Purpose of this pull request

#9826

  • Fix the Flink translation semantics for SeaTunnel v1 sinks when running on Flink 1.15/1.16 Streaming, where File/Hive sinks could lose data or fail with source missing during commit.
  • Ensure that, from the SeaTunnel sink’s perspective, prepareCommit(checkpointId) and snapshotState(checkpointId) are executed back‑to‑back for the same checkpoint inside FlinkSinkWriter, removing the race where data is still written into the old transaction directory after prepareCommit.
  • Keep the change local to seatunnel-translation-flink-common (FlinkSinkWriter), preserving existing behavior for Flink 1.13/1.14 and the dedicated Flink 1.20 translation module, and add unit tests to lock in the new semantics.

Does this PR introduce any user-facing change?

no

How was this patch tested?

UT

Check list

@github-actions github-actions bot added the flink label Dec 5, 2025
@Adamyuanyuan
Copy link
Contributor Author

#9826

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant