Skip to content
Closed
Changes from 1 commit
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
clarify DataWriter lifecycle
  • Loading branch information
jose-torres committed Mar 3, 2018
commit f5948e8eff859df0858f864c566e1cb39705ea1d
Original file line number Diff line number Diff line change
Expand Up @@ -31,6 +31,9 @@
* the {@link #write(Object)}, {@link #abort()} is called afterwards and the remaining records will
* not be processed. If all records are successfully written, {@link #commit()} is called.
*
* Once a data writer returns successfully from {@link #commit()} or {@link #abort()}, its lifecycle
* is over and Spark will not use it again.
*
* If this data writer succeeds(all records are successfully written and {@link #commit()}
* succeeds), a {@link WriterCommitMessage} will be sent to the driver side and pass to
* {@link DataSourceWriter#commit(WriterCommitMessage[])} with commit messages from other data
Expand Down