File tree Expand file tree Collapse file tree 2 files changed +3
-3
lines changed
sql/core/src/main/java/org/apache/spark/sql/sources/v2/writer Expand file tree Collapse file tree 2 files changed +3
-3
lines changed Original file line number Diff line number Diff line change 3838 * succeeds), a {@link WriterCommitMessage} will be sent to the driver side and pass to
3939 * {@link DataSourceWriter#commit(WriterCommitMessage[])} with commit messages from other data
4040 * writers. If this data writer fails(one record fails to write or {@link #commit()} fails), an
41- * exception will be sent to the driver side, and Spark will retry this writing task for some times,
41+ * exception will be sent to the driver side, and Spark may retry this writing task for some times,
4242 * each time {@link DataWriterFactory#createDataWriter(int, int, long)} gets a different
4343 * `attemptNumber`, and finally call {@link DataSourceWriter#abort(WriterCommitMessage[])} if all
4444 * retry fail.
Original file line number Diff line number Diff line change @@ -49,8 +49,8 @@ public interface DataWriterFactory<T> extends Serializable {
4949 * tasks with the same task id running at the same time. Implementations can
5050 * use this attempt number to distinguish writers of different task attempts.
5151 * @param epochId A monotonically increasing id for streaming queries that are split in to
52- * discrete periods of execution. For queries that execute as a single batch, this
53- * id will always be zero .
52+ * discrete periods of execution. For non-streaming queries,
53+ * this ID will always be 0 .
5454 */
5555 DataWriter <T > createDataWriter (int partitionId , int attemptNumber , long epochId );
5656}
You can’t perform that action at this time.
0 commit comments