Skip to content

Commit 544eb1b

Browse files
committed
fix docs
1 parent 55b38db commit 544eb1b

File tree

1 file changed

+4
-3
lines changed
  • sql/core/src/main/java/org/apache/spark/sql/sources/v2/writer

1 file changed

+4
-3
lines changed

sql/core/src/main/java/org/apache/spark/sql/sources/v2/writer/DataWriter.java

Lines changed: 4 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -22,7 +22,7 @@
2222
import org.apache.spark.annotation.InterfaceStability;
2323

2424
/**
25-
* A data writer returned by {@link DataWriterFactory#createDataWriter(int, int)} and is
25+
* A data writer returned by {@link DataWriterFactory#createDataWriter(int, int, long)} and is
2626
* responsible for writing data for an input RDD partition.
2727
*
2828
* One Spark task has one exclusive data writer, so there is no thread-safe concern.
@@ -36,8 +36,9 @@
3636
* {@link DataSourceWriter#commit(WriterCommitMessage[])} with commit messages from other data
3737
* writers. If this data writer fails(one record fails to write or {@link #commit()} fails), an
3838
* exception will be sent to the driver side, and Spark will retry this writing task for some times,
39-
* each time {@link DataWriterFactory#createDataWriter(int, int)} gets a different `attemptNumber`,
40-
* and finally call {@link DataSourceWriter#abort(WriterCommitMessage[])} if all retry fail.
39+
* each time {@link DataWriterFactory#createDataWriter(int, int, long)} gets a different
40+
* `attemptNumber`, and finally call {@link DataSourceWriter#abort(WriterCommitMessage[])} if all
41+
* retry fail.
4142
*
4243
* Besides the retry mechanism, Spark may launch speculative tasks if the existing writing task
4344
* takes too long to finish. Different from retried tasks, which are launched one by one after the

0 commit comments

Comments
 (0)