-
Notifications
You must be signed in to change notification settings - Fork 29k
[SPARK-22732] Add Structured Streaming APIs to DataSourceV2 #19925
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Closed
Closed
Changes from 1 commit
Commits
Show all changes
33 commits
Select commit
Hold shift + click to select a range
cbf7837
add tests
jose-torres 10ac599
writer impl
jose-torres 5594f7a
rm useless writer
jose-torres a364fa6
rm weird docs
jose-torres 41d732c
shuffle around public interfaces
jose-torres 60c12c2
fix imports
jose-torres 57db413
put deserialize in reader so we don't have to port SerializedOffset
jose-torres 93b6976
off by one errors grr
jose-torres abd20db
document right semantics
jose-torres 3629d27
document checkpoint location
jose-torres d021f31
add getStart to continuous and clarify semantics
jose-torres 052808a
cleanup offset set/get docs
jose-torres 7a7638b
cleanup reader docs
jose-torres 81efbee
explain getOffset
jose-torres a9c43d9
fix fmt
jose-torres 3f03f50
fix doc
jose-torres 6338043
note interfaces are temporary
jose-torres 8949571
fix wording
jose-torres df9f224
lifecycle
jose-torres ddaee34
fix offset semantic implementation
jose-torres 1608444
remove unneeded restriction
jose-torres 49525b4
deserializeOffset
jose-torres a9fbf33
add copyright headers
jose-torres 22d07cd
rebase against datasource package change
jose-torres 0b68873
refer properly to sink
jose-torres f924a8a
widen tolerance interval in continuous rate source test
jose-torres 4d166de
widen tolerance interval
jose-torres 7c46b33
clarify start offset
jose-torres 8a2a4f1
add docs
jose-torres 8809bf9
fix problems
jose-torres 0974ac3
even timestamps
jose-torres c1a6322
unify offsets
jose-torres 3cb6cee
undo spurious rename
jose-torres File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
explain getOffset
- Loading branch information
commit 81efbeeca9c41a52bf2112c11f4ec4f042dc2b52
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
better to use a real java doc link, e.g.
{@link DataReader#get}