Skip to content

[SPARK-20783][SQL] Create CachedBatchColumnVector to abstract existing compressed column #18468

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
kiszk wants to merge 21 commits into from
Closed

[SPARK-20783][SQL] Create CachedBatchColumnVector to abstract existing compressed column #18468

Changes from 1 commit
Commits
Show all changes
21 commits
Select commit Hold shift + click to select a range
d4c7d1a
initial commit
kiszk Jun 29, 2017
176fcc9
fix scala style error
kiszk Jun 29, 2017
920b38b
introduced VectorType into ColumnVector
kiszk Jul 7, 2017
aa67f9c
add a new file
kiszk Jul 8, 2017
de27a10
remove ON_HEAP_CACHEDBATCH
kiszk Jul 8, 2017
bb47299
add missing methods
kiszk Jul 8, 2017
cb3e631
add ColumnAccessor.extract(ColumnVector, rowId)
kiszk Jul 11, 2017
68f7e39
rename OnHeapCachedBatch.java to CachedBatchColumnVector.java
kiszk Jul 18, 2017
a068ada
address review comments
kiszk Jul 18, 2017
7c13ed6
address review comments
kiszk Jul 18, 2017
d8fede6
address review comments
kiszk Jul 19, 2017
780115b
address review comment
kiszk Jul 19, 2017
31d2dd7
address review comments
kiszk Jul 19, 2017
8aa9b16
address review comments
kiszk Jul 19, 2017
332fc6c
address review comment
kiszk Jul 20, 2017
dc331f1
address review comments
kiszk Jul 20, 2017
70042d5
fix test faiures
kiszk Jul 21, 2017
d16779f
address review comment
kiszk Jul 21, 2017
ff324fd
addressed review comments
kiszk Jul 21, 2017
157fde1
add initialize() method for reusing CachedBatchColumnVector
kiszk Aug 1, 2017
a26dc15
make initialize public
kiszk Aug 6, 2017
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
address review comment
  • Loading branch information
@kiszk
kiszk committed Aug 7, 2017
commit 332fc6c122fd03f4550bb217d0f8b7fc6608a22d
2 changes: 1 addition & 1 deletion ...core/src/main/java/org/apache/spark/sql/execution/vectorized/CachedBatchColumnVector.java
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -81,7 +81,7 @@ private void prepareAccess(int rowId) {
}
} else {
throw new UnsupportedOperationException("Row access order must be equal or ascending." +
" Row " + rowId + "is accessed after internal row "+ previousRowId + "was accessed.");
" Row " + rowId + "is accessed after row "+ previousRowId + "was accessed.");
}
}

Expand Down