Skip to content

[SPARK-20783][SQL] Create CachedBatchColumnVector to abstract existing compressed column #18468

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
kiszk wants to merge 21 commits into from
Closed

[SPARK-20783][SQL] Create CachedBatchColumnVector to abstract existing compressed column #18468

Changes from 1 commit
Commits
Show all changes
21 commits
Select commit Hold shift + click to select a range
d4c7d1a
initial commit
kiszk Jun 29, 2017
176fcc9
fix scala style error
kiszk Jun 29, 2017
920b38b
introduced VectorType into ColumnVector
kiszk Jul 7, 2017
aa67f9c
add a new file
kiszk Jul 8, 2017
de27a10
remove ON_HEAP_CACHEDBATCH
kiszk Jul 8, 2017
bb47299
add missing methods
kiszk Jul 8, 2017
cb3e631
add ColumnAccessor.extract(ColumnVector, rowId)
kiszk Jul 11, 2017
68f7e39
rename OnHeapCachedBatch.java to CachedBatchColumnVector.java
kiszk Jul 18, 2017
a068ada
address review comments
kiszk Jul 18, 2017
7c13ed6
address review comments
kiszk Jul 18, 2017
d8fede6
address review comments
kiszk Jul 19, 2017
780115b
address review comment
kiszk Jul 19, 2017
31d2dd7
address review comments
kiszk Jul 19, 2017
8aa9b16
address review comments
kiszk Jul 19, 2017
332fc6c
address review comment
kiszk Jul 20, 2017
dc331f1
address review comments
kiszk Jul 20, 2017
70042d5
fix test faiures
kiszk Jul 21, 2017
d16779f
address review comment
kiszk Jul 21, 2017
ff324fd
addressed review comments
kiszk Jul 21, 2017
157fde1
add initialize() method for reusing CachedBatchColumnVector
kiszk Aug 1, 2017
a26dc15
make initialize public
kiszk Aug 6, 2017
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
make initialize public
  • Loading branch information
@kiszk
kiszk committed Aug 7, 2017
commit a26dc150f6b95cc42558561cd2548de04a89f041
2 changes: 1 addition & 1 deletion ...core/src/main/java/org/apache/spark/sql/execution/vectorized/CachedBatchColumnVector.java
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -236,7 +236,7 @@ public final UTF8String getUTF8String(int rowId) {
return unsafeRow.getUTF8String(ORDINAL);
}

void initialize() {
public void initialize() {
ByteBuffer byteBuffer = ByteBuffer.wrap(buffer);
columnAccessor = ColumnAccessor$.MODULE$.apply(type, byteBuffer);
previousRowId = -1;
Expand Down