Skip to content

feat: Add better roundtrip support #142

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
kodiakhq merged 8 commits into from
Nov 27, 2023
Merged

feat: Add better roundtrip support #142

Changes from 1 commit
Commits
Show all changes
8 commits
Select commit Hold shift + click to select a range
ed4e7e3
fix: Helpers for `org.apache.arrow.vector` types
candiduslynx Nov 27, 2023
76d67db
add uuidtype.instance
candiduslynx Nov 27, 2023
ef4e724
add decimal helpers
candiduslynx Nov 27, 2023
5722945
tests init
candiduslynx Nov 27, 2023
2c8cab8
fix `io.cloudquery.helper.ArrowHelperTest.testRoundTripTableEncoding`
candiduslynx Nov 27, 2023
af2dfbe
fix tests
candiduslynx Nov 27, 2023
61f3df7
Merge branch 'main' into fix/date-types-support
candiduslynx Nov 27, 2023
66f5e53
./gradlew :lib:spotlessApply
candiduslynx Nov 27, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
add decimal helpers
  • Loading branch information
@candiduslynx
candiduslynx committed Nov 27, 2023
commit ef4e7248163c4e51434c35e82c4fccd8a4d40f16
18 changes: 14 additions & 4 deletions lib/src/main/java/io/cloudquery/helper/ArrowHelper.java
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -58,6 +58,14 @@ private static void setVectorData(FieldVector vector, Object data) {
dateMilliVector.set(0, (long) data);
return;
}
if (vector instanceof Decimal256Vector decimal256Vector) {
decimal256Vector.set(0, (java.math.BigDecimal) data);
return;
}
if (vector instanceof DecimalVector decimalVector) {
decimalVector.set(0, (java.math.BigDecimal) data);
return;
}
if (vector instanceof DurationVector durationVector) {
durationVector.set(0, (long) data);
return;
Expand Down Expand Up @@ -138,14 +146,16 @@ private static void setVectorData(FieldVector vector, Object data) {
vectorCharVector.set(0, (Text) data);
return;
}
if (vector instanceof UUIDVector uuidVector) {
uuidVector.set(0, (java.util.UUID) data);
return;
}
// CloudQuery-specific
if (vector instanceof JSONVector jsonVector) {
jsonVector.setSafe(0, (byte[]) data);
return;
}
// CloudQuery-specific
if (vector instanceof UUIDVector uuidVector) {
uuidVector.set(0, (java.util.UUID) data);
return;
}

throw new IllegalArgumentException("Unsupported vector type: " + vector.getClass());
}
Expand Down