Skip to content

Cog 505 data dataset model changes #260

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
dexters1 merged 14 commits into from
Dec 6, 2024
Merged

Cog 505 data dataset model changes #260

Changes from 1 commit
Commits
Show all changes
14 commits
Select commit Hold shift + click to select a range
6bb0f3d
feat: Add ability to store single data instance in multiple datasets
dexters1 Dec 4, 2024
0ce254b
feat: Add text deduplication
dexters1 Dec 4, 2024
f5b5e56
feat: Add deduplication of data
dexters1 Dec 5, 2024
378e7b8
fix: Fix merge of data for dlt
dexters1 Dec 5, 2024
349ddfe
Merge branch 'main' into COG-505-data-dataset-model-changes
dexters1 Dec 5, 2024
813b76c
test: Add test for text deduplication
dexters1 Dec 5, 2024
387002d
Merge branch 'COG-505-data-dataset-model-changes' of github.com:topot…
dexters1 Dec 5, 2024
add6730
test: Add testing of dataset data table content
dexters1 Dec 5, 2024
9ba5d49
test: Fix test for multimedia deduplication
dexters1 Dec 5, 2024
e80377b
refactor: Move hash calculation of file to util
dexters1 Dec 5, 2024
1e098ae
refactor: Add error handling to hash util
dexters1 Dec 5, 2024
9429e5e
Merge branch 'main' into COG-505-data-dataset-model-changes
borisarzentar Dec 6, 2024
cc6fbe2
refactor: Add space to ingest function
dexters1 Dec 6, 2024
d7fa9f3
Merge branch 'COG-505-data-dataset-model-changes' of github.com:topot…
dexters1 Dec 6, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Merge branch 'main' into COG-505-data-dataset-model-changes
  • Loading branch information
@dexters1
dexters1 authored Dec 5, 2024
commit 349ddfe794225d0568ec369678ccc9d0de907eca

This merge commit was added into this branch cleanly.

There are no new changes to show, but you can still view the diff.