Skip to content

Conversation

@hardbyte
Copy link
Collaborator

This modifies the cli client to retrieve object store credentials during upload.

For testing purposes it uploads the data twice - once to the existing api, and once to the object store.

Copy link
Contributor

@joyceyuu joyceyuu left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Look good overall. If you can answer my few questions, I am happy to approve it

out = combine_clks_blocks(clk_json, blocks)
with open(clk_json, 'rb') as encodings:
out = combine_clks_blocks(encodings, blocks)
response = rest_client.project_upload_clks(project, apikey, out)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why we don't upload to minio as well like the no blocking case?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

In the initial plan we will only support binary encodings being uploaded to the object store. Eventually a binary format for the blocks will also be implemented.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Okay

Copy link
Contributor

@joyceyuu joyceyuu left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Look good to me. Just few tests are currently failing. Maybe merge into master after fixing the tests

@joyceyuu joyceyuu marked this pull request as ready for review April 29, 2020 00:59
@codecov
Copy link

codecov bot commented Apr 29, 2020

Codecov Report

Merging #46 into master will increase coverage by 3.22%.
The diff coverage is 91.89%.

@@            Coverage Diff             @@
##           master      #46      +/-   ##
==========================================
+ Coverage   91.44%   94.67%   +3.22%     
==========================================
  Files           3        3              
  Lines         456      488      +32     
==========================================
+ Hits          417      462      +45     
+ Misses         39       26      -13     

@joyceyuu joyceyuu merged commit 7c11953 into master May 14, 2020
@joyceyuu joyceyuu deleted the fetch-object-store-auth branch May 14, 2020 09:29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants