Skip to content

[WIP] Allow hadd to run in multiprocess mode #491

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
dpiparo merged 7 commits into from
Apr 26, 2017
Merged

[WIP] Allow hadd to run in multiprocess mode #491

Changes from 1 commit
Commits
Show all changes
7 commits
Select commit Hold shift + click to select a range
4e8c226
Allow hadd to run in multiprocess
xvallspl Apr 9, 2017
3235a7f
Apply clang-format to hadd
xvallspl Apr 9, 2017
7cd817a
Fix typo in help (hadd)
xvallspl Apr 9, 2017
e2f5058
Resolves naming conflicts in partial files in hadd
xvallspl Apr 11, 2017
b9b1d3f
Add debug option for parallel hadd.
xvallspl Apr 11, 2017
ef34f13
Allow user to specify temp dir.
xvallspl Apr 11, 2017
a7d49fa
Check step size only when multiprocess
xvallspl Apr 18, 2017
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Resolves naming conflicts in partial files in hadd 
Appends the same unique identifier to the name of the partial files
within the same hadd execution.
  • Loading branch information
@xvallspl
xvallspl committed Apr 11, 2017
commit e2f5058aebe3b158bbf46306a28de3c3658f6f08
5 changes: 4 additions & 1 deletion main/src/hadd.cxx
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -79,6 +79,7 @@
#include "Riostream.h"
#include "TClass.h"
#include "TSystem.h"
#include "TUUID.h"
#include "ROOT/StringConv.hxx"
#include <stdlib.h>
#include <climits>
Expand Down Expand Up @@ -405,9 +406,11 @@ int main( int argc, char **argv )
std::vector<std::string> partialFiles;

if (multiproc) {
auto uuid = TUUID();
auto partialTail = uuid.AsString();
for (auto i = 0; (i * step) < filesToProcess; i++) {
std::stringstream buffer;
buffer << "partial" << i << ".root";
buffer << "partial" << i << "_" << partialTail << ".root";
partialFiles.emplace_back(buffer.str());
}
}
Expand Down