Skip to content

Spmi replay pipeline #56871

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
66 commits merged into from
Aug 11, 2021
Merged

Spmi replay pipeline #56871

Changes from 1 commit
Commits
Show all changes
66 commits
Select commit Hold shift + click to select a range
9c1284e
Add superpmi-replay pipeline file
kunalspathak Jul 28, 2021
60b44b4
Add superpmi-replay-job.yml that downloads collection
kunalspathak Jul 28, 2021
1919da8
Moved superpmi-replay-job to right location
kunalspathak Jul 28, 2021
f85e072
make sure to have spmi collection after jit build
kunalspathak Jul 28, 2021
224adcd
annotate displayName with windows/OSX
kunalspathak Jul 28, 2021
33072e3
Make osGroup=windows
kunalspathak Jul 29, 2021
207ce41
Add helixType (if that matters)
kunalspathak Jul 29, 2021
84e3dfe
Add some more variables
kunalspathak Jul 29, 2021
2b232d0
skip restore internal tools
kunalspathak Jul 29, 2021
971d198
Just use build-jit-job directly
kunalspathak Jul 29, 2021
bc571f9
Hardcode windows.x64.checked
kunalspathak Jul 29, 2021
f7f77ae
Add -download_all -download_raw options to superpmi.py
kunalspathak Jul 29, 2021
a7bdc5d
Seperate 2 jobs
kunalspathak Jul 29, 2021
fabab8a
Fix Upload artifacts
kunalspathak Jul 29, 2021
9f8a0ba
Fix uploadAsArtifacts
kunalspathak Jul 29, 2021
08650f6
Fix to uploadAsArtifacts
kunalspathak Jul 29, 2021
d14111f
comment upload to azure storage temporarily
kunalspathak Jul 29, 2021
a3916fe
Set variables inside superpmi-replay-job
kunalspathak Jul 29, 2021
fcd9855
Entire pipeline
kunalspathak Jul 30, 2021
dd12070
minor fix
kunalspathak Jul 30, 2021
b136c9d
Add some logging
kunalspathak Jul 30, 2021
333927e
Fix the path
kunalspathak Jul 30, 2021
c8f75f5
fix file names and partition ids
kunalspathak Aug 2, 2021
4ed4cc0
add sample download on helix machine
kunalspathak Aug 2, 2021
f0a9ae8
fix helix-correlation-payload
kunalspathak Aug 2, 2021
4da534d
Download specific build
kunalspathak Aug 2, 2021
9cb6da8
Try to fix correlation payload directory
kunalspathak Aug 2, 2021
12287f6
Do not run windows x86 for now
kunalspathak Aug 2, 2021
c901a70
Log directory
kunalspathak Aug 2, 2021
8dda3f1
walktree instead of dir
kunalspathak Aug 2, 2021
af25275
fix the bug
kunalspathak Aug 2, 2021
2fc1495
Add workitem directory as Payload
kunalspathak Aug 2, 2021
60c86e5
TEMP: Skip downloading collection during setup
kunalspathak Aug 3, 2021
3ec4a84
fix core_root
kunalspathak Aug 3, 2021
966a530
Make download happen on helix
kunalspathak Aug 3, 2021
494e7ab
Add windows x86
kunalspathak Aug 3, 2021
e7ab499
Use -target_os and pass 1 item to helix
kunalspathak Aug 3, 2021
eea085f
Add some logging, have different work item ID
kunalspathak Aug 3, 2021
283f211
fix the superpmi.log upload
kunalspathak Aug 3, 2021
f1e914b
Fix the log location
kunalspathak Aug 3, 2021
92e3d55
one more fix to log_directory
kunalspathak Aug 3, 2021
93edb83
try to fix download results
kunalspathak Aug 3, 2021
20db184
Move the matrix to proj file
kunalspathak Aug 3, 2021
bcc6c36
fix superpmi-replay.proj
kunalspathak Aug 3, 2021
8b50c09
Cleanup
kunalspathak Aug 3, 2021
e35562e
Go back to download specific
kunalspathak Aug 4, 2021
7033211
WorkTimeout for 5 hours
kunalspathak Aug 4, 2021
4edf41d
Remove timeoutInMinutes
kunalspathak Aug 4, 2021
244693f
fix errors related to logging
kunalspathak Aug 4, 2021
9794f4c
return failed run result
kunalspathak Aug 4, 2021
dc5ca48
fix the appending logic
kunalspathak Aug 4, 2021
b9ba241
Remove download-all and download-raw and instead add -no-progres
kunalspathak Aug 4, 2021
4d97688
do not show download progress, try fixing download file
kunalspathak Aug 4, 2021
53eb396
TO REVERT: Just try benchmark on windows x64/x86
kunalspathak Aug 4, 2021
0c12c61
Use uploadAsArtifacts in build-jit-job
kunalspathak Aug 4, 2021
4a48c37
Create dummy.txt in workitem directory
kunalspathak Aug 4, 2021
1c14146
create workitem_directory
kunalspathak Aug 5, 2021
8fbcace
Build clrjit
kunalspathak Aug 5, 2021
5a3168d
fix build-jit-job
kunalspathak Aug 5, 2021
f796b6a
add dependsOn
kunalspathak Aug 5, 2021
deeb625
print params
kunalspathak Aug 5, 2021
faa8294
TO REVERT: Just run jitbuild win-x64
kunalspathak Aug 5, 2021
7c73aa6
minor
kunalspathak Aug 5, 2021
b06725f
move under jobParameters
kunalspathak Aug 5, 2021
a729794
Cleanup
kunalspathak Aug 5, 2021
c8dc88a
review feedback
kunalspathak Aug 11, 2021
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
fix the superpmi.log upload
  • Loading branch information
@kunalspathak
kunalspathak committed Aug 11, 2021
commit 283f211e898ec92906970e1ec5a401b314b3e025
2 changes: 2 additions & 0 deletions src/coreclr/scripts/superpmi-replay.proj
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -30,6 +30,8 @@
<ProductDirectory>%HELIX_CORRELATION_PAYLOAD%</ProductDirectory>
<SpmiCollectionFolder>$(WorkItemDirectory)\partitions</SpmiCollectionFolder>
<SuperpmiLogsLocation>%HELIX_WORKITEM_UPLOAD_ROOT%</SuperpmiLogsLocation>
<!-- Workaround until https://github.com/dotnet/arcade/pull/6179 is not available -->
<HelixResultsDestinationDir>$(BUILD_SOURCESDIRECTORY)\artifacts\helixresults</HelixResultsDestinationDir>
<WorkItemCommand>$(Python) $(ProductDirectory)\superpmi-replay.py -arch $(Architecture) -platform $(Platform) -log_directory $(SuperpmiLogsLocation) -jit_directory $(ProductDirectory)</WorkItemCommand>
</PropertyGroup>

Expand Down