Skip to content

[SPARK-1170] Add histogram method to Python's RDD API #1783

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
nrchandan wants to merge 7 commits into from
Closed

[SPARK-1170] Add histogram method to Python's RDD API #1783

Changes from 1 commit
Commits
Show all changes
7 commits
Select commit Hold shift + click to select a range
aecb5bc
added histogram method, added max and min to statscounter
dwmclary Mar 11, 2014
0c2bbdd
SPARK-1170 Added histogram(buckets) to pyspark and not histogram(noOf…
ScrapCodes Mar 11, 2014
8427db6
SPARK-1170. Merged commits and fixed bugs in both the original commits
Aug 5, 2014
bdd3d7a
SPARK-1170. Merged commits and fixed bugs in both the original commits
Aug 5, 2014
7fe070a
SPARK-1170. Fix a test case.
Aug 5, 2014
7b522d5
[SPARK-1170] Remove unnecessary rounding
Aug 5, 2014
c8dd625
SPARK-1170. Fix a typo in doc comment.
Aug 5, 2014
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
[SPARK-1170] Remove unnecessary rounding
  • Loading branch information
Chandan Kumar committed Aug 5, 2014
commit 7b522d5ab9150a1b2da34031003749f2f6adc09a
2 changes: 1 addition & 1 deletion python/pyspark/rdd.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -952,7 +952,7 @@ def getBuckets():
max = mm_stats.max()
increment = (max - min) * 1.0 / bucketCount
if increment != 0:
Copy link
Contributor

@davies davies Aug 5, 2014

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

if increment:

buckets = [round(min+x*increment, 2) for x in range(bucketCount+1)]
buckets = [min+x*increment for x in range(bucketCount+1)]
Copy link
Contributor

@davies davies Aug 5, 2014

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The last one is buckets should be max.

else:
buckets = [min, max]
return buckets
Expand Down