Skip to content

[SPARK-21070][PYSPARK] Attempt to update cloudpickle again #18734

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
holdenk wants to merge 11 commits into from
Closed

[SPARK-21070][PYSPARK] Attempt to update cloudpickle again #18734

Changes from 1 commit
Commits
Show all changes
11 commits
Select commit Hold shift + click to select a range
b84222b
[SPARK-21070][PYSPARK] Upgrade cloudpickle
rgbkrk Jun 12, 2017
6d5e5cf
Merge branch 'master' into holden-rgbkrk-cloudpickle-upgrades
holdenk Jul 24, 2017
1cfd38f
Copy over support work weakset, dynamic classess, and remove __transi…
holdenk Jul 24, 2017
f8ff2da
Test fix
holdenk Jul 25, 2017
cff6bfb
Revert "Copy over support work weakset, dynamic classess, and remove …
holdenk Jul 25, 2017
195cd21
Fixed named tuple issue
holdenk Jul 25, 2017
74880ea
Try and move the fix for namedtuple and re-enable the rest of the use…
holdenk Jul 25, 2017
9a0f9b4
Re-enable our custom exception message
holdenk Jul 25, 2017
09cf41e
Save and restore the module info functions
holdenk Jul 25, 2017
7ad278a
six importing work around restore
holdenk Aug 18, 2017
f986c25
Restore the six work around and update the hasattry check for package.
holdenk Aug 18, 2017
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Next Next commit
[SPARK-21070][PYSPARK] Upgrade cloudpickle 
This brings in fixes and upgrades from the [cloudpickle](https://github.com/cloudpipe/cloudpickle) module, notably:

* Import submodules accessed by pickled functions (cloudpipe/cloudpickle#80)
* Support recursive functions inside closures (cloudpipe/cloudpickle#89, cloudpipe/cloudpickle#90)
* Fix ResourceWarnings and DeprecationWarnings (cloudpipe/cloudpickle#88)
* Assume modules with __file__ attribute are not dynamic (cloudpipe/cloudpickle#85)
* Make cloudpickle Python 3.6 compatible (cloudpipe/cloudpickle#72)
* Allow pickling of builtin methods (cloudpipe/cloudpickle#57)
* Add ability to pickle dynamically created modules (cloudpipe/cloudpickle#52)
* Support method descriptor (cloudpipe/cloudpickle#46)
* No more pickling of closed files, was broken on Python 3 (cloudpipe/cloudpickle#32)
  • Loading branch information
@rgbkrk
rgbkrk committed Jun 12, 2017
commit b84222b6ea660ce5ec1aedfee50e297b436eb824
Loading