Skip to content

[SPARK-21045][PYTHON] Allow non-ascii string as an exception message from python execution in Python 2 #25847

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
advancedxy wants to merge 7 commits into from
Closed

[SPARK-21045][PYTHON] Allow non-ascii string as an exception message from python execution in Python 2 #25847

Changes from 1 commit
Commits
Show all changes
7 commits
Select commit Hold shift + click to select a range
90559c0
[SPARK-21045][PYSPARK] Defensive check for exception info thrown by u…
advancedxy Sep 19, 2019
fb72447
remove ExecThread and rdd operations happens in main thread.
advancedxy Sep 19, 2019
ff7f248
remove unused import
advancedxy Sep 19, 2019
42a9eb0
revert change.
advancedxy Sep 19, 2019
0652966
revert change and define unicode for python3
advancedxy Sep 19, 2019
ffb4d29
make lint-python happy for python3
advancedxy Sep 19, 2019
d6ec7ae
Address comments.
advancedxy Sep 20, 2019
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
revert change.
  • Loading branch information
@advancedxy
advancedxy committed Sep 19, 2019
commit 42a9eb0caed3b3b693938dc6fb3480cbd1462998
2 changes: 1 addition & 1 deletion python/pyspark/worker.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -44,7 +44,7 @@
from pyspark.util import _get_argspec, fail_on_stopiteration
from pyspark import shuffle

if sys.version_info.major >= 3:
if sys.version >= '3':
basestring = str
else:
from itertools import imap as map # use iterator map by default
Expand Down