Skip to content

[SPARK-23120][PYSPARK][ML] Add basic PMML export support to PySpark #21172

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
holdenk wants to merge 5 commits into from
Closed

[SPARK-23120][PYSPARK][ML] Add basic PMML export support to PySpark #21172

Changes from 1 commit
Commits
Show all changes
5 commits
Select commit Hold shift + click to select a range
8cbef82
Add basic PMML export support to PySpark ML pipeline elements with Li…
holdenk Apr 26, 2018
64d6db8
Add unit test
holdenk Apr 26, 2018
af21aa7
Update tests to use assertIn rather than assertTrue with in so we can…
holdenk May 4, 2018
9d7d684
Fix creation of pmml_text
holdenk May 4, 2018
67b59a7
I don't know why I was checking for xs:element we really should have …
holdenk May 11, 2018
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Fix creation of pmml_text
  • Loading branch information
@holdenk
holdenk committed May 4, 2018
commit 9d7d684d3151d7904e5b868b1fc9b05aa43f8fea
3 changes: 2 additions & 1 deletion python/pyspark/ml/tests.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -1367,7 +1367,8 @@ def test_linear_regression_pmml_basic(self):
path = tempfile.mkdtemp()
lr_path = path + "/lr-pmml"
model.write().format("pmml").save(lr_path)
pmml_text = self.sc.textFile(lr_path).collect()
pmml_text_list = self.sc.textFile(lr_path).collect()
pmml_text = "\n".join(pmml_text_list)
self.assertIn("Apache Spark", pmml_text)
self.assertIn("xs:element", pmml_text)

Expand Down