Skip to content

Commit b154623

Browse files
committed
[MINOR][TESTS] Always remove spark.master in ReusedConnectTestCase
### What changes were proposed in this pull request? This PR proposes to always remove `spark.master` in `ReusedConnectTestCase`. ### Why are the changes needed? More just for sanity. The tests should only run with `spark.remote` ### Does this PR introduce _any_ user-facing change? No, test-only ### How was this patch tested? Fixed unittest ### Was this patch authored or co-authored using generative AI tooling? No. Closes #47113 from HyukjinKwon/minor-test-test. Authored-by: Hyukjin Kwon <[email protected]> Signed-off-by: Hyukjin Kwon <[email protected]>
1 parent 2e31572 commit b154623

File tree

1 file changed

+2
-0
lines changed

1 file changed

+2
-0
lines changed

python/pyspark/testing/connectutils.py

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -177,6 +177,8 @@ def conf(cls):
177177
conf = SparkConf(loadDefaults=False)
178178
# Make the server terminate reattachable streams every 1 second and 123 bytes,
179179
# to make the tests exercise reattach.
180+
if conf._jconf is not None:
181+
conf._jconf.remove("spark.master")
180182
conf.set("spark.connect.execute.reattachable.senderMaxStreamDuration", "1s")
181183
conf.set("spark.connect.execute.reattachable.senderMaxStreamSize", "123")
182184
return conf

0 commit comments

Comments
 (0)