[SPARK-12582][Test] IndexShuffleBlockResolverSuite fails in windows

[yucai]

[SPARK-12582][Test] IndexShuffleBlockResolverSuite fails in windows

• IndexShuffleBlockResolverSuite fails in windows due to file is not closed.
• mv IndexShuffleBlockResolverSuite.scala from "test/java" to "test/scala".

https://issues.apache.org/jira/browse/SPARK-12582

[chenghao-intel]

LGTM @andrewor14

[andrewor14]

Looks good, but maybe we should close the stream in a finally block.
ok to test

[srowen]

@yucai can you update accordingly?

[yucai]

Sure, I will update the codes.

[JoshRosen]

Ping again; should be quick to update then we can merge.

[andrewor14]

Jenkins, this is ok to test?

[SparkQA]

Test build #48801 has finished for PR 10526 at commit 11b97d5.

• This patch fails from timeout after a configured wait of 250m.
• This patch merges cleanly.
• This patch adds the following public classes (experimental):
  • class IndexShuffleBlockResolverSuite extends SparkFunSuite with BeforeAndAfterEach

[SparkQA]

Test build #2352 has finished for PR 10526 at commit 11b97d5.

• This patch passes all tests.
• This patch merges cleanly.
• This patch adds the following public classes (experimental):
  • class IndexShuffleBlockResolverSuite extends SparkFunSuite with BeforeAndAfterEach

[srowen]

@yucai should we take this over, in which case you can close this PR, or do you intend to update it?

[yucai]

Sorry, I miss the conversation! I will update it right now.

[SparkQA]

Test build #49088 has finished for PR 10526 at commit fb9cb7d.

• This patch fails Scala style tests.
• This patch merges cleanly.
• This patch adds no public classes.

[yucai]

Jenkins, retest this please.

[JoshRosen]

Jenkins, retest this please.

[SparkQA]

Test build #49098 has finished for PR 10526 at commit 174b40f.

• This patch fails from timeout after a configured wait of 250m.
• This patch merges cleanly.
• This patch adds no public classes.

[SparkQA]

Test build #49121 has finished for PR 10526 at commit 174b40f.

• This patch fails PySpark unit tests.
• This patch merges cleanly.
• This patch adds no public classes.

[SparkQA]

Test build #2362 has finished for PR 10526 at commit 174b40f.

• This patch fails PySpark unit tests.
• This patch merges cleanly.
• This patch adds no public classes.

[andrewor14]

retest this please

[SparkQA]

Test build #49173 has finished for PR 10526 at commit 174b40f.

• This patch fails Spark unit tests.
• This patch merges cleanly.
• This patch adds no public classes.

[JoshRosen]

Looks like a known-flaky streaming test.

[yucai]

One failure is about flaky streaming test. I retest InputStreamsSuite locally, no failure.

[info] - socket input stream *** FAILED *** (3 seconds, 978 milliseconds)
[info]   4 did not equal 5 (InputStreamsSuite.scala:83)
[info]   org.scalatest.exceptions.TestFailedException:
[info]   at org.scalatest.Assertions$class.newAssertionFailedException(Assertions.scala:500)
[info]   at org.scalatest.FunSuite.newAssertionFailedException(FunSuite.scala:1555)
[info]   at org.scalatest.Assertions$AssertionsHelper.macroAssert(Assertions.scala:466)

Another failure looks like some test fail to launch? Like below:

[error] Error: Total 0, Failed 0, Errors 0, Passed 0
[error] Error during tests:
[error]     Running java with options -classpath /home/jenkins/workspace/SparkPullRequestBuilder/core/target/scala-2.10/test-classes:/home/jenkins/workspace/SparkPullRequestBuilder/core/target/scala-2.10/classes:/home/jenkins/workspace/SparkPullRequestBuilder/launcher/target/scala-2.10/classes:/home/jenkins/workspace/SparkPullRequestBuilder/network/common/target/scala-2.10/classes:/home/jenkins/workspace/SparkPullRequestBuilder/network/shuffle/target/scala-

How about retest this?

[yucai]

@JoshRosen @andrewor14 could you kindly help retest?

[JoshRosen]

Jenkins, retest this please.

[SparkQA]

Test build #49210 has finished for PR 10526 at commit 174b40f.

• This patch passes all tests.
• This patch merges cleanly.
• This patch adds no public classes.

[srowen]

Merged to master/1.6