Node down when number of workers are increased.

[shireenabraham]

When given this ini file the test suite executes correctly
[pytest]
addopts = -n 5 --dist load --boxed --timeout=90 -v --durations=32 --lf
norecursedirs = ui zetc gracefulShutdown

gw0 = dialplan conf/AgentLogin
gw1 = conf/DN
gw2 = dm/AdvancedSearch dm/Bulk dm/CME dm/IVR dm/Profile
gw3 = voicemail conf/AgentGroup conf/System monitoring tserv
gw4 = conf/Person conf/Place dm/Device dm/Features dm/FirmwareUpgrade

When number of workers are increased to 9. The test suite fails

[pytest]
addopts = -n 9 --dist load --boxed --timeout=90 -v --durations=32 --lf
norecursedirs = ui zetc gracefulShutdown

gw0 = dialplan monitoring
gw1 = voicemail dm/Profile
gw2 = conf/AgentLogin dm/Device
gw3 = conf/DN dm/Bulk
gw4 = conf/Person dm/CME
gw5 = conf/Place dm/Features
gw6 = conf/AgentGroup dm/IVR
gw7 = conf/System dm/FirmwareUpgrade
gw8 = dm/AdvancedSearch tserv

it fails with the following error

[gw8] node down: Traceback (most recent call last):
File "/var/lib/jenkins/jobs/fs-integration-test-standalone/workspace/env27/lib/python2.7/site-packages/execnet/gateway_base.py", line 816, in _local_receive
callback(data) # even if channel may be already closed
File "/var/lib/jenkins/jobs/fs-integration-test-standalone/workspace/env27/src/pytest-xdist/xdist/slavemanage.py", line 316, in process_from_remote
self.config.pluginmanager.notify_exception(excinfo)
AttributeError: 'PytestPluginManager' object has no attribute 'notify_exception'

I have searched but couldn't find the possible reasons for the error.

[nicoddemus]

Hi @shireenabraham

Which version are you using? Your traceback says:

File ".../pytest-xdist/xdist/slavemanage.py", line 316, in process_from_remote
  self.config.pluginmanager.notify_exception(excinfo)
AttributeError: 'PytestPluginManager' object has no attribute 'notify_exception'

But slavemanage.py:316 currently contains this code:

pytest-xdist/xdist/slavemanage.py

Lines 316 to 318 in 5889e4c

	elif eventname == "collectionfinish":
	self.notify_inproc(eventname, node=self, ids=kwargs['ids'])
	elif eventname == "runtest_protocol_complete":

And what does this mean?

gw0 = dialplan monitoring
gw1 = voicemail dm/Profile
gw2 = conf/AgentLogin dm/Device
gw3 = conf/DN dm/Bulk
gw4 = conf/Person dm/CME
gw5 = conf/Place dm/Features
gw6 = conf/AgentGroup dm/IVR
gw7 = conf/System dm/FirmwareUpgrade
gw8 = dm/AdvancedSearch tserv

[nicoddemus]

Hmm your code seems to be using the code changed by this commit: 64f8ad5, which was included in 1.18.2. That was a tricky one because it would actually hide the original error. I suggest to update pytest-xdist to see if you get a different behavior.

[shireenabraham]

gw0 = dialplan monitoring
gw1 = voicemail dm/Profile
gw2 = conf/AgentLogin dm/Device
gw3 = conf/DN dm/Bulk
gw4 = conf/Person dm/CME
gw5 = conf/Place dm/Features
gw6 = conf/AgentGroup dm/IVR
gw7 = conf/System dm/FirmwareUpgrade
gw8 = dm/AdvancedSearch tserv
The above are test cases I have distributed among the workers. I have done this to reduce the execution time. How do I check the version of pytest-xdist ?

[RonnyPfannschmidt]

pytest outputs the version at the start of a test run, and you can let pip list the versions of packages

[shireenabraham]

pytest-2.5.2 is the version used. The pytest executes when I use 8 workers, but fails when I use 9 or more