MongoDB | 2261123

Info

sharding_multiversion on enterprise-rhel-80-64-bit-dynamic-all-feature-flags-required Host: i-0c7e98c0b663bda19, i-0084a64c3946e3f70, i-06dd8f12eb6c0ca66, i-0545a5d4d498da924, i-0894f14a3ad3b860a, i-0500c1ae1f5eb950e, i-02d8e607d7e46e7fd, i-002291f4ecbcdd49e, i-0d66d45909dfb07fd, i-0084f07f52c0fcf84 Project: mongodb-mongo-master Commit: 1049af0c Failing Test Logs:

Top User Comments

sviatlana.zuiko commented on Fri, 10 Feb 2023 22:24:20 +0000: [2023/02/10 17:54:48.720] Hit exec timeout (1h20m0s). The hang analyzer started attaching processes at 16:58:02 and was disrupted at 17:54:48 when task timeout commands started killing processes. There were 6 mongod processes, 1 configsvr and 1 mongod in the test. [js_test:retryable_writes_committed_during_resharding] assert.soon failed (timeout 600000ms), msg : Timed out waiting for failpoint to be hit. Failpoint: reshardingPauseCoordinatorBeforeBlockingWrites The hang analyzer is automatically called in assert.soon functions. If you are *expecting* assert.soon to possibly fail, call assert.soon with {runHangAnalyzer: false} as the fifth argument (you can fill unused arguments with `undefined`). Running hang analyzer from assert.soon. [js_test:retryable_writes_committed_during_resharding] Running hang analyzer for pids [16099,16103,16097,16110,17934,16101,16095,16093] [js_test:retryable_writes_committed_during_resharding] | 2023-02-10T16:58:02.360Z I - 22810 [js] "shell: Started program","attr":{"pid":"2923","port":-1,"argv":["/data/mci/92dcc8f355c8c5092ea0e80d15e41a97/venv/bin/python","./buildscripts/resmoke.py","hang-analyzer","-k","-o","file","-o","stdout","-d","16099,16103,16097,16110,17934,16101,16095,16093","-t","mongodb_mongo_master_enterprise_rhel_80_64_bit_dynamic_all_feature_flags_required_sharding_last_lts_0_linux_enterprise_1049af0cf89571f65cf9a22dfe75119b9059d785_23_02_09_19_51_19","-c"]} The hang analyzer was unable attach to eight (8) MongoDB processes in 1 hour that caused the execution timeout xgen-buildbaron-user commented on Fri, 10 Feb 2023 22:17:11 +0000: Assert Soon Failure Logs: assert.soon failed (timeout 600000ms), msg : Timed out waiting for failpoint to be hit. Failpoint: reshardingPauseCoordinatorBeforeBlockingWrites The hang analyzer is automatically called in assert.soon functions. If you are *expecting* assert.soon to possibly fail, call assert.soon with {runHangAnalyzer: false} as the fifth argument (you can fill unused arguments with `undefined`). Running hang analyzer from assert.soon. Running hang analyzer for pids [20357,20360,25114,20362,20379,20366] logs Repro Artifacts: Resmoke.py Invocation for Local Usage We stopped analyzing the logs. More tests than threshold. xgen-buildbaron-user commented on Fri, 10 Feb 2023 22:17:09 +0000: Hang Analyzer Extractor Logs: Running Print JavaScript Stack Supplement Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack logs Hang Analyzer Extractor Logs: Running Print JavaScript Stack Supplement Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack logs Hang Analyzer Extractor Logs: Running Print JavaScript Stack Supplement Traceback (most recent call last): File "buildscripts/gdb/mongo.py", line 879, in invoke main_binary_name = get_process_name() File "buildscripts/gdb/mongo.py", line 137, in get_process_name main_binary_name = gdb.objfiles()[0].filename IndexError: list index out of range Error occurred in Python: list index out of range Traceback (most recent call last): File "buildscripts/gdb/mongo.py", line 400, in invoke session_catalog = get_session_catalog() File "buildscripts/gdb/mongo.py", line 186, in get_session_catalog logs Hang Analyzer Extractor Logs: Running Print JavaScript Stack Supplement Traceback (most recent call last): File "buildscripts/gdb/mongo.py", line 879, in invoke main_binary_name = get_process_name() File "buildscripts/gdb/mongo.py", line 137, in get_process_name main_binary_name = gdb.objfiles()[0].filename IndexError: list index out of range Error occurred in Python: list index out of range Traceback (most recent call last): File "buildscripts/gdb/mongo.py", line 400, in invoke session_catalog = get_session_catalog() File "buildscripts/gdb/mongo.py", line 186, in get_session_catalog logs Agent Log Assertion Extractor Logs: Hit exec timeout (1h20m0s). logs pTrace Operation error Logs: ptrace: Operation not permitted. logs pTrace Operation error Logs: Traceback (most recent call last): File "/data/mci/c01101c027cff22751b8dc0289de251e/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 210, in _run_single_copy test_case.run_test() File "/data/mci/c01101c027cff22751b8dc0289de251e/src/buildscripts/resmokelib/testing/testcases/interface.py", line 137, in run_test self._execute(proc) File "/data/mci/c01101c027cff22751b8dc0289de251e/src/buildscripts/resmokelib/testing/testcases/interface.py", line 158, in _execute raise self.failureException("%s failed" % (self.short_description())) AssertionError: JSTest jstests/sharding/resharding_replicate_updates_as_insert_delete.js failed Traceback (most recent call last): File "/data/mci/c01101c027cff22751b8dc0289de251e/src/buildscripts/resmokelib/testing/job.py", line 83, in __call__ self._run(queue, interrupt_flag, teardown_flag, hook_failure_flag) File "/data/mci/c01101c027cff22751b8dc0289de251e/src/buildscripts/resmokelib/testing/job.py", line 129, in _run self._execute_test(test, hook_failure_flag) File "/data/mci/c01101c027cff22751b8dc0289de251e/src/buildscripts/resmokelib/testing/job.py", line 175, in _execute_test raise test.propagate_error File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 59, in testPartExecutor yield File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 591, in run self._callTestMethod(testMethod) File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 549, in _callTestMethod method() File "/data/mci/c01101c027cff22751b8dc0289de251e/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 259, in run_test self._run_single_copy() File "/data/mci/c01101c027cff22751b8dc0289de251e/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 214, in _run_single_copy self._raise_if_unsafe_exit(self.return_code) File "/data/mci/c01101c027cff22751b8dc0289de251e/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 277, in _raise_if_unsafe_exit raise self.propagate_error # pylint: disable=raising-bad-type buildscripts.resmokelib.errors.UnsafeExitError: Mongo shell exited with code -9 while running jstest resharding_replicate_updates_as_insert_delete.js. Further test execution may be unsafe. Traceback (most recent call last): File "/data/mci/c01101c027cff22751b8dc0289de251e/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 210, in _run_single_copy test_case.run_test() File "/data/mci/c01101c027cff22751b8dc0289de251e/src/buildscripts/resmokelib/testing/testcases/interface.py", line 137, in run_test self._execute(proc) File "/data/mci/c01101c027cff22751b8dc0289de251e/src/buildscripts/resmokelib/testing/testcases/interface.py", line 158, in _execute raise self.failureException("%s failed" % (self.short_description())) AssertionError: JSTest jstests/sharding/resharding_replicate_updates_as_insert_delete.js failed Traceback (most recent call last): File "/data/mci/c01101c027cff22751b8dc0289de251e/src/buildscripts/resmokelib/testing/job.py", line 83, in __call__ self._run(queue, interrupt_flag, teardown_flag, hook_failure_flag) File "/data/mci/c01101c027cff22751b8dc0289de251e/src/buildscripts/resmokelib/testing/job.py", line 129, in _run self._execute_test(test, hook_failure_flag) File "/data/mci/c01101c027cff22751b8dc0289de251e/src/buildscripts/resmokelib/testing/job.py", line 175, in _execute_test raise test.propagate_error File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 59, in testPartExecutor yield File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 591, in run self._callTestMethod(testMethod) File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 549, in _callTestMethod method() File "/data/mci/c01101c027cff22751b8dc0289de251e/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 259, in run_test self._run_single_copy() File "/data/mci/c01101c027cff22751b8dc0289de251e/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 214, in _run_single_copy self._raise_if_unsafe_exit(self.return_code) File "/data/mci/c01101c027cff22751b8dc0289de251e/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 277, in _raise_if_unsafe_exit raise self.propagate_error # pylint: disable=raising-bad-type buildscripts.resmokelib.errors.UnsafeExitError: Mongo shell exited with code -9 while running jstest resharding_replicate_updates_as_insert_delete.js. Further test execution may be unsafe. Traceback (most recent call last): File "/data/mci/c01101c027cff22751b8dc0289de251e/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 210, in _run_single_copy test_case.run_test() File "/data/mci/c01101c027cff22751b8dc0289de251e/src/buildscripts/resmokelib/testing/testcases/interface.py", line 137, in run_test self._execute(proc) File "/data/mci/c01101c027cff22751b8dc0289de251e/src/buildscripts/resmokelib/testing/testcases/interface.py", line 158, in _execute raise self.failureException("%s failed" % (self.short_description())) AssertionError: JSTest jstests/sharding/internal_txns/non_retryable_writes_during_resharding.js failed Traceback (most recent call last): File "/data/mci/c01101c027cff22751b8dc0289de251e/src/buildscripts/resmokelib/testing/job.py", line 83, in __call__ self._run(queue, interrupt_flag, teardown_flag, hook_failure_flag) File "/data/mci/c01101c027cff22751b8dc0289de251e/src/buildscripts/resmokelib/testing/job.py", line 129, in _run self._execute_test(test, hook_failure_flag) File "/data/mci/c01101c027cff22751b8dc0289de251e/src/buildscripts/resmokelib/testing/job.py", line 175, in _execute_test raise test.propagate_error File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 59, in testPartExecutor yield File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 591, in run self._callTestMethod(testMethod) File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 549, in _callTestMethod method() File "/data/mci/c01101c027cff22751b8dc0289de251e/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 259, in run_test self._run_single_copy() File "/data/mci/c01101c027cff22751b8dc0289de251e/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 214, in _run_single_copy self._raise_if_unsafe_exit(self.return_code) File "/data/mci/c01101c027cff22751b8dc0289de251e/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 277, in _raise_if_unsafe_exit raise self.propagate_error # pylint: disable=raising-bad-type buildscripts.resmokelib.errors.UnsafeExitError: Mongo shell exited with code -9 while running jstest non_retryable_writes_during_resharding.js. Further test execution may be unsafe. Traceback (most recent call last): File "/data/mci/c01101c027cff22751b8dc0289de251e/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 210, in _run_single_copy test_case.run_test() File "/data/mci/c01101c027cff22751b8dc0289de251e/src/buildscripts/resmokelib/testing/testcases/interface.py", line 137, in run_test self._execute(proc) File "/data/mci/c01101c027cff22751b8dc0289de251e/src/buildscripts/resmokelib/testing/testcases/interface.py", line 158, in _execute raise self.failureException("%s failed" % (self.short_description())) AssertionError: JSTest jstests/sharding/internal_txns/non_retryable_writes_during_resharding.js failed Traceback (most recent call last): File "/data/mci/c01101c027cff22751b8dc0289de251e/src/buildscripts/resmokelib/testing/job.py", line 83, in __call__ self._run(queue, interrupt_flag, teardown_flag, hook_failure_flag) File "/data/mci/c01101c027cff22751b8dc0289de251e/src/buildscripts/resmokelib/testing/job.py", line 129, in _run self._execute_test(test, hook_failure_flag) File "/data/mci/c01101c027cff22751b8dc0289de251e/src/buildscripts/resmokelib/testing/job.py", line 175, in _execute_test raise test.propagate_error File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 59, in testPartExecutor yield File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 591, in run self._callTestMethod(testMethod) File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 549, in _callTestMethod method() File "/data/mci/c01101c027cff22751b8dc0289de251e/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 259, in run_test self._run_single_copy() File "/data/mci/c01101c027cff22751b8dc0289de251e/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 214, in _run_single_copy self._raise_if_unsafe_exit(self.return_code) File "/data/mci/c01101c027cff22751b8dc0289de251e/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 277, in _raise_if_unsafe_exit raise self.propagate_error # pylint: disable=raising-bad-type buildscripts.resmokelib.errors.UnsafeExitError: Mongo shell exited with code -9 while running jstest non_retryable_writes_during_resharding.js. Further test execution may be unsafe. logs pTrace Operation error Logs: expansions.update' in function 'set task expansion macros expansions.write' in function 'f_expansions_write expansions.write' in function 'git get project no modules git.get_project' in function 'git get project no modules subprocess.exec' in function 'add git tag expansions.write' in function 'do setup s3.get' in function 'do setup subprocess.exec' in function 'do setup keyval.inc' in function 'do setup subprocess.exec' in function 'configure evergreen api credentials expansions.write' in function 'do multiversion setup subprocess.exec' in function 'do multiversion setup expansions.write' in function 'run generated tests s3.get' in function 'run generated tests subprocess.exec' in function 'run generated tests expansions.update' in function 'run generated tests timeout.update' in function 'run generated tests expansions.write' in function 'upload npm logs subprocess.exec' in function 'upload npm logs archive.targz_pack' in function 'upload npm logs s3.put' in function 'upload npm logs s3.put' in function 'attach local resmoke invocation attach.results' in function 'attach report attach.artifacts' in function 'attach artifacts expansions.write' in function 'save ec2 task artifacts subprocess.exec' in function 'save ec2 task artifacts s3.put' in function 'save ec2 task artifacts expansions.write' in function 'attach wiki page subprocess.exec' in function 'attach wiki page attach.artifacts' in function 'attach wiki page s3.put' in function 'upload jstestfuzz minimized output expansions.write' in function 'upload jstestfuzz minimized output subprocess.exec' in function 'upload jstestfuzz minimized output attach.artifacts' in function 'upload jstestfuzz minimized output subprocess.exec' in function 'kill processes expansions.write' in function 'save local client logs subprocess.exec' in function 'save local client logs s3.put' in function 'save local client logs expansions.write' in function 'save code coverage data subprocess.exec' in function 'save code coverage data archive.targz_pack' in function 'save code coverage data s3.put' in function 'save code coverage data archive.targz_pack' in function 'save jepsen artifacts s3.put' in function 'save jepsen artifacts archive.targz_pack' in function 'save blackduck artifacts s3.put' in function 'save blackduck artifacts expansions.write' in function 'save mongo coredumps subprocess.exec' in function 'save mongo coredumps archive.targz_pack' in function 'save mongo coredumps logs pTrace Operation error Logs: expansions.write' in function 'f_expansions_write expansions.write' in function 'run hang analyzer subprocess.exec' in function 'run hang analyzer subprocess.exec' in function 'wait for resmoke to shutdown logs Assert Soon Failure Logs: assert.soon failed (timeout 600000ms), msg : Timed out waiting for failpoint to be hit. Failpoint: reshardingPauseCoordinatorBeforeBlockingWrites The hang analyzer is automatically called in assert.soon functions. If you are *expecting* assert.soon to possibly fail, call assert.soon with {runHangAnalyzer: false} as the fifth argument (you can fill unused arguments with `undefined`). Running hang analyzer from assert.soon. Running hang analyzer for pids [13173,12016,12019,12022,12031,12040] logs Mongo Shell Failed to Load Logs: uncaught exception: Error: command worked when it should have failed: { "raw" : { "resharding_prohibited_commands-rs1/ip-10-128-122-48.ec2.internal:20542,ip-10-128-122-48.ec2.internal:20543" : { "numIndexesBefore" : 3, "numIndexesAfter" : 4, "createdCollectionAutomatically" : false, "commitQuorum" : "votingMembers", "ok" : 1 }, "resharding_prohibited_commands-rs0/ip-10-128-122-48.ec2.internal:20540,ip-10-128-122-48.ec2.internal:20541" : { "numIndexesBefore" : 3, "numIndexesAfter" : 4, "createdCollectionAutomatically" : false, "commitQuorum" : "votingMembers", "ok" : 1 } }, "ok" : 1, "$clusterTime" : { "clusterTime" : Timestamp(1676047475, 1), "signature" : { "hash" : BinData(0,"AAAAAAAAAAAAAAAAAAAAAAAAAAA="), "keyId" : NumberLong(0) } }, "operationTime" : Timestamp(1676047475, 1) } : _getErrorWithCode@src/mongo/shell/utils.js:24:13 doassert@src/mongo/shell/assert.js:18:14 _assertCommandFailed@src/mongo/shell/assert.js:819:25 assert.commandFailedWithCode@src/mongo/shell/assert.js:882:16 assertCommandsFailDuringReshardingOp/<@jstests/sharding/resharding_prohibited_commands.js:72:16 assertCommandsFailDuringReshardingOp@jstests/sharding/resharding_prohibited_commands.js:64:24 @jstests/sharding/resharding_prohibited_commands.js:183:41 withReshardingInBackground/<@jstests/sharding/libs/resharding_test_fixture.js:431:58 _callFunctionSafely@jstests/sharding/libs/resharding_test_fixture.js:462:13 withReshardingInBackground@jstests/sharding/libs/resharding_test_fixture.js:431:14 withReshardingInBackground@jstests/sharding/resharding_prohibited_commands.js:128:24 @jstests/sharding/resharding_prohibited_commands.js:165:27 @jstests/sharding/resharding_prohibited_commands.js:197:3 failed to load: jstests/sharding/resharding_prohibited_commands.js exiting with code -3 logs Assert Soon Failure Logs: assert.soon failed (timeout 600000ms), msg : Timed out waiting for failpoint to be hit. Failpoint: reshardingPauseCoordinatorBeforeBlockingWrites The hang analyzer is automatically called in assert.soon functions. If you are *expecting* assert.soon to possibly fail, call assert.soon with {runHangAnalyzer: false} as the fifth argument (you can fill unused arguments with `undefined`). Running hang analyzer from assert.soon. Running hang analyzer for pids [31503,31491,31485,31483,31495,31489,31487,1663] logs xgen-buildbaron-user commented on Fri, 10 Feb 2023 22:17:07 +0000: pTrace Operation error Logs: -9 while running jstest resharding_write_when_temp_ns_routing_info_unknown.js. Further test execution may be unsafe. Traceback (most recent call last): File "/data/mci/953df1ece246512efc7f93232c9dd3f6/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 210, in _run_single_copy test_case.run_test() File "/data/mci/953df1ece246512efc7f93232c9dd3f6/src/buildscripts/resmokelib/testing/testcases/interface.py", line 137, in run_test self._execute(proc) File "/data/mci/953df1ece246512efc7f93232c9dd3f6/src/buildscripts/resmokelib/testing/testcases/interface.py", line 158, in _execute raise self.failureException("%s failed" % (self.short_description())) AssertionError: JSTest jstests/sharding/query/unionWith_current_op.js failed Traceback (most recent call last): File "/data/mci/953df1ece246512efc7f93232c9dd3f6/src/buildscripts/resmokelib/testing/job.py", line 83, in __call__ self._run(queue, interrupt_flag, teardown_flag, hook_failure_flag) File "/data/mci/953df1ece246512efc7f93232c9dd3f6/src/buildscripts/resmokelib/testing/job.py", line 129, in _run self._execute_test(test, hook_failure_flag) File "/data/mci/953df1ece246512efc7f93232c9dd3f6/src/buildscripts/resmokelib/testing/job.py", line 175, in _execute_test raise test.propagate_error File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 59, in testPartExecutor yield File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 591, in run self._callTestMethod(testMethod) File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 549, in _callTestMethod method() File "/data/mci/953df1ece246512efc7f93232c9dd3f6/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 259, in run_test self._run_single_copy() File "/data/mci/953df1ece246512efc7f93232c9dd3f6/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 214, in _run_single_copy self._raise_if_unsafe_exit(self.return_code) File "/data/mci/953df1ece246512efc7f93232c9dd3f6/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 277, in _raise_if_unsafe_exit raise self.propagate_error # pylint: disable=raising-bad-type buildscripts.resmokelib.errors.UnsafeExitError: Mongo shell exited with code -9 while running jstest unionWith_current_op.js. Further test execution may be unsafe. Traceback (most recent call last): File "/data/mci/953df1ece246512efc7f93232c9dd3f6/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 210, in _run_single_copy test_case.run_test() File "/data/mci/953df1ece246512efc7f93232c9dd3f6/src/buildscripts/resmokelib/testing/testcases/interface.py", line 137, in run_test self._execute(proc) File "/data/mci/953df1ece246512efc7f93232c9dd3f6/src/buildscripts/resmokelib/testing/testcases/interface.py", line 158, in _execute raise self.failureException("%s failed" % (self.short_description())) AssertionError: JSTest jstests/sharding/query/unionWith_current_op.js failed Traceback (most recent call last): File "/data/mci/953df1ece246512efc7f93232c9dd3f6/src/buildscripts/resmokelib/testing/job.py", line 83, in __call__ self._run(queue, interrupt_flag, teardown_flag, hook_failure_flag) File "/data/mci/953df1ece246512efc7f93232c9dd3f6/src/buildscripts/resmokelib/testing/job.py", line 129, in _run self._execute_test(test, hook_failure_flag) File "/data/mci/953df1ece246512efc7f93232c9dd3f6/src/buildscripts/resmokelib/testing/job.py", line 175, in _execute_test raise test.propagate_error File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 59, in testPartExecutor yield File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 591, in run self._callTestMethod(testMethod) File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 549, in _callTestMethod method() File "/data/mci/953df1ece246512efc7f93232c9dd3f6/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 259, in run_test self._run_single_copy() File "/data/mci/953df1ece246512efc7f93232c9dd3f6/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 214, in _run_single_copy self._raise_if_unsafe_exit(self.return_code) File "/data/mci/953df1ece246512efc7f93232c9dd3f6/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 277, in _raise_if_unsafe_exit raise self.propagate_error # pylint: disable=raising-bad-type buildscripts.resmokelib.errors.UnsafeExitError: Mongo shell exited with code -9 while running jstest unionWith_current_op.js. Further test execution may be unsafe. Traceback (most recent call last): File "/data/mci/953df1ece246512efc7f93232c9dd3f6/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 210, in _run_single_copy test_case.run_test() File "/data/mci/953df1ece246512efc7f93232c9dd3f6/src/buildscripts/resmokelib/testing/testcases/interface.py", line 137, in run_test self._execute(proc) File "/data/mci/953df1ece246512efc7f93232c9dd3f6/src/buildscripts/resmokelib/testing/testcases/interface.py", line 158, in _execute raise self.failureException("%s failed" % (self.short_description())) AssertionError: JSTest jstests/sharding/reshard_collection_existing_sk_index_not_duplicated.js failed Traceback (most recent call last): File "/data/mci/953df1ece246512efc7f93232c9dd3f6/src/buildscripts/resmokelib/testing/job.py", line 83, in __call__ self._run(queue, interrupt_flag, teardown_flag, hook_failure_flag) File "/data/mci/953df1ece246512efc7f93232c9dd3f6/src/buildscripts/resmokelib/testing/job.py", line 129, in _run self._execute_test(test, hook_failure_flag) File "/data/mci/953df1ece246512efc7f93232c9dd3f6/src/buildscripts/resmokelib/testing/job.py", line 175, in _execute_test raise test.propagate_error File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 59, in testPartExecutor yield File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 591, in run self._callTestMethod(testMethod) File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 549, in _callTestMethod method() File "/data/mci/953df1ece246512efc7f93232c9dd3f6/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 259, in run_test self._run_single_copy() File "/data/mci/953df1ece246512efc7f93232c9dd3f6/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 214, in _run_single_copy self._raise_if_unsafe_exit(self.return_code) File "/data/mci/953df1ece246512efc7f93232c9dd3f6/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 277, in _raise_if_unsafe_exit raise self.propagate_error # pylint: disable=raising-bad-type buildscripts.resmokelib.errors.UnsafeExitError: Mongo shell exited with code -9 while running jstest reshard_collection_existing_sk_index_not_duplicated.js. Further test execution may be unsafe. Traceback (most recent call last): File "/data/mci/953df1ece246512efc7f93232c9dd3f6/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 210, in _run_single_copy test_case.run_test() File "/data/mci/953df1ece246512efc7f93232c9dd3f6/src/buildscripts/resmokelib/testing/testcases/interface.py", line 137, in run_test self._execute(proc) File "/data/mci/953df1ece246512efc7f93232c9dd3f6/src/buildscripts/resmokelib/testing/testcases/interface.py", line 158, in _execute raise self.failureException("%s failed" % (self.short_description())) AssertionError: JSTest jstests/sharding/reshard_collection_existing_sk_index_not_duplicated.js failed Traceback (most recent call last): File "/data/mci/953df1ece246512efc7f93232c9dd3f6/src/buildscripts/resmokelib/testing/job.py", line 83, in __call__ self._run(queue, interrupt_flag, teardown_flag, hook_failure_flag) File "/data/mci/953df1ece246512efc7f93232c9dd3f6/src/buildscripts/resmokelib/testing/job.py", line 129, in _run self._execute_test(test, hook_failure_flag) File "/data/mci/953df1ece246512efc7f93232c9dd3f6/src/buildscripts/resmokelib/testing/job.py", line 175, in _execute_test raise test.propagate_error File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 59, in testPartExecutor yield File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 591, in run self._callTestMethod(testMethod) File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 549, in _callTestMethod method() File "/data/mci/953df1ece246512efc7f93232c9dd3f6/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 259, in run_test self._run_single_copy() File "/data/mci/953df1ece246512efc7f93232c9dd3f6/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 214, in _run_single_copy self._raise_if_unsafe_exit(self.return_code) File "/data/mci/953df1ece246512efc7f93232c9dd3f6/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 277, in _raise_if_unsafe_exit raise self.propagate_error # pylint: disable=raising-bad-type buildscripts.resmokelib.errors.UnsafeExitError: Mongo shell exited with code -9 while running jstest reshard_collection_existing_sk_index_not_duplicated.js. Further test execution may be unsafe. logs pTrace Operation error Logs: expansions.update' in function 'set task expansion macros expansions.write' in function 'f_expansions_write expansions.write' in function 'git get project no modules git.get_project' in function 'git get project no modules subprocess.exec' in function 'add git tag expansions.write' in function 'do setup s3.get' in function 'do setup subprocess.exec' in function 'do setup keyval.inc' in function 'do setup subprocess.exec' in function 'configure evergreen api credentials expansions.write' in function 'do multiversion setup subprocess.exec' in function 'do multiversion setup expansions.write' in function 'run generated tests s3.get' in function 'run generated tests subprocess.exec' in function 'run generated tests expansions.update' in function 'run generated tests timeout.update' in function 'run generated tests expansions.write' in function 'upload npm logs subprocess.exec' in function 'upload npm logs archive.targz_pack' in function 'upload npm logs s3.put' in function 'upload npm logs s3.put' in function 'attach local resmoke invocation attach.results' in function 'attach report attach.artifacts' in function 'attach artifacts expansions.write' in function 'save ec2 task artifacts subprocess.exec' in function 'save ec2 task artifacts s3.put' in function 'save ec2 task artifacts expansions.write' in function 'attach wiki page subprocess.exec' in function 'attach wiki page attach.artifacts' in function 'attach wiki page s3.put' in function 'upload jstestfuzz minimized output expansions.write' in function 'upload jstestfuzz minimized output subprocess.exec' in function 'upload jstestfuzz minimized output attach.artifacts' in function 'upload jstestfuzz minimized output subprocess.exec' in function 'kill processes expansions.write' in function 'save local client logs subprocess.exec' in function 'save local client logs s3.put' in function 'save local client logs expansions.write' in function 'save code coverage data subprocess.exec' in function 'save code coverage data archive.targz_pack' in function 'save code coverage data s3.put' in function 'save code coverage data archive.targz_pack' in function 'save jepsen artifacts s3.put' in function 'save jepsen artifacts archive.targz_pack' in function 'save blackduck artifacts s3.put' in function 'save blackduck artifacts expansions.write' in function 'save mongo coredumps subprocess.exec' in function 'save mongo coredumps archive.targz_pack' in function 'save mongo coredumps logs pTrace Operation error Logs: expansions.write' in function 'f_expansions_write expansions.write' in function 'run hang analyzer subprocess.exec' in function 'run hang analyzer subprocess.exec' in function 'wait for resmoke to shutdown logs Agent Log Assertion Extractor Logs: Hit exec timeout (1h20m0s). logs pTrace Operation error Logs: ptrace: Operation not permitted. logs pTrace Operation error Logs: ptrace: Operation not permitted. logs pTrace Operation error Logs: ptrace: Operation not permitted. logs pTrace Operation error Logs: ptrace: Operation not permitted. logs pTrace Operation error Logs: ecution may be unsafe. Traceback (most recent call last): File "/data/mci/1cbf0335e4b064f3e07b4dbdefcdcf8a/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 210, in _run_single_copy test_case.run_test() File "/data/mci/1cbf0335e4b064f3e07b4dbdefcdcf8a/src/buildscripts/resmokelib/testing/testcases/interface.py", line 137, in run_test self._execute(proc) File "/data/mci/1cbf0335e4b064f3e07b4dbdefcdcf8a/src/buildscripts/resmokelib/testing/testcases/interface.py", line 158, in _execute raise self.failureException("%s failed" % (self.short_description())) AssertionError: JSTest jstests/sharding/internal_txns/non_retryable_writes_before_resharding.js failed Traceback (most recent call last): File "/data/mci/1cbf0335e4b064f3e07b4dbdefcdcf8a/src/buildscripts/resmokelib/testing/job.py", line 83, in __call__ self._run(queue, interrupt_flag, teardown_flag, hook_failure_flag) File "/data/mci/1cbf0335e4b064f3e07b4dbdefcdcf8a/src/buildscripts/resmokelib/testing/job.py", line 129, in _run self._execute_test(test, hook_failure_flag) File "/data/mci/1cbf0335e4b064f3e07b4dbdefcdcf8a/src/buildscripts/resmokelib/testing/job.py", line 175, in _execute_test raise test.propagate_error File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 59, in testPartExecutor yield File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 591, in run self._callTestMethod(testMethod) File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 549, in _callTestMethod method() File "/data/mci/1cbf0335e4b064f3e07b4dbdefcdcf8a/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 259, in run_test self._run_single_copy() File "/data/mci/1cbf0335e4b064f3e07b4dbdefcdcf8a/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 214, in _run_single_copy self._raise_if_unsafe_exit(self.return_code) File "/data/mci/1cbf0335e4b064f3e07b4dbdefcdcf8a/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 277, in _raise_if_unsafe_exit raise self.propagate_error # pylint: disable=raising-bad-type buildscripts.resmokelib.errors.UnsafeExitError: Mongo shell exited with code -9 while running jstest non_retryable_writes_before_resharding.js. Further test execution may be unsafe. Traceback (most recent call last): File "/data/mci/1cbf0335e4b064f3e07b4dbdefcdcf8a/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 210, in _run_single_copy test_case.run_test() File "/data/mci/1cbf0335e4b064f3e07b4dbdefcdcf8a/src/buildscripts/resmokelib/testing/testcases/interface.py", line 137, in run_test self._execute(proc) File "/data/mci/1cbf0335e4b064f3e07b4dbdefcdcf8a/src/buildscripts/resmokelib/testing/testcases/interface.py", line 158, in _execute raise self.failureException("%s failed" % (self.short_description())) AssertionError: JSTest jstests/sharding/internal_txns/non_retryable_writes_before_resharding.js failed Traceback (most recent call last): File "/data/mci/1cbf0335e4b064f3e07b4dbdefcdcf8a/src/buildscripts/resmokelib/testing/job.py", line 83, in __call__ self._run(queue, interrupt_flag, teardown_flag, hook_failure_flag) File "/data/mci/1cbf0335e4b064f3e07b4dbdefcdcf8a/src/buildscripts/resmokelib/testing/job.py", line 129, in _run self._execute_test(test, hook_failure_flag) File "/data/mci/1cbf0335e4b064f3e07b4dbdefcdcf8a/src/buildscripts/resmokelib/testing/job.py", line 175, in _execute_test raise test.propagate_error File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 59, in testPartExecutor yield File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 591, in run self._callTestMethod(testMethod) File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 549, in _callTestMethod method() File "/data/mci/1cbf0335e4b064f3e07b4dbdefcdcf8a/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 259, in run_test self._run_single_copy() File "/data/mci/1cbf0335e4b064f3e07b4dbdefcdcf8a/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 214, in _run_single_copy self._raise_if_unsafe_exit(self.return_code) File "/data/mci/1cbf0335e4b064f3e07b4dbdefcdcf8a/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 277, in _raise_if_unsafe_exit raise self.propagate_error # pylint: disable=raising-bad-type buildscripts.resmokelib.errors.UnsafeExitError: Mongo shell exited with code -9 while running jstest non_retryable_writes_before_resharding.js. Further test execution may be unsafe. Traceback (most recent call last): File "/data/mci/1cbf0335e4b064f3e07b4dbdefcdcf8a/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 210, in _run_single_copy test_case.run_test() File "/data/mci/1cbf0335e4b064f3e07b4dbdefcdcf8a/src/buildscripts/resmokelib/testing/testcases/interface.py", line 137, in run_test self._execute(proc) File "/data/mci/1cbf0335e4b064f3e07b4dbdefcdcf8a/src/buildscripts/resmokelib/testing/testcases/interface.py", line 158, in _execute raise self.failureException("%s failed" % (self.short_description())) AssertionError: JSTest jstests/sharding/change_streams/change_stream_lookup_preimage_with_resharding.js failed Traceback (most recent call last): File "/data/mci/1cbf0335e4b064f3e07b4dbdefcdcf8a/src/buildscripts/resmokelib/testing/job.py", line 83, in __call__ self._run(queue, interrupt_flag, teardown_flag, hook_failure_flag) File "/data/mci/1cbf0335e4b064f3e07b4dbdefcdcf8a/src/buildscripts/resmokelib/testing/job.py", line 129, in _run self._execute_test(test, hook_failure_flag) File "/data/mci/1cbf0335e4b064f3e07b4dbdefcdcf8a/src/buildscripts/resmokelib/testing/job.py", line 175, in _execute_test raise test.propagate_error File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 59, in testPartExecutor yield File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 591, in run self._callTestMethod(testMethod) File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 549, in _callTestMethod method() File "/data/mci/1cbf0335e4b064f3e07b4dbdefcdcf8a/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 259, in run_test self._run_single_copy() File "/data/mci/1cbf0335e4b064f3e07b4dbdefcdcf8a/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 214, in _run_single_copy self._raise_if_unsafe_exit(self.return_code) File "/data/mci/1cbf0335e4b064f3e07b4dbdefcdcf8a/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 277, in _raise_if_unsafe_exit raise self.propagate_error # pylint: disable=raising-bad-type buildscripts.resmokelib.errors.UnsafeExitError: Mongo shell exited with code -9 while running jstest change_stream_lookup_preimage_with_resharding.js. Further test execution may be unsafe. Traceback (most recent call last): File "/data/mci/1cbf0335e4b064f3e07b4dbdefcdcf8a/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 210, in _run_single_copy test_case.run_test() File "/data/mci/1cbf0335e4b064f3e07b4dbdefcdcf8a/src/buildscripts/resmokelib/testing/testcases/interface.py", line 137, in run_test self._execute(proc) File "/data/mci/1cbf0335e4b064f3e07b4dbdefcdcf8a/src/buildscripts/resmokelib/testing/testcases/interface.py", line 158, in _execute raise self.failureException("%s failed" % (self.short_description())) AssertionError: JSTest jstests/sharding/change_streams/change_stream_lookup_preimage_with_resharding.js failed Traceback (most recent call last): File "/data/mci/1cbf0335e4b064f3e07b4dbdefcdcf8a/src/buildscripts/resmokelib/testing/job.py", line 83, in __call__ self._run(queue, interrupt_flag, teardown_flag, hook_failure_flag) File "/data/mci/1cbf0335e4b064f3e07b4dbdefcdcf8a/src/buildscripts/resmokelib/testing/job.py", line 129, in _run self._execute_test(test, hook_failure_flag) File "/data/mci/1cbf0335e4b064f3e07b4dbdefcdcf8a/src/buildscripts/resmokelib/testing/job.py", line 175, in _execute_test raise test.propagate_error File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 59, in testPartExecutor yield File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 591, in run self._callTestMethod(testMethod) File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 549, in _callTestMethod method() File "/data/mci/1cbf0335e4b064f3e07b4dbdefcdcf8a/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 259, in run_test self._run_single_copy() File "/data/mci/1cbf0335e4b064f3e07b4dbdefcdcf8a/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 214, in _run_single_copy self._raise_if_unsafe_exit(self.return_code) File "/data/mci/1cbf0335e4b064f3e07b4dbdefcdcf8a/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 277, in _raise_if_unsafe_exit raise self.propagate_error # pylint: disable=raising-bad-type buildscripts.resmokelib.errors.UnsafeExitError: Mongo shell exited with code -9 while running jstest change_stream_lookup_preimage_with_resharding.js. Further test execution may be unsafe. logs pTrace Operation error Logs: expansions.update' in function 'set task expansion macros expansions.write' in function 'f_expansions_write expansions.write' in function 'git get project no modules git.get_project' in function 'git get project no modules subprocess.exec' in function 'add git tag expansions.write' in function 'do setup s3.get' in function 'do setup subprocess.exec' in function 'do setup keyval.inc' in function 'do setup subprocess.exec' in function 'configure evergreen api credentials expansions.write' in function 'do multiversion setup subprocess.exec' in function 'do multiversion setup expansions.write' in function 'run generated tests s3.get' in function 'run generated tests subprocess.exec' in function 'run generated tests expansions.update' in function 'run generated tests timeout.update' in function 'run generated tests expansions.write' in function 'upload npm logs subprocess.exec' in function 'upload npm logs archive.targz_pack' in function 'upload npm logs s3.put' in function 'upload npm logs s3.put' in function 'attach local resmoke invocation attach.results' in function 'attach report attach.artifacts' in function 'attach artifacts expansions.write' in function 'save ec2 task artifacts subprocess.exec' in function 'save ec2 task artifacts s3.put' in function 'save ec2 task artifacts expansions.write' in function 'attach wiki page subprocess.exec' in function 'attach wiki page attach.artifacts' in function 'attach wiki page s3.put' in function 'upload jstestfuzz minimized output expansions.write' in function 'upload jstestfuzz minimized output subprocess.exec' in function 'upload jstestfuzz minimized output attach.artifacts' in function 'upload jstestfuzz minimized output subprocess.exec' in function 'kill processes expansions.write' in function 'save local client logs subprocess.exec' in function 'save local client logs s3.put' in function 'save local client logs expansions.write' in function 'save code coverage data subprocess.exec' in function 'save code coverage data archive.targz_pack' in function 'save code coverage data s3.put' in function 'save code coverage data archive.targz_pack' in function 'save jepsen artifacts s3.put' in function 'save jepsen artifacts archive.targz_pack' in function 'save blackduck artifacts s3.put' in function 'save blackduck artifacts expansions.write' in function 'save mongo coredumps subprocess.exec' in function 'save mongo coredumps archive.targz_pack' in function 'save mongo coredumps s3.put' in function 'save mongo coredumps logs pTrace Operation error Logs: expansions.write' in function 'f_expansions_write expansions.write' in function 'run hang analyzer subprocess.exec' in function 'run hang analyzer subprocess.exec' in function 'wait for resmoke to shutdown logs xgen-buildbaron-user commented on Fri, 10 Feb 2023 22:17:05 +0000: Hang Analyzer Extractor Logs: Running Print JavaScript Stack Supplement Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack logs Hang Analyzer Extractor Logs: Running Print JavaScript Stack Supplement Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack logs Hang Analyzer Extractor Logs: Running Print JavaScript Stack Supplement Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack logs Hang Analyzer Extractor Logs: Running Print JavaScript Stack Supplement Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack logs Agent Log Assertion Extractor Logs: Hit exec timeout (1h20m0s). logs pTrace Operation error Logs: ptrace: Operation not permitted. logs pTrace Operation error Logs: ptrace: Operation not permitted. logs pTrace Operation error Logs: ptrace: Operation not permitted. logs xgen-buildbaron-user commented on Fri, 10 Feb 2023 22:17:03 +0000: Hang Analyzer Extractor Logs: Running Print JavaScript Stack Supplement Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack logs Hang Analyzer Extractor Logs: Running Print JavaScript Stack Supplement Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack Ignoring GDB error 'No symbol table is loaded. Use the "file" command.' in javascript_stack logs Hang Analyzer Extractor Logs: Running Print JavaScript Stack Supplement Traceback (most recent call last): File "buildscripts/gdb/mongo.py", line 879, in invoke main_binary_name = get_process_name() File "buildscripts/gdb/mongo.py", line 137, in get_process_name main_binary_name = gdb.objfiles()[0].filename IndexError: list index out of range Error occurred in Python: list index out of range Traceback (most recent call last): File "buildscripts/gdb/mongo.py", line 400, in invoke session_catalog = get_session_catalog() File "buildscripts/gdb/mongo.py", line 186, in get_session_catalog logs Hang Analyzer Extractor Logs: Running Print JavaScript Stack Supplement Traceback (most recent call last): File "buildscripts/gdb/mongo.py", line 879, in invoke main_binary_name = get_process_name() File "buildscripts/gdb/mongo.py", line 137, in get_process_name main_binary_name = gdb.objfiles()[0].filename IndexError: list index out of range Error occurred in Python: list index out of range Traceback (most recent call last): File "buildscripts/gdb/mongo.py", line 400, in invoke session_catalog = get_session_catalog() File "buildscripts/gdb/mongo.py", line 186, in get_session_catalog logs Agent Log Assertion Extractor Logs: Hit exec timeout (1h20m0s). logs pTrace Operation error Logs: ptrace: Operation not permitted. logs pTrace Operation error Logs: ptrace: Operation not permitted. logs pTrace Operation error Logs: ptrace: Operation not permitted. logs pTrace Operation error Logs: ptrace: Operation not permitted. logs pTrace Operation error Logs: Error: Mongo shell exited with code -9 while running jstest retryable_writes_aborted_during_resharding.js. Further test execution may be unsafe. Traceback (most recent call last): File "/data/mci/ac49a6cd7d95def02a4be6c96aefd522/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 210, in _run_single_copy test_case.run_test() File "/data/mci/ac49a6cd7d95def02a4be6c96aefd522/src/buildscripts/resmokelib/testing/testcases/interface.py", line 137, in run_test self._execute(proc) File "/data/mci/ac49a6cd7d95def02a4be6c96aefd522/src/buildscripts/resmokelib/testing/testcases/interface.py", line 158, in _execute raise self.failureException("%s failed" % (self.short_description())) AssertionError: JSTest jstests/sharding/resharding_change_stream_internal_ops.js failed Traceback (most recent call last): File "/data/mci/ac49a6cd7d95def02a4be6c96aefd522/src/buildscripts/resmokelib/testing/job.py", line 83, in __call__ self._run(queue, interrupt_flag, teardown_flag, hook_failure_flag) File "/data/mci/ac49a6cd7d95def02a4be6c96aefd522/src/buildscripts/resmokelib/testing/job.py", line 129, in _run self._execute_test(test, hook_failure_flag) File "/data/mci/ac49a6cd7d95def02a4be6c96aefd522/src/buildscripts/resmokelib/testing/job.py", line 175, in _execute_test raise test.propagate_error File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 59, in testPartExecutor yield File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 591, in run self._callTestMethod(testMethod) File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 549, in _callTestMethod method() File "/data/mci/ac49a6cd7d95def02a4be6c96aefd522/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 259, in run_test self._run_single_copy() File "/data/mci/ac49a6cd7d95def02a4be6c96aefd522/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 214, in _run_single_copy self._raise_if_unsafe_exit(self.return_code) File "/data/mci/ac49a6cd7d95def02a4be6c96aefd522/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 277, in _raise_if_unsafe_exit raise self.propagate_error # pylint: disable=raising-bad-type buildscripts.resmokelib.errors.UnsafeExitError: Mongo shell exited with code -9 while running jstest resharding_change_stream_internal_ops.js. Further test execution may be unsafe. Traceback (most recent call last): File "/data/mci/ac49a6cd7d95def02a4be6c96aefd522/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 210, in _run_single_copy test_case.run_test() File "/data/mci/ac49a6cd7d95def02a4be6c96aefd522/src/buildscripts/resmokelib/testing/testcases/interface.py", line 137, in run_test self._execute(proc) File "/data/mci/ac49a6cd7d95def02a4be6c96aefd522/src/buildscripts/resmokelib/testing/testcases/interface.py", line 158, in _execute raise self.failureException("%s failed" % (self.short_description())) AssertionError: JSTest jstests/sharding/resharding_change_stream_internal_ops.js failed Traceback (most recent call last): File "/data/mci/ac49a6cd7d95def02a4be6c96aefd522/src/buildscripts/resmokelib/testing/job.py", line 83, in __call__ self._run(queue, interrupt_flag, teardown_flag, hook_failure_flag) File "/data/mci/ac49a6cd7d95def02a4be6c96aefd522/src/buildscripts/resmokelib/testing/job.py", line 129, in _run self._execute_test(test, hook_failure_flag) File "/data/mci/ac49a6cd7d95def02a4be6c96aefd522/src/buildscripts/resmokelib/testing/job.py", line 175, in _execute_test raise test.propagate_error File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 59, in testPartExecutor yield File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 591, in run self._callTestMethod(testMethod) File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 549, in _callTestMethod method() File "/data/mci/ac49a6cd7d95def02a4be6c96aefd522/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 259, in run_test self._run_single_copy() File "/data/mci/ac49a6cd7d95def02a4be6c96aefd522/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 214, in _run_single_copy self._raise_if_unsafe_exit(self.return_code) File "/data/mci/ac49a6cd7d95def02a4be6c96aefd522/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 277, in _raise_if_unsafe_exit raise self.propagate_error # pylint: disable=raising-bad-type buildscripts.resmokelib.errors.UnsafeExitError: Mongo shell exited with code -9 while running jstest resharding_change_stream_internal_ops.js. Further test execution may be unsafe. Traceback (most recent call last): File "/data/mci/ac49a6cd7d95def02a4be6c96aefd522/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 210, in _run_single_copy test_case.run_test() File "/data/mci/ac49a6cd7d95def02a4be6c96aefd522/src/buildscripts/resmokelib/testing/testcases/interface.py", line 137, in run_test self._execute(proc) File "/data/mci/ac49a6cd7d95def02a4be6c96aefd522/src/buildscripts/resmokelib/testing/testcases/interface.py", line 158, in _execute raise self.failureException("%s failed" % (self.short_description())) AssertionError: JSTest jstests/sharding/resharding_read_from_secondary.js failed Traceback (most recent call last): File "/data/mci/ac49a6cd7d95def02a4be6c96aefd522/src/buildscripts/resmokelib/testing/job.py", line 83, in __call__ self._run(queue, interrupt_flag, teardown_flag, hook_failure_flag) File "/data/mci/ac49a6cd7d95def02a4be6c96aefd522/src/buildscripts/resmokelib/testing/job.py", line 129, in _run self._execute_test(test, hook_failure_flag) File "/data/mci/ac49a6cd7d95def02a4be6c96aefd522/src/buildscripts/resmokelib/testing/job.py", line 175, in _execute_test raise test.propagate_error File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 59, in testPartExecutor yield File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 591, in run self._callTestMethod(testMethod) File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 549, in _callTestMethod method() File "/data/mci/ac49a6cd7d95def02a4be6c96aefd522/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 259, in run_test self._run_single_copy() File "/data/mci/ac49a6cd7d95def02a4be6c96aefd522/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 214, in _run_single_copy self._raise_if_unsafe_exit(self.return_code) File "/data/mci/ac49a6cd7d95def02a4be6c96aefd522/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 277, in _raise_if_unsafe_exit raise self.propagate_error # pylint: disable=raising-bad-type buildscripts.resmokelib.errors.UnsafeExitError: Mongo shell exited with code -9 while running jstest resharding_read_from_secondary.js. Further test execution may be unsafe. Traceback (most recent call last): File "/data/mci/ac49a6cd7d95def02a4be6c96aefd522/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 210, in _run_single_copy test_case.run_test() File "/data/mci/ac49a6cd7d95def02a4be6c96aefd522/src/buildscripts/resmokelib/testing/testcases/interface.py", line 137, in run_test self._execute(proc) File "/data/mci/ac49a6cd7d95def02a4be6c96aefd522/src/buildscripts/resmokelib/testing/testcases/interface.py", line 158, in _execute raise self.failureException("%s failed" % (self.short_description())) AssertionError: JSTest jstests/sharding/resharding_read_from_secondary.js failed Traceback (most recent call last): File "/data/mci/ac49a6cd7d95def02a4be6c96aefd522/src/buildscripts/resmokelib/testing/job.py", line 83, in __call__ self._run(queue, interrupt_flag, teardown_flag, hook_failure_flag) File "/data/mci/ac49a6cd7d95def02a4be6c96aefd522/src/buildscripts/resmokelib/testing/job.py", line 129, in _run self._execute_test(test, hook_failure_flag) File "/data/mci/ac49a6cd7d95def02a4be6c96aefd522/src/buildscripts/resmokelib/testing/job.py", line 175, in _execute_test raise test.propagate_error File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 59, in testPartExecutor yield File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 591, in run self._callTestMethod(testMethod) File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 549, in _callTestMethod method() File "/data/mci/ac49a6cd7d95def02a4be6c96aefd522/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 259, in run_test self._run_single_copy() File "/data/mci/ac49a6cd7d95def02a4be6c96aefd522/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 214, in _run_single_copy self._raise_if_unsafe_exit(self.return_code) File "/data/mci/ac49a6cd7d95def02a4be6c96aefd522/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 277, in _raise_if_unsafe_exit raise self.propagate_error # pylint: disable=raising-bad-type buildscripts.resmokelib.errors.UnsafeExitError: Mongo shell exited with code -9 while running jstest resharding_read_from_secondary.js. Further test execution may be unsafe. logs pTrace Operation error Logs: expansions.update' in function 'set task expansion macros expansions.write' in function 'f_expansions_write expansions.write' in function 'git get project no modules git.get_project' in function 'git get project no modules subprocess.exec' in function 'add git tag expansions.write' in function 'do setup s3.get' in function 'do setup subprocess.exec' in function 'do setup keyval.inc' in function 'do setup subprocess.exec' in function 'configure evergreen api credentials expansions.write' in function 'do multiversion setup subprocess.exec' in function 'do multiversion setup expansions.write' in function 'run generated tests s3.get' in function 'run generated tests subprocess.exec' in function 'run generated tests expansions.update' in function 'run generated tests timeout.update' in function 'run generated tests expansions.write' in function 'upload npm logs subprocess.exec' in function 'upload npm logs archive.targz_pack' in function 'upload npm logs s3.put' in function 'upload npm logs s3.put' in function 'attach local resmoke invocation attach.results' in function 'attach report attach.artifacts' in function 'attach artifacts expansions.write' in function 'save ec2 task artifacts subprocess.exec' in function 'save ec2 task artifacts s3.put' in function 'save ec2 task artifacts expansions.write' in function 'attach wiki page subprocess.exec' in function 'attach wiki page attach.artifacts' in function 'attach wiki page s3.put' in function 'upload jstestfuzz minimized output expansions.write' in function 'upload jstestfuzz minimized output subprocess.exec' in function 'upload jstestfuzz minimized output attach.artifacts' in function 'upload jstestfuzz minimized output subprocess.exec' in function 'kill processes expansions.write' in function 'save local client logs subprocess.exec' in function 'save local client logs s3.put' in function 'save local client logs expansions.write' in function 'save code coverage data subprocess.exec' in function 'save code coverage data archive.targz_pack' in function 'save code coverage data s3.put' in function 'save code coverage data archive.targz_pack' in function 'save jepsen artifacts s3.put' in function 'save jepsen artifacts archive.targz_pack' in function 'save blackduck artifacts s3.put' in function 'save blackduck artifacts expansions.write' in function 'save mongo coredumps subprocess.exec' in function 'save mongo coredumps archive.targz_pack' in function 'save mongo coredumps s3.put' in function 'save mongo coredumps logs pTrace Operation error Logs: expansions.write' in function 'f_expansions_write expansions.write' in function 'run hang analyzer subprocess.exec' in function 'run hang analyzer subprocess.exec' in function 'wait for resmoke to shutdown logs xgen-buildbaron-user commented on Fri, 10 Feb 2023 22:17:01 +0000: logs Agent Log Assertion Extractor Logs: Hit exec timeout (1h20m0s). logs pTrace Operation error Logs: ptrace: Operation not permitted. logs pTrace Operation error Logs: ptrace: Operation not permitted. logs pTrace Operation error Logs: ptrace: Operation not permitted. logs pTrace Operation error Logs: txn_cloner.js. Further test execution may be unsafe. Traceback (most recent call last): File "/data/mci/30320058e4874c11dcc4cc0e4863c7e6/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 210, in _run_single_copy test_case.run_test() File "/data/mci/30320058e4874c11dcc4cc0e4863c7e6/src/buildscripts/resmokelib/testing/testcases/interface.py", line 137, in run_test self._execute(proc) File "/data/mci/30320058e4874c11dcc4cc0e4863c7e6/src/buildscripts/resmokelib/testing/testcases/interface.py", line 158, in _execute raise self.failureException("%s failed" % (self.short_description())) AssertionError: JSTest jstests/sharding/resharding_replicate_updates_as_insert_delete.js failed Traceback (most recent call last): File "/data/mci/30320058e4874c11dcc4cc0e4863c7e6/src/buildscripts/resmokelib/testing/job.py", line 83, in __call__ self._run(queue, interrupt_flag, teardown_flag, hook_failure_flag) File "/data/mci/30320058e4874c11dcc4cc0e4863c7e6/src/buildscripts/resmokelib/testing/job.py", line 129, in _run self._execute_test(test, hook_failure_flag) File "/data/mci/30320058e4874c11dcc4cc0e4863c7e6/src/buildscripts/resmokelib/testing/job.py", line 175, in _execute_test raise test.propagate_error File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 59, in testPartExecutor yield File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 591, in run self._callTestMethod(testMethod) File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 549, in _callTestMethod method() File "/data/mci/30320058e4874c11dcc4cc0e4863c7e6/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 259, in run_test self._run_single_copy() File "/data/mci/30320058e4874c11dcc4cc0e4863c7e6/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 214, in _run_single_copy self._raise_if_unsafe_exit(self.return_code) File "/data/mci/30320058e4874c11dcc4cc0e4863c7e6/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 277, in _raise_if_unsafe_exit raise self.propagate_error # pylint: disable=raising-bad-type buildscripts.resmokelib.errors.UnsafeExitError: Mongo shell exited with code -9 while running jstest resharding_replicate_updates_as_insert_delete.js. Further test execution may be unsafe. Traceback (most recent call last): File "/data/mci/30320058e4874c11dcc4cc0e4863c7e6/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 210, in _run_single_copy test_case.run_test() File "/data/mci/30320058e4874c11dcc4cc0e4863c7e6/src/buildscripts/resmokelib/testing/testcases/interface.py", line 137, in run_test self._execute(proc) File "/data/mci/30320058e4874c11dcc4cc0e4863c7e6/src/buildscripts/resmokelib/testing/testcases/interface.py", line 158, in _execute raise self.failureException("%s failed" % (self.short_description())) AssertionError: JSTest jstests/sharding/resharding_replicate_updates_as_insert_delete.js failed Traceback (most recent call last): File "/data/mci/30320058e4874c11dcc4cc0e4863c7e6/src/buildscripts/resmokelib/testing/job.py", line 83, in __call__ self._run(queue, interrupt_flag, teardown_flag, hook_failure_flag) File "/data/mci/30320058e4874c11dcc4cc0e4863c7e6/src/buildscripts/resmokelib/testing/job.py", line 129, in _run self._execute_test(test, hook_failure_flag) File "/data/mci/30320058e4874c11dcc4cc0e4863c7e6/src/buildscripts/resmokelib/testing/job.py", line 175, in _execute_test raise test.propagate_error File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 59, in testPartExecutor yield File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 591, in run self._callTestMethod(testMethod) File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 549, in _callTestMethod method() File "/data/mci/30320058e4874c11dcc4cc0e4863c7e6/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 259, in run_test self._run_single_copy() File "/data/mci/30320058e4874c11dcc4cc0e4863c7e6/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 214, in _run_single_copy self._raise_if_unsafe_exit(self.return_code) File "/data/mci/30320058e4874c11dcc4cc0e4863c7e6/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 277, in _raise_if_unsafe_exit raise self.propagate_error # pylint: disable=raising-bad-type buildscripts.resmokelib.errors.UnsafeExitError: Mongo shell exited with code -9 while running jstest resharding_replicate_updates_as_insert_delete.js. Further test execution may be unsafe. Traceback (most recent call last): File "/data/mci/30320058e4874c11dcc4cc0e4863c7e6/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 210, in _run_single_copy test_case.run_test() File "/data/mci/30320058e4874c11dcc4cc0e4863c7e6/src/buildscripts/resmokelib/testing/testcases/interface.py", line 137, in run_test self._execute(proc) File "/data/mci/30320058e4874c11dcc4cc0e4863c7e6/src/buildscripts/resmokelib/testing/testcases/interface.py", line 158, in _execute raise self.failureException("%s failed" % (self.short_description())) AssertionError: JSTest jstests/sharding/internal_txns/non_retryable_writes_during_resharding.js failed Traceback (most recent call last): File "/data/mci/30320058e4874c11dcc4cc0e4863c7e6/src/buildscripts/resmokelib/testing/job.py", line 83, in __call__ self._run(queue, interrupt_flag, teardown_flag, hook_failure_flag) File "/data/mci/30320058e4874c11dcc4cc0e4863c7e6/src/buildscripts/resmokelib/testing/job.py", line 129, in _run self._execute_test(test, hook_failure_flag) File "/data/mci/30320058e4874c11dcc4cc0e4863c7e6/src/buildscripts/resmokelib/testing/job.py", line 175, in _execute_test raise test.propagate_error File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 59, in testPartExecutor yield File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 591, in run self._callTestMethod(testMethod) File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 549, in _callTestMethod method() File "/data/mci/30320058e4874c11dcc4cc0e4863c7e6/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 259, in run_test self._run_single_copy() File "/data/mci/30320058e4874c11dcc4cc0e4863c7e6/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 214, in _run_single_copy self._raise_if_unsafe_exit(self.return_code) File "/data/mci/30320058e4874c11dcc4cc0e4863c7e6/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 277, in _raise_if_unsafe_exit raise self.propagate_error # pylint: disable=raising-bad-type buildscripts.resmokelib.errors.UnsafeExitError: Mongo shell exited with code -9 while running jstest non_retryable_writes_during_resharding.js. Further test execution may be unsafe. Traceback (most recent call last): File "/data/mci/30320058e4874c11dcc4cc0e4863c7e6/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 210, in _run_single_copy test_case.run_test() File "/data/mci/30320058e4874c11dcc4cc0e4863c7e6/src/buildscripts/resmokelib/testing/testcases/interface.py", line 137, in run_test self._execute(proc) File "/data/mci/30320058e4874c11dcc4cc0e4863c7e6/src/buildscripts/resmokelib/testing/testcases/interface.py", line 158, in _execute raise self.failureException("%s failed" % (self.short_description())) AssertionError: JSTest jstests/sharding/internal_txns/non_retryable_writes_during_resharding.js failed Traceback (most recent call last): File "/data/mci/30320058e4874c11dcc4cc0e4863c7e6/src/buildscripts/resmokelib/testing/job.py", line 83, in __call__ self._run(queue, interrupt_flag, teardown_flag, hook_failure_flag) File "/data/mci/30320058e4874c11dcc4cc0e4863c7e6/src/buildscripts/resmokelib/testing/job.py", line 129, in _run self._execute_test(test, hook_failure_flag) File "/data/mci/30320058e4874c11dcc4cc0e4863c7e6/src/buildscripts/resmokelib/testing/job.py", line 175, in _execute_test raise test.propagate_error File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 59, in testPartExecutor yield File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 591, in run self._callTestMethod(testMethod) File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 549, in _callTestMethod method() File "/data/mci/30320058e4874c11dcc4cc0e4863c7e6/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 259, in run_test self._run_single_copy() File "/data/mci/30320058e4874c11dcc4cc0e4863c7e6/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 214, in _run_single_copy self._raise_if_unsafe_exit(self.return_code) File "/data/mci/30320058e4874c11dcc4cc0e4863c7e6/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 277, in _raise_if_unsafe_exit raise self.propagate_error # pylint: disable=raising-bad-type buildscripts.resmokelib.errors.UnsafeExitError: Mongo shell exited with code -9 while running jstest non_retryable_writes_during_resharding.js. Further test execution may be unsafe. logs pTrace Operation error Logs: expansions.update' in function 'set task expansion macros expansions.write' in function 'f_expansions_write expansions.write' in function 'git get project no modules git.get_project' in function 'git get project no modules subprocess.exec' in function 'add git tag expansions.write' in function 'do setup s3.get' in function 'do setup subprocess.exec' in function 'do setup keyval.inc' in function 'do setup subprocess.exec' in function 'configure evergreen api credentials expansions.write' in function 'do multiversion setup subprocess.exec' in function 'do multiversion setup expansions.write' in function 'run generated tests s3.get' in function 'run generated tests subprocess.exec' in function 'run generated tests expansions.update' in function 'run generated tests timeout.update' in function 'run generated tests expansions.write' in function 'upload npm logs subprocess.exec' in function 'upload npm logs archive.targz_pack' in function 'upload npm logs s3.put' in function 'upload npm logs s3.put' in function 'attach local resmoke invocation attach.results' in function 'attach report attach.artifacts' in function 'attach artifacts expansions.write' in function 'save ec2 task artifacts subprocess.exec' in function 'save ec2 task artifacts s3.put' in function 'save ec2 task artifacts expansions.write' in function 'attach wiki page subprocess.exec' in function 'attach wiki page attach.artifacts' in function 'attach wiki page s3.put' in function 'upload jstestfuzz minimized output expansions.write' in function 'upload jstestfuzz minimized output subprocess.exec' in function 'upload jstestfuzz minimized output attach.artifacts' in function 'upload jstestfuzz minimized output subprocess.exec' in function 'kill processes expansions.write' in function 'save local client logs subprocess.exec' in function 'save local client logs s3.put' in function 'save local client logs expansions.write' in function 'save code coverage data subprocess.exec' in function 'save code coverage data archive.targz_pack' in function 'save code coverage data s3.put' in function 'save code coverage data archive.targz_pack' in function 'save jepsen artifacts s3.put' in function 'save jepsen artifacts archive.targz_pack' in function 'save blackduck artifacts s3.put' in function 'save blackduck artifacts expansions.write' in function 'save mongo coredumps subprocess.exec' in function 'save mongo coredumps archive.targz_pack' in function 'save mongo coredumps logs pTrace Operation error Logs: expansions.write' in function 'f_expansions_write expansions.write' in function 'run hang analyzer subprocess.exec' in function 'run hang analyzer subprocess.exec' in function 'wait for resmoke to shutdown logs Agent Log Assertion Extractor Logs: Hit exec timeout (1h20m0s). logs pTrace Operation error Logs: ptrace: Operation not permitted. logs pTrace Operation error Logs: ptrace: Operation not permitted. logs pTrace Operation error Logs: Traceback (most recent call last): File "buildscripts/gdb/mongo.py", line 574, in invoke main_binary_name = get_process_name() File "buildscripts/gdb/mongo.py", line 137, in get_process_name main_binary_name = gdb.objfiles()[0].filename IndexError: list index out of range Traceback (most recent call last): File "buildscripts/gdb/mongo.py", line 879, in invoke main_binary_name = get_process_name() File "buildscripts/gdb/mongo.py", line 137, in get_process_name main_binary_name = gdb.objfiles()[0].filename IndexError: list index out of range Traceback (most recent call last): File "buildscripts/gdb/mongo.py", line 400, in invoke session_catalog = get_session_catalog() File "buildscripts/gdb/mongo.py", line 186, in get_session_catalog session_catalog_dec = get_decoration(get_global_service_context(), "mongo::SessionCatalog") File "buildscripts/gdb/mongo.py", line 177, in get_global_service_context return gdb.parse_and_eval("'mongo::(anonymous namespace)::globalServiceContext'").dereference() Traceback (most recent call last): File "buildscripts/gdb/mongo.py", line 528, in invoke service_context = get_global_service_context() File "buildscripts/gdb/mongo.py", line 177, in get_global_service_context return gdb.parse_and_eval("'mongo::(anonymous namespace)::globalServiceContext'").dereference() Traceback (most recent call last): File "buildscripts/gdb/mongo.py", line 614, in invoke main_binary_name = get_process_name() File "buildscripts/gdb/mongo.py", line 137, in get_process_name main_binary_name = gdb.objfiles()[0].filename IndexError: list index out of range Traceback (most recent call last): File "buildscripts/gdb/mongo.py", line 723, in invoke main_binary_name = get_process_name() File "buildscripts/gdb/mongo.py", line 137, in get_process_name main_binary_name = gdb.objfiles()[0].filename IndexError: list index out of range Traceback (most recent call last): File "/data/mci/92dcc8f355c8c5092ea0e80d15e41a97/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 210, in _run_single_copy test_case.run_test() File "/data/mci/92dcc8f355c8c5092ea0e80d15e41a97/src/buildscripts/resmokelib/testing/testcases/interface.py", line 137, in run_test self._execute(proc) File "/data/mci/92dcc8f355c8c5092ea0e80d15e41a97/src/buildscripts/resmokelib/testing/testcases/interface.py", line 158, in _execute raise self.failureException("%s failed" % (self.short_description())) AssertionError: JSTest jstests/sharding/internal_txns/retryable_writes_committed_during_resharding.js failed Traceback (most recent call last): File "/data/mci/92dcc8f355c8c5092ea0e80d15e41a97/src/buildscripts/resmokelib/testing/job.py", line 83, in __call__ self._run(queue, interrupt_flag, teardown_flag, hook_failure_flag) File "/data/mci/92dcc8f355c8c5092ea0e80d15e41a97/src/buildscripts/resmokelib/testing/job.py", line 129, in _run self._execute_test(test, hook_failure_flag) File "/data/mci/92dcc8f355c8c5092ea0e80d15e41a97/src/buildscripts/resmokelib/testing/job.py", line 175, in _execute_test raise test.propagate_error File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 59, in testPartExecutor yield File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 591, in run self._callTestMethod(testMethod) File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 549, in _callTestMethod method() File "/data/mci/92dcc8f355c8c5092ea0e80d15e41a97/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 259, in run_test self._run_single_copy() File "/data/mci/92dcc8f355c8c5092ea0e80d15e41a97/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 214, in _run_single_copy self._raise_if_unsafe_exit(self.return_code) File "/data/mci/92dcc8f355c8c5092ea0e80d15e41a97/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 277, in _raise_if_unsafe_exit raise self.propagate_error # pylint: disable=raising-bad-type buildscripts.resmokelib.errors.UnsafeExitError: Mongo shell exited with code -9 while running jstest retryable_writes_committed_during_resharding.js. Further test execution may be unsafe. Traceback (most recent call last): File "/data/mci/92dcc8f355c8c5092ea0e80d15e41a97/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 210, in _run_single_copy test_case.run_test() File "/data/mci/92dcc8f355c8c5092ea0e80d15e41a97/src/buildscripts/resmokelib/testing/testcases/interface.py", line 137, in run_test self._execute(proc) File "/data/mci/92dcc8f355c8c5092ea0e80d15e41a97/src/buildscripts/resmokelib/testing/testcases/interface.py", line 158, in _execute raise self.failureException("%s failed" % (self.short_description())) AssertionError: JSTest jstests/sharding/internal_txns/retryable_writes_committed_during_resharding.js failed Traceback (most recent call last): File "/data/mci/92dcc8f355c8c5092ea0e80d15e41a97/src/buildscripts/resmokelib/testing/job.py", line 83, in __call__ self._run(queue, interrupt_flag, teardown_flag, hook_failure_flag) File "/data/mci/92dcc8f355c8c5092ea0e80d15e41a97/src/buildscripts/resmokelib/testing/job.py", line 129, in _run self._execute_test(test, hook_failure_flag) File "/data/mci/92dcc8f355c8c5092ea0e80d15e41a97/src/buildscripts/resmokelib/testing/job.py", line 175, in _execute_test raise test.propagate_error File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 59, in testPartExecutor yield File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 591, in run self._callTestMethod(testMethod) File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 549, in _callTestMethod method() File "/data/mci/92dcc8f355c8c5092ea0e80d15e41a97/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 259, in run_test self._run_single_copy() File "/data/mci/92dcc8f355c8c5092ea0e80d15e41a97/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 214, in _run_single_copy self._raise_if_unsafe_exit(self.return_code) File "/data/mci/92dcc8f355c8c5092ea0e80d15e41a97/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 277, in _raise_if_unsafe_exit raise self.propagate_error # pylint: disable=raising-bad-type buildscripts.resmokelib.errors.UnsafeExitError: Mongo shell exited with code -9 while running jstest retryable_writes_committed_during_resharding.js. Further test execution may be unsafe. logs pTrace Operation error Logs: expansions.update' in function 'set task expansion macros expansions.write' in function 'f_expansions_write expansions.write' in function 'git get project no modules git.get_project' in function 'git get project no modules subprocess.exec' in function 'add git tag expansions.write' in function 'do setup s3.get' in function 'do setup subprocess.exec' in function 'do setup keyval.inc' in function 'do setup subprocess.exec' in function 'configure evergreen api credentials expansions.write' in function 'do multiversion setup subprocess.exec' in function 'do multiversion setup expansions.write' in function 'run generated tests s3.get' in function 'run generated tests subprocess.exec' in function 'run generated tests expansions.update' in function 'run generated tests timeout.update' in function 'run generated tests expansions.write' in function 'upload npm logs subprocess.exec' in function 'upload npm logs archive.targz_pack' in function 'upload npm logs s3.put' in function 'upload npm logs s3.put' in function 'attach local resmoke invocation attach.results' in function 'attach report attach.artifacts' in function 'attach artifacts expansions.write' in function 'save ec2 task artifacts subprocess.exec' in function 'save ec2 task artifacts s3.put' in function 'save ec2 task artifacts expansions.write' in function 'attach wiki page subprocess.exec' in function 'attach wiki page attach.artifacts' in function 'attach wiki page s3.put' in function 'upload jstestfuzz minimized output expansions.write' in function 'upload jstestfuzz minimized output subprocess.exec' in function 'upload jstestfuzz minimized output attach.artifacts' in function 'upload jstestfuzz minimized output subprocess.exec' in function 'kill processes expansions.write' in function 'save local client logs subprocess.exec' in function 'save local client logs s3.put' in function 'save local client logs expansions.write' in function 'save code coverage data subprocess.exec' in function 'save code coverage data archive.targz_pack' in function 'save code coverage data s3.put' in function 'save code coverage data archive.targz_pack' in function 'save jepsen artifacts s3.put' in function 'save jepsen artifacts archive.targz_pack' in function 'save blackduck artifacts s3.put' in function 'save blackduck artifacts expansions.write' in function 'save mongo coredumps subprocess.exec' in function 'save mongo coredumps archive.targz_pack' in function 'save mongo coredumps s3.put' in function 'save mongo coredumps logs pTrace Operation error Logs: expansions.write' in function 'f_expansions_write expansions.write' in function 'run hang analyzer subprocess.exec' in function 'run hang analyzer subprocess.exec' in function 'wait for resmoke to shutdown logs xgen-buildbaron-user commented on Fri, 10 Feb 2023 22:16:59 +0000: logs Task Log Assertion Extractor Logs: expansions.update' in function 'set task expansion macros expansions.write' in function 'f_expansions_write expansions.write' in function 'git get project no modules git.get_project' in function 'git get project no modules subprocess.exec' in function 'add git tag expansions.write' in function 'do setup s3.get' in function 'do setup subprocess.exec' in function 'do setup keyval.inc' in function 'do setup subprocess.exec' in function 'configure evergreen api credentials expansions.write' in function 'do multiversion setup subprocess.exec' in function 'do multiversion setup expansions.write' in function 'run generated tests s3.get' in function 'run generated tests subprocess.exec' in function 'run generated tests expansions.update' in function 'run generated tests timeout.update' in function 'run generated tests logs Agent Log Assertion Extractor Logs: Hit exec timeout (1h20m0s). logs Task Log Assertion Extractor Logs: er test execution may be unsafe. Traceback (most recent call last): File "/data/mci/979ab9667c6bae395d23d9ca4f74c648/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 210, in _run_single_copy test_case.run_test() File "/data/mci/979ab9667c6bae395d23d9ca4f74c648/src/buildscripts/resmokelib/testing/testcases/interface.py", line 137, in run_test self._execute(proc) File "/data/mci/979ab9667c6bae395d23d9ca4f74c648/src/buildscripts/resmokelib/testing/testcases/interface.py", line 158, in _execute raise self.failureException("%s failed" % (self.short_description())) AssertionError: JSTest jstests/sharding/read_does_not_create_namespaces.js failed Traceback (most recent call last): File "/data/mci/979ab9667c6bae395d23d9ca4f74c648/src/buildscripts/resmokelib/testing/job.py", line 83, in __call__ self._run(queue, interrupt_flag, teardown_flag, hook_failure_flag) File "/data/mci/979ab9667c6bae395d23d9ca4f74c648/src/buildscripts/resmokelib/testing/job.py", line 129, in _run self._execute_test(test, hook_failure_flag) File "/data/mci/979ab9667c6bae395d23d9ca4f74c648/src/buildscripts/resmokelib/testing/job.py", line 175, in _execute_test raise test.propagate_error File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 59, in testPartExecutor yield File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 591, in run self._callTestMethod(testMethod) File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 549, in _callTestMethod method() File "/data/mci/979ab9667c6bae395d23d9ca4f74c648/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 259, in run_test self._run_single_copy() File "/data/mci/979ab9667c6bae395d23d9ca4f74c648/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 214, in _run_single_copy self._raise_if_unsafe_exit(self.return_code) File "/data/mci/979ab9667c6bae395d23d9ca4f74c648/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 277, in _raise_if_unsafe_exit raise self.propagate_error # pylint: disable=raising-bad-type buildscripts.resmokelib.errors.UnsafeExitError: Mongo shell exited with code -9 while running jstest read_does_not_create_namespaces.js. Further test execution may be unsafe. Traceback (most recent call last): File "/data/mci/979ab9667c6bae395d23d9ca4f74c648/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 210, in _run_single_copy test_case.run_test() File "/data/mci/979ab9667c6bae395d23d9ca4f74c648/src/buildscripts/resmokelib/testing/testcases/interface.py", line 137, in run_test self._execute(proc) File "/data/mci/979ab9667c6bae395d23d9ca4f74c648/src/buildscripts/resmokelib/testing/testcases/interface.py", line 158, in _execute raise self.failureException("%s failed" % (self.short_description())) AssertionError: JSTest jstests/sharding/read_does_not_create_namespaces.js failed Traceback (most recent call last): File "/data/mci/979ab9667c6bae395d23d9ca4f74c648/src/buildscripts/resmokelib/testing/job.py", line 83, in __call__ self._run(queue, interrupt_flag, teardown_flag, hook_failure_flag) File "/data/mci/979ab9667c6bae395d23d9ca4f74c648/src/buildscripts/resmokelib/testing/job.py", line 129, in _run self._execute_test(test, hook_failure_flag) File "/data/mci/979ab9667c6bae395d23d9ca4f74c648/src/buildscripts/resmokelib/testing/job.py", line 175, in _execute_test raise test.propagate_error File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 59, in testPartExecutor yield File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 591, in run self._callTestMethod(testMethod) File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 549, in _callTestMethod method() File "/data/mci/979ab9667c6bae395d23d9ca4f74c648/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 259, in run_test self._run_single_copy() File "/data/mci/979ab9667c6bae395d23d9ca4f74c648/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 214, in _run_single_copy self._raise_if_unsafe_exit(self.return_code) File "/data/mci/979ab9667c6bae395d23d9ca4f74c648/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 277, in _raise_if_unsafe_exit raise self.propagate_error # pylint: disable=raising-bad-type buildscripts.resmokelib.errors.UnsafeExitError: Mongo shell exited with code -9 while running jstest read_does_not_create_namespaces.js. Further test execution may be unsafe. Traceback (most recent call last): File "/data/mci/979ab9667c6bae395d23d9ca4f74c648/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 210, in _run_single_copy test_case.run_test() File "/data/mci/979ab9667c6bae395d23d9ca4f74c648/src/buildscripts/resmokelib/testing/testcases/interface.py", line 137, in run_test self._execute(proc) File "/data/mci/979ab9667c6bae395d23d9ca4f74c648/src/buildscripts/resmokelib/testing/testcases/interface.py", line 158, in _execute raise self.failureException("%s failed" % (self.short_description())) AssertionError: JSTest jstests/sharding/internal_txns/retryable_findAndModify_committed_during_resharding_oplog.js failed Traceback (most recent call last): File "/data/mci/979ab9667c6bae395d23d9ca4f74c648/src/buildscripts/resmokelib/testing/job.py", line 83, in __call__ self._run(queue, interrupt_flag, teardown_flag, hook_failure_flag) File "/data/mci/979ab9667c6bae395d23d9ca4f74c648/src/buildscripts/resmokelib/testing/job.py", line 129, in _run self._execute_test(test, hook_failure_flag) File "/data/mci/979ab9667c6bae395d23d9ca4f74c648/src/buildscripts/resmokelib/testing/job.py", line 175, in _execute_test raise test.propagate_error File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 59, in testPartExecutor yield File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 591, in run self._callTestMethod(testMethod) File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 549, in _callTestMethod method() File "/data/mci/979ab9667c6bae395d23d9ca4f74c648/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 259, in run_test self._run_single_copy() File "/data/mci/979ab9667c6bae395d23d9ca4f74c648/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 214, in _run_single_copy self._raise_if_unsafe_exit(self.return_code) File "/data/mci/979ab9667c6bae395d23d9ca4f74c648/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 277, in _raise_if_unsafe_exit raise self.propagate_error # pylint: disable=raising-bad-type buildscripts.resmokelib.errors.UnsafeExitError: Mongo shell exited with code -9 while running jstest retryable_findAndModify_committed_during_resharding_oplog.js. Further test execution may be unsafe. Traceback (most recent call last): File "/data/mci/979ab9667c6bae395d23d9ca4f74c648/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 210, in _run_single_copy test_case.run_test() File "/data/mci/979ab9667c6bae395d23d9ca4f74c648/src/buildscripts/resmokelib/testing/testcases/interface.py", line 137, in run_test self._execute(proc) File "/data/mci/979ab9667c6bae395d23d9ca4f74c648/src/buildscripts/resmokelib/testing/testcases/interface.py", line 158, in _execute raise self.failureException("%s failed" % (self.short_description())) AssertionError: JSTest jstests/sharding/internal_txns/retryable_findAndModify_committed_during_resharding_oplog.js failed Traceback (most recent call last): File "/data/mci/979ab9667c6bae395d23d9ca4f74c648/src/buildscripts/resmokelib/testing/job.py", line 83, in __call__ self._run(queue, interrupt_flag, teardown_flag, hook_failure_flag) File "/data/mci/979ab9667c6bae395d23d9ca4f74c648/src/buildscripts/resmokelib/testing/job.py", line 129, in _run self._execute_test(test, hook_failure_flag) File "/data/mci/979ab9667c6bae395d23d9ca4f74c648/src/buildscripts/resmokelib/testing/job.py", line 175, in _execute_test raise test.propagate_error File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 59, in testPartExecutor yield File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 591, in run self._callTestMethod(testMethod) File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 549, in _callTestMethod method() File "/data/mci/979ab9667c6bae395d23d9ca4f74c648/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 259, in run_test self._run_single_copy() File "/data/mci/979ab9667c6bae395d23d9ca4f74c648/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 214, in _run_single_copy self._raise_if_unsafe_exit(self.return_code) File "/data/mci/979ab9667c6bae395d23d9ca4f74c648/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 277, in _raise_if_unsafe_exit raise self.propagate_error # pylint: disable=raising-bad-type buildscripts.resmokelib.errors.UnsafeExitError: Mongo shell exited with code -9 while running jstest retryable_findAndModify_committed_during_resharding_oplog.js. Further test execution may be unsafe. logs Task Log Assertion Extractor Logs: expansions.update' in function 'set task expansion macros expansions.write' in function 'f_expansions_write expansions.write' in function 'git get project no modules git.get_project' in function 'git get project no modules subprocess.exec' in function 'add git tag expansions.write' in function 'do setup s3.get' in function 'do setup subprocess.exec' in function 'do setup keyval.inc' in function 'do setup subprocess.exec' in function 'configure evergreen api credentials expansions.write' in function 'do multiversion setup subprocess.exec' in function 'do multiversion setup expansions.write' in function 'run generated tests s3.get' in function 'run generated tests subprocess.exec' in function 'run generated tests expansions.update' in function 'run generated tests timeout.update' in function 'run generated tests expansions.write' in function 'upload npm logs subprocess.exec' in function 'upload npm logs archive.targz_pack' in function 'upload npm logs s3.put' in function 'upload npm logs s3.put' in function 'attach local resmoke invocation attach.results' in function 'attach report attach.artifacts' in function 'attach artifacts expansions.write' in function 'save ec2 task artifacts subprocess.exec' in function 'save ec2 task artifacts s3.put' in function 'save ec2 task artifacts expansions.write' in function 'attach wiki page subprocess.exec' in function 'attach wiki page attach.artifacts' in function 'attach wiki page s3.put' in function 'upload jstestfuzz minimized output expansions.write' in function 'upload jstestfuzz minimized output subprocess.exec' in function 'upload jstestfuzz minimized output attach.artifacts' in function 'upload jstestfuzz minimized output subprocess.exec' in function 'kill processes expansions.write' in function 'save local client logs subprocess.exec' in function 'save local client logs s3.put' in function 'save local client logs expansions.write' in function 'save code coverage data subprocess.exec' in function 'save code coverage data archive.targz_pack' in function 'save code coverage data s3.put' in function 'save code coverage data archive.targz_pack' in function 'save jepsen artifacts s3.put' in function 'save jepsen artifacts archive.targz_pack' in function 'save blackduck artifacts s3.put' in function 'save blackduck artifacts expansions.write' in function 'save mongo coredumps subprocess.exec' in function 'save mongo coredumps archive.targz_pack' in function 'save mongo coredumps logs Task Log Assertion Extractor Logs: expansions.write' in function 'f_expansions_write expansions.write' in function 'run hang analyzer subprocess.exec' in function 'run hang analyzer subprocess.exec' in function 'wait for resmoke to shutdown logs Agent Log Assertion Extractor Logs: Hit exec timeout (1h20m0s). logs pTrace Operation error Logs: ptrace: Operation not permitted. logs pTrace Operation error Logs: ptrace: Operation not permitted. logs pTrace Operation error Logs: UnsafeExitError: Mongo shell exited with code -9 while running jstest resharding_min_fetch_ts_with_txn.js. Further test execution may be unsafe. Traceback (most recent call last): File "/data/mci/8f4cb354067d8cdfdb2974d535403616/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 210, in _run_single_copy test_case.run_test() File "/data/mci/8f4cb354067d8cdfdb2974d535403616/src/buildscripts/resmokelib/testing/testcases/interface.py", line 137, in run_test self._execute(proc) File "/data/mci/8f4cb354067d8cdfdb2974d535403616/src/buildscripts/resmokelib/testing/testcases/interface.py", line 158, in _execute raise self.failureException("%s failed" % (self.short_description())) AssertionError: JSTest jstests/sharding/reshard_collection_joins_existing_operation.js failed Traceback (most recent call last): File "/data/mci/8f4cb354067d8cdfdb2974d535403616/src/buildscripts/resmokelib/testing/job.py", line 83, in __call__ self._run(queue, interrupt_flag, teardown_flag, hook_failure_flag) File "/data/mci/8f4cb354067d8cdfdb2974d535403616/src/buildscripts/resmokelib/testing/job.py", line 129, in _run self._execute_test(test, hook_failure_flag) File "/data/mci/8f4cb354067d8cdfdb2974d535403616/src/buildscripts/resmokelib/testing/job.py", line 175, in _execute_test raise test.propagate_error File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 59, in testPartExecutor yield File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 591, in run self._callTestMethod(testMethod) File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 549, in _callTestMethod method() File "/data/mci/8f4cb354067d8cdfdb2974d535403616/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 259, in run_test self._run_single_copy() File "/data/mci/8f4cb354067d8cdfdb2974d535403616/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 214, in _run_single_copy self._raise_if_unsafe_exit(self.return_code) File "/data/mci/8f4cb354067d8cdfdb2974d535403616/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 277, in _raise_if_unsafe_exit raise self.propagate_error # pylint: disable=raising-bad-type buildscripts.resmokelib.errors.UnsafeExitError: Mongo shell exited with code -9 while running jstest reshard_collection_joins_existing_operation.js. Further test execution may be unsafe. Traceback (most recent call last): File "/data/mci/8f4cb354067d8cdfdb2974d535403616/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 210, in _run_single_copy test_case.run_test() File "/data/mci/8f4cb354067d8cdfdb2974d535403616/src/buildscripts/resmokelib/testing/testcases/interface.py", line 137, in run_test self._execute(proc) File "/data/mci/8f4cb354067d8cdfdb2974d535403616/src/buildscripts/resmokelib/testing/testcases/interface.py", line 158, in _execute raise self.failureException("%s failed" % (self.short_description())) AssertionError: JSTest jstests/sharding/reshard_collection_joins_existing_operation.js failed Traceback (most recent call last): File "/data/mci/8f4cb354067d8cdfdb2974d535403616/src/buildscripts/resmokelib/testing/job.py", line 83, in __call__ self._run(queue, interrupt_flag, teardown_flag, hook_failure_flag) File "/data/mci/8f4cb354067d8cdfdb2974d535403616/src/buildscripts/resmokelib/testing/job.py", line 129, in _run self._execute_test(test, hook_failure_flag) File "/data/mci/8f4cb354067d8cdfdb2974d535403616/src/buildscripts/resmokelib/testing/job.py", line 175, in _execute_test raise test.propagate_error File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 59, in testPartExecutor yield File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 591, in run self._callTestMethod(testMethod) File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 549, in _callTestMethod method() File "/data/mci/8f4cb354067d8cdfdb2974d535403616/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 259, in run_test self._run_single_copy() File "/data/mci/8f4cb354067d8cdfdb2974d535403616/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 214, in _run_single_copy self._raise_if_unsafe_exit(self.return_code) File "/data/mci/8f4cb354067d8cdfdb2974d535403616/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 277, in _raise_if_unsafe_exit raise self.propagate_error # pylint: disable=raising-bad-type buildscripts.resmokelib.errors.UnsafeExitError: Mongo shell exited with code -9 while running jstest reshard_collection_joins_existing_operation.js. Further test execution may be unsafe. Traceback (most recent call last): File "/data/mci/8f4cb354067d8cdfdb2974d535403616/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 210, in _run_single_copy test_case.run_test() File "/data/mci/8f4cb354067d8cdfdb2974d535403616/src/buildscripts/resmokelib/testing/testcases/interface.py", line 137, in run_test self._execute(proc) File "/data/mci/8f4cb354067d8cdfdb2974d535403616/src/buildscripts/resmokelib/testing/testcases/interface.py", line 158, in _execute raise self.failureException("%s failed" % (self.short_description())) AssertionError: JSTest jstests/sharding/query/comment_field_sharded.js failed Traceback (most recent call last): File "/data/mci/8f4cb354067d8cdfdb2974d535403616/src/buildscripts/resmokelib/testing/job.py", line 83, in __call__ self._run(queue, interrupt_flag, teardown_flag, hook_failure_flag) File "/data/mci/8f4cb354067d8cdfdb2974d535403616/src/buildscripts/resmokelib/testing/job.py", line 129, in _run self._execute_test(test, hook_failure_flag) File "/data/mci/8f4cb354067d8cdfdb2974d535403616/src/buildscripts/resmokelib/testing/job.py", line 175, in _execute_test raise test.propagate_error File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 59, in testPartExecutor yield File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 591, in run self._callTestMethod(testMethod) File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 549, in _callTestMethod method() File "/data/mci/8f4cb354067d8cdfdb2974d535403616/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 259, in run_test self._run_single_copy() File "/data/mci/8f4cb354067d8cdfdb2974d535403616/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 214, in _run_single_copy self._raise_if_unsafe_exit(self.return_code) File "/data/mci/8f4cb354067d8cdfdb2974d535403616/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 277, in _raise_if_unsafe_exit raise self.propagate_error # pylint: disable=raising-bad-type buildscripts.resmokelib.errors.UnsafeExitError: Mongo shell exited with code -9 while running jstest comment_field_sharded.js. Further test execution may be unsafe. Traceback (most recent call last): File "/data/mci/8f4cb354067d8cdfdb2974d535403616/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 210, in _run_single_copy test_case.run_test() File "/data/mci/8f4cb354067d8cdfdb2974d535403616/src/buildscripts/resmokelib/testing/testcases/interface.py", line 137, in run_test self._execute(proc) File "/data/mci/8f4cb354067d8cdfdb2974d535403616/src/buildscripts/resmokelib/testing/testcases/interface.py", line 158, in _execute raise self.failureException("%s failed" % (self.short_description())) AssertionError: JSTest jstests/sharding/query/comment_field_sharded.js failed Traceback (most recent call last): File "/data/mci/8f4cb354067d8cdfdb2974d535403616/src/buildscripts/resmokelib/testing/job.py", line 83, in __call__ self._run(queue, interrupt_flag, teardown_flag, hook_failure_flag) File "/data/mci/8f4cb354067d8cdfdb2974d535403616/src/buildscripts/resmokelib/testing/job.py", line 129, in _run self._execute_test(test, hook_failure_flag) File "/data/mci/8f4cb354067d8cdfdb2974d535403616/src/buildscripts/resmokelib/testing/job.py", line 175, in _execute_test raise test.propagate_error File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 59, in testPartExecutor yield File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 591, in run self._callTestMethod(testMethod) File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 549, in _callTestMethod method() File "/data/mci/8f4cb354067d8cdfdb2974d535403616/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 259, in run_test self._run_single_copy() File "/data/mci/8f4cb354067d8cdfdb2974d535403616/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 214, in _run_single_copy self._raise_if_unsafe_exit(self.return_code) File "/data/mci/8f4cb354067d8cdfdb2974d535403616/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 277, in _raise_if_unsafe_exit raise self.propagate_error # pylint: disable=raising-bad-type buildscripts.resmokelib.errors.UnsafeExitError: Mongo shell exited with code -9 while running jstest comment_field_sharded.js. Further test execution may be unsafe. logs pTrace Operation error Logs: expansions.update' in function 'set task expansion macros expansions.write' in function 'f_expansions_write expansions.write' in function 'git get project no modules git.get_project' in function 'git get project no modules subprocess.exec' in function 'add git tag expansions.write' in function 'do setup s3.get' in function 'do setup subprocess.exec' in function 'do setup keyval.inc' in function 'do setup subprocess.exec' in function 'configure evergreen api credentials expansions.write' in function 'do multiversion setup subprocess.exec' in function 'do multiversion setup expansions.write' in function 'run generated tests s3.get' in function 'run generated tests subprocess.exec' in function 'run generated tests expansions.update' in function 'run generated tests timeout.update' in function 'run generated tests expansions.write' in function 'upload npm logs subprocess.exec' in function 'upload npm logs archive.targz_pack' in function 'upload npm logs s3.put' in function 'upload npm logs s3.put' in function 'attach local resmoke invocation attach.results' in function 'attach report attach.artifacts' in function 'attach artifacts expansions.write' in function 'save ec2 task artifacts subprocess.exec' in function 'save ec2 task artifacts s3.put' in function 'save ec2 task artifacts expansions.write' in function 'attach wiki page subprocess.exec' in function 'attach wiki page attach.artifacts' in function 'attach wiki page s3.put' in function 'upload jstestfuzz minimized output expansions.write' in function 'upload jstestfuzz minimized output subprocess.exec' in function 'upload jstestfuzz minimized output attach.artifacts' in function 'upload jstestfuzz minimized output subprocess.exec' in function 'kill processes expansions.write' in function 'save local client logs subprocess.exec' in function 'save local client logs s3.put' in function 'save local client logs expansions.write' in function 'save code coverage data subprocess.exec' in function 'save code coverage data archive.targz_pack' in function 'save code coverage data s3.put' in function 'save code coverage data archive.targz_pack' in function 'save jepsen artifacts s3.put' in function 'save jepsen artifacts archive.targz_pack' in function 'save blackduck artifacts s3.put' in function 'save blackduck artifacts expansions.write' in function 'save mongo coredumps subprocess.exec' in function 'save mongo coredumps archive.targz_pack' in function 'save mongo coredumps logs pTrace Operation error Logs: expansions.write' in function 'f_expansions_write expansions.write' in function 'run hang analyzer subprocess.exec' in function 'run hang analyzer subprocess.exec' in function 'wait for resmoke to shutdown xgen-buildbaron-user commented on Fri, 10 Feb 2023 22:16:57 +0000: om/mongodb/mongo/blob/1049af0cf89571f65cf9a22dfe75119b9059d785/jstests/sharding/reshard_collection_existing_sk_index_not_duplicated.js] resharding_write_when_temp_ns_routing_info_unknown.js - Logs | History | GitHub sharded_lookup_execution.js - Logs | History | GitHub unionWith_current_op.js - Logs | History | GitHub agg_mongos_merge.js - Logs | History | GitHub resharding_large_number_of_initial_chunks.js - Logs | History | GitHub now_variable_sharding.js - Logs | History | GitHub non_retryable_writes_before_resharding.js - Logs | History | GitHub comment_field_sharded.js - Logs | History | GitHub change_stream_lookup_preimage_with_resharding.js - Logs | History | GitHub reshard_collection_joins_existing_operation.js - Logs | History | GitHub reshard_collection_basic.js - Logs | History | GitHub union_sharded_views.js - Logs | History | GitHub resharding_replicate_updates_as_insert_delete.js - Logs | History | GitHub resharding_secondary_recovers_temp_ns_metadata.js - Logs | History | GitHub resharding_clones_initial_data.js - Logs | History | GitHub resharding_nonblocking_coordinator_rebuild.js - Logs | History | GitHub lookup_on_shard.js - Logs | History | GitHub resharding_txn_cloner.js - Logs | History | GitHub resharding_collection_cloner_resuming.js - Logs | History | GitHub lookup_mongod_unaware.js - Logs | History | GitHub lookup_read_preference.js - Logs | History | GitHub collation_lookup.js - Logs | History | GitHub resharding_collection_cloner.js - Logs | History | GitHub non_retryable_writes_during_resharding.js - Logs | History | GitHub Task Logs: task sharding_last_continuous_0-linux-enterprise task sharding_last_continuous_1-linux-enterprise task sharding_last_continuous_2-linux-enterprise task sharding_last_continuous_3-linux-enterprise task sharding_last_continuous_4-linux-enterprise task sharding_last_lts_0-linux-enterprise task sharding_last_lts_1-linux-enterprise task sharding_last_lts_2-linux-enterprise task sharding_last_lts_3-linux-enterprise task sharding_last_lts_4-linux-enterprise Agent Log Assertion Extractor Logs: Hit exec timeout (1h20m0s). logs pTrace Operation error Logs: ptrace: Operation not permitted. logs pTrace Operation error Logs: ptrace: Operation not permitted. logs pTrace Operation error Logs: t resharding_size_estimate.js. Further test execution may be unsafe. Traceback (most recent call last): File "/data/mci/371c913903b94e3028c93fc735914849/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 210, in _run_single_copy test_case.run_test() File "/data/mci/371c913903b94e3028c93fc735914849/src/buildscripts/resmokelib/testing/testcases/interface.py", line 137, in run_test self._execute(proc) File "/data/mci/371c913903b94e3028c93fc735914849/src/buildscripts/resmokelib/testing/testcases/interface.py", line 158, in _execute raise self.failureException("%s failed" % (self.short_description())) AssertionError: JSTest jstests/sharding/resharding_critical_section_metrics.js failed Traceback (most recent call last): File "/data/mci/371c913903b94e3028c93fc735914849/src/buildscripts/resmokelib/testing/job.py", line 83, in __call__ self._run(queue, interrupt_flag, teardown_flag, hook_failure_flag) File "/data/mci/371c913903b94e3028c93fc735914849/src/buildscripts/resmokelib/testing/job.py", line 129, in _run self._execute_test(test, hook_failure_flag) File "/data/mci/371c913903b94e3028c93fc735914849/src/buildscripts/resmokelib/testing/job.py", line 175, in _execute_test raise test.propagate_error File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 59, in testPartExecutor yield File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 591, in run self._callTestMethod(testMethod) File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 549, in _callTestMethod method() File "/data/mci/371c913903b94e3028c93fc735914849/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 259, in run_test self._run_single_copy() File "/data/mci/371c913903b94e3028c93fc735914849/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 214, in _run_single_copy self._raise_if_unsafe_exit(self.return_code) File "/data/mci/371c913903b94e3028c93fc735914849/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 277, in _raise_if_unsafe_exit raise self.propagate_error # pylint: disable=raising-bad-type buildscripts.resmokelib.errors.UnsafeExitError: Mongo shell exited with code -9 while running jstest resharding_critical_section_metrics.js. Further test execution may be unsafe. Traceback (most recent call last): File "/data/mci/371c913903b94e3028c93fc735914849/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 210, in _run_single_copy test_case.run_test() File "/data/mci/371c913903b94e3028c93fc735914849/src/buildscripts/resmokelib/testing/testcases/interface.py", line 137, in run_test self._execute(proc) File "/data/mci/371c913903b94e3028c93fc735914849/src/buildscripts/resmokelib/testing/testcases/interface.py", line 158, in _execute raise self.failureException("%s failed" % (self.short_description())) AssertionError: JSTest jstests/sharding/resharding_critical_section_metrics.js failed Traceback (most recent call last): File "/data/mci/371c913903b94e3028c93fc735914849/src/buildscripts/resmokelib/testing/job.py", line 83, in __call__ self._run(queue, interrupt_flag, teardown_flag, hook_failure_flag) File "/data/mci/371c913903b94e3028c93fc735914849/src/buildscripts/resmokelib/testing/job.py", line 129, in _run self._execute_test(test, hook_failure_flag) File "/data/mci/371c913903b94e3028c93fc735914849/src/buildscripts/resmokelib/testing/job.py", line 175, in _execute_test raise test.propagate_error File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 59, in testPartExecutor yield File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 591, in run self._callTestMethod(testMethod) File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 549, in _callTestMethod method() File "/data/mci/371c913903b94e3028c93fc735914849/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 259, in run_test self._run_single_copy() File "/data/mci/371c913903b94e3028c93fc735914849/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 214, in _run_single_copy self._raise_if_unsafe_exit(self.return_code) File "/data/mci/371c913903b94e3028c93fc735914849/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 277, in _raise_if_unsafe_exit raise self.propagate_error # pylint: disable=raising-bad-type buildscripts.resmokelib.errors.UnsafeExitError: Mongo shell exited with code -9 while running jstest resharding_critical_section_metrics.js. Further test execution may be unsafe. Traceback (most recent call last): File "/data/mci/371c913903b94e3028c93fc735914849/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 210, in _run_single_copy test_case.run_test() File "/data/mci/371c913903b94e3028c93fc735914849/src/buildscripts/resmokelib/testing/testcases/interface.py", line 137, in run_test self._execute(proc) File "/data/mci/371c913903b94e3028c93fc735914849/src/buildscripts/resmokelib/testing/testcases/interface.py", line 158, in _execute raise self.failureException("%s failed" % (self.short_description())) AssertionError: JSTest jstests/sharding/internal_txns/retryable_writes_committed_during_resharding.js failed Traceback (most recent call last): File "/data/mci/371c913903b94e3028c93fc735914849/src/buildscripts/resmokelib/testing/job.py", line 83, in __call__ self._run(queue, interrupt_flag, teardown_flag, hook_failure_flag) File "/data/mci/371c913903b94e3028c93fc735914849/src/buildscripts/resmokelib/testing/job.py", line 129, in _run self._execute_test(test, hook_failure_flag) File "/data/mci/371c913903b94e3028c93fc735914849/src/buildscripts/resmokelib/testing/job.py", line 175, in _execute_test raise test.propagate_error File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 59, in testPartExecutor yield File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 591, in run self._callTestMethod(testMethod) File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 549, in _callTestMethod method() File "/data/mci/371c913903b94e3028c93fc735914849/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 259, in run_test self._run_single_copy() File "/data/mci/371c913903b94e3028c93fc735914849/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 214, in _run_single_copy self._raise_if_unsafe_exit(self.return_code) File "/data/mci/371c913903b94e3028c93fc735914849/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 277, in _raise_if_unsafe_exit raise self.propagate_error # pylint: disable=raising-bad-type buildscripts.resmokelib.errors.UnsafeExitError: Mongo shell exited with code -9 while running jstest retryable_writes_committed_during_resharding.js. Further test execution may be unsafe. Traceback (most recent call last): File "/data/mci/371c913903b94e3028c93fc735914849/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 210, in _run_single_copy test_case.run_test() File "/data/mci/371c913903b94e3028c93fc735914849/src/buildscripts/resmokelib/testing/testcases/interface.py", line 137, in run_test self._execute(proc) File "/data/mci/371c913903b94e3028c93fc735914849/src/buildscripts/resmokelib/testing/testcases/interface.py", line 158, in _execute raise self.failureException("%s failed" % (self.short_description())) AssertionError: JSTest jstests/sharding/internal_txns/retryable_writes_committed_during_resharding.js failed Traceback (most recent call last): File "/data/mci/371c913903b94e3028c93fc735914849/src/buildscripts/resmokelib/testing/job.py", line 83, in __call__ self._run(queue, interrupt_flag, teardown_flag, hook_failure_flag) File "/data/mci/371c913903b94e3028c93fc735914849/src/buildscripts/resmokelib/testing/job.py", line 129, in _run self._execute_test(test, hook_failure_flag) File "/data/mci/371c913903b94e3028c93fc735914849/src/buildscripts/resmokelib/testing/job.py", line 175, in _execute_test raise test.propagate_error File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 59, in testPartExecutor yield File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 591, in run self._callTestMethod(testMethod) File "/opt/mongodbtoolchain/revisions/11316f1e7b36f08dcdd2ad0640af18f9287876f4/stow/python3-v4.qUz/lib/python3.10/unittest/case.py", line 549, in _callTestMethod method() File "/data/mci/371c913903b94e3028c93fc735914849/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 259, in run_test self._run_single_copy() File "/data/mci/371c913903b94e3028c93fc735914849/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 214, in _run_single_copy self._raise_if_unsafe_exit(self.return_code) File "/data/mci/371c913903b94e3028c93fc735914849/src/buildscripts/resmokelib/testing/testcases/jstest.py", line 277, in _raise_if_unsafe_exit raise self.propagate_error # pylint: disable=raising-bad-type buildscripts.resmokelib.errors.UnsafeExitError: Mongo shell exited with code -9 while running jstest retryable_writes_committed_during_resharding.js. Further test execution may be unsafe. logs pTrace Operation error Logs: expansions.update' in function 'set task expansion macros expansions.write' in function 'f_expansions_write expansions.write' in function 'git get project no modules git.get_project' in function 'git get project no modules subprocess.exec' in function 'add git tag expansions.write' in function 'do setup s3.get' in function 'do setup subprocess.exec' in function 'do setup keyval.inc' in function 'do setup subprocess.exec' in function 'configure evergreen api credentials expansions.write' in function 'do multiversion setup subprocess.exec' in function 'do multiversion setup expansions.write' in function 'run generated tests s3.get' in function 'run generated tests subprocess.exec' in function 'run generated tests expansions.update' in function 'run generated tests timeout.update' in function 'run generated tests expansions.write' in function 'upload npm logs subprocess.exec' in function 'upload npm logs archive.targz_pack' in function 'upload npm logs s3.put' in function 'upload npm logs s3.put' in function 'attach local resmoke invocation attach.results' in function 'attach report attach.artifacts' in function 'attach artifacts expansions.write' in function 'save ec2 task artifacts subprocess.exec' in function 'save ec2 task artifacts s3.put' in function 'save ec2 task artifacts expansions.write' in function 'attach wiki page subprocess.exec' in function 'attach wiki page attach.artifacts' in function 'attach wiki page s3.put' in function 'upload jstestfuzz minimized output expansions.write' in function 'upload jstestfuzz minimized output subprocess.exec' in function 'upload jstestfuzz minimized output attach.artifacts' in function 'upload jstestfuzz minimized output subprocess.exec' in function 'kill processes expansions.write' in function 'save local client logs subprocess.exec' in function 'save local client logs s3.put' in function 'save local client logs expansions.write' in function 'save code coverage data subprocess.exec' in function 'save code coverage data archive.targz_pack' in function 'save code coverage data s3.put' in function 'save code coverage data archive.targz_pack' in function 'save jepsen artifacts s3.put' in function 'save jepsen artifacts archive.targz_pack' in function 'save blackduck artifacts s3.put' in function 'save blackduck artifacts expansions.write' in function 'save mongo coredumps subprocess.exec' in function 'save mongo coredumps archive.targz_pack' in function 'save mongo coredumps logs pTrace Operation error Logs: expansions.write' in function 'f_expansions_write expansions.write' in function 'run hang analyzer subprocess.exec' in function 'run hang analyzer subprocess.exec' in function 'wait for resmoke to shutdown logs Task Log Assertion Extractor Logs: 'mongodb_mongo_master_enterprise_rhel_80_64_bit_dynamic_all_feature_flags_required_sharding_last_continuous_1_linux_enterprise_1049af0cf89571f65cf9a22dfe75119b9059d785_23_02_09_19_51_19', execution 4. xgen-buildbaron-user commented on Fri, 10 Feb 2023 22:16:55 +0000: retryable_writes_committed_during_resharding.js - Logs | History | GitHub resharding_prohibited_commands.js - Logs | History | GitHub resharding_verify_primary_catalog_consistency.js - Logs | History | GitHub resharding_size_estimate.js - Logs | History | GitHub resharding_critical_section_metrics.js - Logs | History | GitHub sharded_graph_lookup_execution.js - Logs | History | GitHub resharding_change_stream_namespace_filtering.js - Logs | History | GitHub invalidate_plan_cache_entries_when_collection_generation_changes.js - Logs | History | GitHub resharding_abort_command.js - Logs | History | GitHub resharding_change_streams_resumability.js - Logs | History | GitHub sharded_lookup_execution.js - Logs | History | GitHub reshard_collection_existing_sk_index_not_duplicated.js - Logs | History | GitHub resharding_retryable_writes.js - Logs | History | GitHub retryable_findAndModify_committed_during_resharding_oplog.js - Logs | History | GitHub lookup_on_shard.js - Logs | History | GitHub lookup_unionWith_subpipeline_local_read.js - Logs | History | GitHub read_does_not_create_namespaces.js - Logs | History | GitHub retryable_writes_aborted_before_resharding.js - Logs | History | GitHub test_resharding_test_fixture_detects_unowned_docs.js - Logs | History | GitHub resharding_large_number_of_initial_chunks.js - Logs | History | GitHub reshard_collection_joins_existing_operation.js - Logs | History | GitHub comment_field_sharded.js - Logs | History | GitHub resharding_disallow_drop.js - Logs | History | GitHub resharding_min_fetch_ts_with_txn.js - Logs | History | GitHub reshard_collection_basic.js - Logs | History | GitHub resharding_fails_on_nonempty_stash.js - Logs | History | GitHub resharding_collection_cloner.js - Logs | History | GitHub resharding_metrics.js - Logs | History | GitHub now_variable_sharding.js - Logs | History | GitHub non_retryable_writes_before_resharding.js - Logs | History | GitHub union_sharded_views.js - Logs | History | GitHub resharding_abort_while_monitoring_to_commit.js - Logs | History | GitHub lookup_mongod_unaware.js - Logs | History | GitHub resharding_txn_cloner.js - Logs | History | GitHub lookup_read_preference.js - Logs | History | GitHub non_retryable_writes_during_resharding.js - Logs | History | GitHub collation_lookup.js - Logs | History | GitHub resharding_collection_cloner_resuming.js - Logs | History | GitHub lookup.js - Logs | History | GitHub resharding_nonblocking_coordinator_rebuild.js - Logs | History | GitHub resharding_replicate_updates_as_insert_delete.js - Logs | History | GitHub sharded_graph_lookup_execution.js - Logs | History | GitHub lookup_change_stream_post_image_id_shard_key.js - Logs | History | GitHub resharding_change_stream_namespace_filtering.js - Logs | History | GitHub resharding_critical_section_timeout.js - Logs | History | GitHub retryable_writes_committed_during_resharding.js - Logs | History | GitHub graph_lookup.js - Logs | History | GitHub resharding_change_stream_internal_ops.js - Logs | History | GitHub api_version_test_expression.js - Logs | History | GitHub resharding_update_shard_key_in_retryable_write.js - Logs | History | GitHub resharding_coordinator_recovers_abort_decision.js - Logs | History | GitHub resharding_array_shard_key.js - Logs | History | GitHub resharding_read_from_secondary.js - Logs | History | GitHub union_with_read_preference.js - Logs | History | GitHub change_stream_lookup_post_image_chunk_migration.js - Logs | History | GitHub sharding_non_transaction_snapshot_aggregate.js - Logs | History | GitHub retryable_writes_aborted_during_resharding.js - Logs | History | GitHub lookup_unionWith_subpipeline_local_read.js - Logs | History | GitHub reshard_collection_existing_sk_index_not_duplicated.js - Logs | History | [GitHub|https://github.c

Steps to Reproduce