Skip to content

Instantly share code, notes, and snippets.

@bjacob
Created November 17, 2025 21:23
Show Gist options
  • Select an option

  • Save bjacob/be461139704b6149a87d96d6072cb81d to your computer and use it in GitHub Desktop.

Select an option

Save bjacob/be461139704b6149a87d96d6072cb81d to your computer and use it in GitHub Desktop.
(.venv) ➜ iree-test-suites git:(main) pytest \
-rA \
-m "target_cpu" \
--timeout=300 \
--durations=0 \
--log-cli-level=info
============================================================================================= test session starts =============================================================================================
platform linux -- Python 3.12.3, pytest-8.0.0, pluggy-1.6.0
rootdir: /home/ossci/iree-test-suites
plugins: anyio-4.11.0, xdist-3.5.0, timeout-2.4.0, subtests-0.15.0, metadata-3.1.1, cov-7.0.0, asyncio-0.23.8, html-4.1.1, retry-1.7.0, reportlog-1.0.0, check-2.6.0
timeout: 300.0s
timeout method: signal
timeout func_only: False
asyncio: mode=Mode.STRICT
collecting ...
--------------------------------------------------------------------------------------------- live log collection ---------------------------------------------------------------------------------------------
INFO ireers_tools.artifacts:artifacts.py:190 Skipping 'argmax_3d_linalg.mlir' download (5.18 KiB) - local MD5 hash matches
INFO ireers_tools.artifacts:artifacts.py:190 Skipping 'argmax_3d_input_f16.npy' download (515.75 KiB) - local MD5 hash matches
INFO ireers_tools.artifacts:artifacts.py:190 Skipping 'argmax_3d_output_f16.npy' download (160.00 B) - local MD5 hash matches
INFO ireers_tools.artifacts:artifacts.py:190 Skipping 'argmax_3d_input_f32.npy' download (1.01 MiB) - local MD5 hash matches
INFO ireers_tools.artifacts:artifacts.py:190 Skipping 'argmax_3d_output_f32.npy' download (160.00 B) - local MD5 hash matches
collected 31 items / 7 errors / 11 deselected / 20 selected
!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! Interrupted: 7 errors during collection !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
Traceback (most recent call last):
File "/home/ossci/shark-ai/.venv/bin/pytest", line 8, in <module>
sys.exit(console_main())
^^^^^^^^^^^^^^
File "/home/ossci/shark-ai/.venv/lib/python3.12/site-packages/_pytest/config/__init__.py", line 197, in console_main
code = main()
^^^^^^
File "/home/ossci/shark-ai/.venv/lib/python3.12/site-packages/_pytest/config/__init__.py", line 174, in main
ret: Union[ExitCode, int] = config.hook.pytest_cmdline_main(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/ossci/shark-ai/.venv/lib/python3.12/site-packages/pluggy/_hooks.py", line 512, in __call__
return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/ossci/shark-ai/.venv/lib/python3.12/site-packages/pluggy/_manager.py", line 120, in _hookexec
return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/ossci/shark-ai/.venv/lib/python3.12/site-packages/pluggy/_callers.py", line 167, in _multicall
raise exception
File "/home/ossci/shark-ai/.venv/lib/python3.12/site-packages/pluggy/_callers.py", line 121, in _multicall
res = hook_impl.function(*args)
^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/ossci/shark-ai/.venv/lib/python3.12/site-packages/_pytest/main.py", line 319, in pytest_cmdline_main
return wrap_session(config, _main)
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/ossci/shark-ai/.venv/lib/python3.12/site-packages/_pytest/main.py", line 307, in wrap_session
config.hook.pytest_sessionfinish(
File "/home/ossci/shark-ai/.venv/lib/python3.12/site-packages/pluggy/_hooks.py", line 512, in __call__
return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/ossci/shark-ai/.venv/lib/python3.12/site-packages/pluggy/_manager.py", line 120, in _hookexec
return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/ossci/shark-ai/.venv/lib/python3.12/site-packages/pluggy/_callers.py", line 167, in _multicall
raise exception
File "/home/ossci/shark-ai/.venv/lib/python3.12/site-packages/pluggy/_callers.py", line 139, in _multicall
teardown.throw(exception)
File "/home/ossci/shark-ai/.venv/lib/python3.12/site-packages/_pytest/logging.py", line 861, in pytest_sessionfinish
return (yield)
^^^^^
File "/home/ossci/shark-ai/.venv/lib/python3.12/site-packages/pluggy/_callers.py", line 139, in _multicall
teardown.throw(exception)
File "/home/ossci/shark-ai/.venv/lib/python3.12/site-packages/_pytest/terminal.py", line 854, in pytest_sessionfinish
result = yield
^^^^^
File "/home/ossci/shark-ai/.venv/lib/python3.12/site-packages/pluggy/_callers.py", line 139, in _multicall
teardown.throw(exception)
File "/home/ossci/shark-ai/.venv/lib/python3.12/site-packages/_pytest/warnings.py", line 138, in pytest_sessionfinish
return (yield)
^^^^^
File "/home/ossci/shark-ai/.venv/lib/python3.12/site-packages/pluggy/_callers.py", line 121, in _multicall
res = hook_impl.function(*args)
^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/ossci/iree-test-suites/sharktank_models/benchmarks/conftest.py", line 88, in pytest_sessionfinish
with open(f"{job_summary_path}/job_summary.md", "a") as job_summary, open(
^^^^^
FileNotFoundError: [Errno 2] No such file or directory: '/home/ossci/iree-test-suites/sharktank_models/benchmarks/job_summary.json'
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment