Single/Dual-core systems: Threading works better (I/O-bound tests benefit from concurrency) Multi-core systems: Multiprocessing works better (true parallelism) Instead of manually choosing between ...
Issue you'd like to raise. We run our evaluations with openevals inside of pytest and trace the results in LangSmith. When sharding the pytests in CI/CD to make the tests run in parallel, even when ...