You can create a release to package software, along with release notes and links to binary files, for other people to use. Learn more about releases in our docs.

Currently, we're consistently using list[int] to represent output_tokens in ModelRunnerOutput which is very inefficient from GC prospective. The default setup of GC is (700, 10, 10) which means if ...