Arbiter.predict new API

Changed the API for Arbiter.predict

arbiter.predict(input_key1=value, input_key2=value2)

Added batching and resume-ability to VLLMBatchClient

Makes VLLMBatchClient way more tolerant of transient GPU crashes and able to handle larger batch jobs

Added PrecompiledProgram._metadata

Convenience attribute to read the metadata from the README frontmatter on a repo

push_to_hub not takes in extra_files

Allows specifying extra files to push to root of repo.