Create Batch Job

Create Batch Job

The Batch page in Compass allows you to create and execute batch jobs. The batch jobs are available by default with the GPT-4o and GPT-4o mini model PYG (Pay-as-You-Go) subscriptions.

You can set the Batch Processing budget limit for batch jobs along with the models on the My Resources page.

To create a batch, you need to have:

• An active PYG subscription for GPT-4o or GPT-4o mini models

• A valid API key assigned to GPT-4o or GPT-4o mini models

To create a batch:

1. From the Dashboard, click Your Profile Icon > Batch Jobs. The Batch job page lists all the batch jobs that were created in the account.

    

2. Click Create.

3. In the Create Batch Job dialog box, authenticate yourself by entering the API key and click Verify.

4. Upon successful verification of the API key, the next screen appears to upload a batch file using one of the two options:

   • Upload file: Drag and drop or manually upload the batch file from your system. The supported file format is JSONL and the maximum file size allowed is 50 MB. The maximum number of requests allowed in a single file is 10000. Once the file is uploaded, a file ID will be generated which can be copied by clicking the Copy File ID button.

   • Attach File ID: Enter the batch file ID. The file ID is a UUID and can be generated by uploading the file as described above or using the backend API method.

     
     

      

5. Click Create. The batch job gets created successfully and starts executing.

6. To cancel the job, click Cancel batch job, the job is canceled after confirmation.

    

   

Note: You can view the usage in the Usage Report page by selecting the corresponding model filter.

Once the batch job execution is completed, you can download the output and error files. To download the output file, select the batch and click the download icon that is available after the Output file.