Reviewing Submissions

Submit an “Auto” Review for a submission.

Introduction

After a Submission(s) has been created, you may want to submit an auto review for a submission. SubmitReview is utilized to assist Reviewers as they manually review submissions by handling error cases, auto-rejecting bad submissions, auto-accepting labels with very high OCR and/or model confidence, and more. This query returns a Job object that monitors the status of review.

SubmitReview

Inputs

📥

SubmitReview Inputs

🌟 submissions: int Id of submission to submit reviewEnabled for

Optional:

changes: dict or JSONString changes to make to raw predictions

rejected: boolean reject the predictions and place the submission in the review queue. Must be True if $changes not provided

force_complete: boolean have this submission bypass the Review queue
(or exceptions queue if is True) and mark as Complete. NOT RECOMMENDED

Outputs

📤

SubmitReview Outputs

A Job that can be watched for status of review

Try It Out

You can try outSubmitReview below:

from indico.queries import SubmitReview

submission_id = 1
changes = {} # insert your changes to the predictions here
job = client.call(SubmitReview(submission_id, changes=changes))
using System;
using System.IO;
using System.Threading.Tasks;
using IndicoV2;
using Newtonsoft.Json.Linq;

namespace Examples
{
    public class SubmitReview
    {
        private static string GetToken() =>
            File.ReadAllText(Path.Combine(Environment.GetFolderPath(Environment.SpecialFolder.UserProfile),
                "indico_api_token.txt"));

        public static async Task Main()
        {
            var client = new IndicoClient(GetToken(), new Uri("https://mycluster.indico.io"));

            var reviewClient = client.Reviews();

            var submissionId = 1;
            var changes = new JObject(); //insert your changes to predictions here
            var jobId = await reviewClient.SubmitReviewAsync(submissionId, changes);
            Console.WriteLine(jobId);
        }
    }