Reviewing Submissions
Submit an “Auto” Review for a submission.
Introduction
After a Submission(s) has been created, you may want to submit an auto review for a submission. SubmitReview is utilized to assist Reviewers as they manually review submissions by handling error cases, auto-rejecting bad submissions, auto-accepting labels with very high OCR and/or model confidence, and more. This query returns a Job object that monitors the status of review.
SubmitReview
Inputs
SubmitReview Inputs
🌟
submissions: intId of submission to submit reviewEnabled forOptional:
changes: dict or JSONStringchanges to make to raw predictions
rejected: booleanreject the predictions and place the submission in the review queue. Must be True if $changes not provided
force_complete: booleanhave this submission bypass the Review queue
(or exceptions queue if is True) and mark as Complete. NOT RECOMMENDED
Outputs
SubmitReview Outputs
A Job that can be watched for status of review
Try It Out
You can try outSubmitReview below:
from indico.queries import SubmitReview
submission_id = 1
changes = {} # insert your changes to the predictions here
job = client.call(SubmitReview(submission_id, changes=changes))
using System;
using System.IO;
using System.Threading.Tasks;
using IndicoV2;
using Newtonsoft.Json.Linq;
namespace Examples
{
public class SubmitReview
{
private static string GetToken() =>
File.ReadAllText(Path.Combine(Environment.GetFolderPath(Environment.SpecialFolder.UserProfile),
"indico_api_token.txt"));
public static async Task Main()
{
var client = new IndicoClient(GetToken(), new Uri("https://mycluster.indico.io"));
var reviewClient = client.Reviews();
var submissionId = 1;
var changes = new JObject(); //insert your changes to predictions here
var jobId = await reviewClient.SubmitReviewAsync(submissionId, changes);
Console.WriteLine(jobId);
}
}
Updated 9 months ago