Reviewing Submissions
Submit an “Auto” Review for a submission.
Introduction
After a Submission(s) has been created, you may want to submit an auto review for a submission. SubmitReview
is utilized to assist Reviewers as they manually review submissions by handling error cases, auto-rejecting bad submissions, auto-accepting labels with very high OCR and/or model confidence, and more. This query returns a Job object that monitors the status of review.
SubmitReview
Inputs
SubmitReview Inputs
🌟
submissions: int
Id of submission to submit reviewEnabled forOptional:
changes: dict or JSONString
changes to make to raw predictions
rejected: boolean
reject the predictions and place the submission in the review queue. Must be True if $changes not provided
force_complete: boolean
have this submission bypass the Review queue
(or exceptions queue if is True) and mark as Complete. NOT RECOMMENDED
Outputs
SubmitReview Outputs
A Job that can be watched for status of review
Try It Out
You can try outSubmitReview
below:
from indico.queries import SubmitReview
submission_id = 1
changes = {} # insert your changes to the predictions here
job = client.call(SubmitReview(submission_id, changes=changes))
using System;
using System.IO;
using System.Threading.Tasks;
using IndicoV2;
using Newtonsoft.Json.Linq;
namespace Examples
{
public class SubmitReview
{
private static string GetToken() =>
File.ReadAllText(Path.Combine(Environment.GetFolderPath(Environment.SpecialFolder.UserProfile),
"indico_api_token.txt"));
public static async Task Main()
{
var client = new IndicoClient(GetToken(), new Uri("https://mycluster.indico.io"));
var reviewClient = client.Reviews();
var submissionId = 1;
var changes = new JObject(); //insert your changes to predictions here
var jobId = await reviewClient.SubmitReviewAsync(submissionId, changes);
Console.WriteLine(jobId);
}
}
Updated 10 months ago