User Guide

Getting Started

Connect your Solana wallet using the wallet selector. Supported wallets include Phantom, Solflare, and others. Make sure you have SOL for transaction fees and, if you are a lister, for escrowing rewards.

Creating an Annotation Task

  1. On the "Create Task" page, use the modal to create a json task file, this will include the list of urls to the samples to be annotated, details on how to annotate them, and an example url to a correctly annotated sample. Then fill out the rest form with your task details, including the dataset URL, reward per sample, and number of samples.
  2. Generate a new encryption keypair using the provided tool.Back up your private key securely!This is done so only you will be able to decrypt submissions. You can use the same keypair for multiple tasks, but ensure you keep it safe.
  3. When you list a task, the transaction will escrow the total reward amount (number of samples × price per sample). The task can be cancelled at any time but a fee of 5% of the remaining escrow balance will be deducted from the escrowed amount. This is done to discourage spam tasks and listers creating tasks, decrypting submissions, and then cancelling without paying annotators.

Submitting Annotations

  1. Browse available tasks and select one to annotate.
  2. Prepare your annotation file and upload it to a publicly accessible location.
  3. Submit your annotation by providing the public link and the sample index you labeled.
  4. Your submission link and a signed hash will be encrypted with the lister’s public key before being stored on-chain. This ensures only the lister can view your submission and prevents others from resubmitting your work.

Reviewing and Payouts

Listers can review encrypted submissions. Upon approval, the annotator is automatically paid from the escrowed funds. This ensures fair and timely payouts.

Reputation System

Both listers and annotators have reputation accounts tied to their wallets. Lister reputation includes total payouts, samples listed, samples paid, tasks cancelled, accepted submissions, and total submissions. Annotators build reputation through accepted submissions and consistent participation. Reputation helps both parties identify trustworthy collaborators and encourages good behavior.

Security Tips