Form cover
Page 1 of 1

AI Data Annotation Practice

This assessment evaluates advanced skills required for AI data annotation and image model evaluation.

You will analyze generated images, evaluate their alignment with prompts, detect inconsistencies, and provide your reasoning if requested.

You will be tested on:

- Instruction following

- Visual observation and detail recognition

- Image quality evaluation

- Factual correctness

- Dataset suitability

- Logical reasoning

- Explanation clarity

- Reading comprehension

- Provide clear reasoning for all choices.

Let's start with your personal details

What is your current location ?

1. Image description

Look at the image and describe the scene. Mention the activity, visible objects, and important colors

Image 1

https://storage.tally.so/63882744-32dc-4810-be19-713ddf7dc509/pexels-didsss-35908820.jpg

Image 2

https://storage.tally.so/b2f721a8-21af-4205-984f-8ab69d32905f/pexels-ghassan-hani-709938-36447513.jpg

Image 3

https://storage.tally.so/39c91fb5-6fa9-4fa7-8087-cd58f9752223/pexels-benprater-34635712.jpg

2. Instruction Following/Factuality/Quality Evaluation

Prompt: A red bicycle leaning against a wooden fence in a green park during sunset.

Image A
https://storage.tally.so/52bd1b8d-f0a0-409d-bacb-da565696edca/photo-1588852041467-4d31840c3036.jpg
Image B
https://storage.tally.so/53e473e0-aa70-4a99-8609-40659d8cd21d/photo-1642662015144-e6814f73d40d.jpg
Which image follows the prompt more accurately?
Prompt: A red bicycle leaning against a wooden fence in a green park during sunset.
Which image looks more factual?
Untitled checkboxes field
Which image has better Quality Overall?
Untitled checkboxes field

Prompt: A golden retriever playing with a red ball on a grassy field.

Image A
https://storage.tally.so/823b0078-cda0-45ae-8372-dedc8129263b/2024-12-06_dog_texture_study_-_Hero.jpg
Image B
https://storage.tally.so/eb148c2f-06e9-403a-a510-b46ba5324f2e/f972ac7e-e0ae-401f-926d-f4217a50e242.png
Which image follows the prompt more accurately?
Prompt: A golden retriever playing with a red ball on a grassy field.
Which image looks more factual?
Untitled checkboxes field
Which image has better Quality Overall?
Untitled checkboxes field
3. English understanding
a. Read carefully the passage and answer the questions
Passage

A data annotator helps train artificial intelligence systems by labeling data. The data can include images, text, audio, or video. For example, an annotator may draw a box around a car in an image and label it as “vehicle.” In text annotation, a sentence may be labeled as positive, negative, or neutral.

Accuracy is very important in data annotation. If labels are wrong, the AI model may learn incorrect patterns and produce unreliable results. For this reason, many annotation projects include a quality review step. During this step, experienced reviewers check the work of annotators and provide feedback.

Good annotators follow instructions carefully and pay attention to details. They must also read guidelines before starting tasks so they understand what should be labeled and what should not be labeled.

What does a data annotator do?

Name two types of data mentioned in the passage

Why is accuracy important in data annotation

What personal skill is important for annotators?

b. Which sentence is correct?
* Question 1
A. She usually arrives early to work.
B. She usually arrive early to work.
C. She arrive usually early to work.
Untitled checkboxes field
* Question 2
A. The meeting will started in ten minutes.
B.
The meeting will start in ten minutes.
C. The meeting start will in ten minutes.
Untitled checkboxes field
* Question 3
A. The children playing were outside yesterday.
B. The children was playing outside yesterday.
C. The children were playing outside yesterday.
Untitled checkboxes field