Creative Design Specialist for AI Evaluation

OpenTrain AI is looking for a Creative Design Specialist to apply professional design and multimedia expertise to the evaluation of AI-generated content.

Rather than creating traditional design deliverables, you'll review how AI systems perform across design, video and creative workflows, assessing their outputs and providing structured feedback that can help improve future AI models.

The opportunity is fully remote and open worldwide, with compensation ranging from $30 to $100 per hour.

What you'll be working on

You'll complete structured AI evaluation and human-feedback tasks using your existing creative expertise to judge the quality, accuracy and usability of model outputs.

Your work may include:

• Evaluating AI-generated designs and multimedia outputs for accuracy, realism and usability.
• Reviewing how AI performs across professional creative workflows.
• Completing video labeling and structured evaluation tasks.
• Performing RLHF (Reinforcement Learning from Human Feedback) and related model-evaluation work.
• Rating outputs against defined quality criteria and rubrics.
• Writing detailed annotations and constructive feedback.
• Identifying problems and suggesting ways creative processes or tool interactions could be improved.
• Delivering evaluations according to established project timelines and quality standards.

Creative tools and disciplines

The project covers a broad range of creative applications and professional workflows.

Relevant tools include:

• Figma
• Canva
• Adobe After Effects
• DaVinci Resolve
• Adobe Lightroom
• CorelDRAW
• CLO3D
• Camtasia
• Mural
• Milanote
• Behance

Comparable professional creative tools are also relevant.

Your background could come from UI/UX design, graphic design, motion graphics, video editing, fashion design, presentation design, audio or other multimedia disciplines.

What they're looking for

You should have at least 2 years of professional experience working with creative or design tools and enough practical expertise to evaluate whether AI-generated work meets professional standards.

You'll also need:

• Professional experience in at least one relevant creative or multimedia discipline.
• Strong knowledge of the tools and workflows associated with your area of expertise.
• Previous verified paid experience working on human-data projects for AI models.
• Experience with activities such as annotation, data labeling, RLHF, model evaluation or rubric-based grading.
• Strong written and verbal English communication skills.
• English proficiency of at least B2 level.
• A reliable internet connection and availability to begin participating promptly.

A formal degree isn't required.

Previous AI data experience is required

One requirement is particularly important: simply using generative AI tools isn't enough for this position.

OpenTrain is specifically looking for candidates who have previously been paid to contribute human feedback or data to AI systems.

That could include:

Data annotation → AI output evaluation → RLHF → model evaluation → rubric-based grading.

If your AI experience consists only of generating images, videos or written content with AI tools, it doesn't satisfy this requirement.

Why this opportunity stands out

Creative professionals are increasingly being asked not only to use AI, but also to evaluate whether AI-generated work meets real professional standards.

This project puts your existing design or multimedia expertise directly into that process. Your judgments and feedback will contribute to the training and assessment of next-generation AI systems and creative tools.

Role details

Location: Worldwide / Remote
Contract: Contractor
Duration: Expected 3–6 months
Compensation: $30–$100 USD/hour
Indicated rate: $65/hour
Experience: Intermediate
Language: English

Learn how AI fits into modern design workflows

This role combines professional creative expertise with the ability to understand and evaluate AI-assisted design workflows.

For UI/UX and Product Designers interested in developing more practical AI skills, Designlab's AI for UX Design course focuses on integrating AI into research, ideation and everyday design workflows.

Explore AI for UX Design Affiliate link