Creative Design Specialist — AI Evaluation

OpenTrain AI is looking for Creative Design Specialists to help evaluate the quality of AI-generated designs and media as part of a worldwide remote project.

This opportunity combines professional creative expertise with human evaluation of generative AI. You'll review outputs produced by AI systems, assess them against structured criteria and provide detailed feedback that can help improve how those systems perform.

The project is expected to run for approximately three to six months, with creative professionals across multiple disciplines eligible to participate.

What You'll Do

You'll apply your professional design or media judgment to structured AI evaluation tasks.

Depending on your area of expertise, your work may include:

• Review designs and media generated by AI systems.
• Evaluate outputs for accuracy, realism, usability and overall quality.
• Compare results against defined evaluation criteria.
• Provide annotations, ratings and detailed written feedback.
• Identify weaknesses or inconsistencies in AI-generated creative work.
• Document observations about creative workflows and tool behavior.
• Recommend improvements based on real professional practices.
• Complete structured tasks using relevant creative applications.
• Deliver assignments within agreed timelines.
• Maintain the quality standards established for the project.

Your feedback will become part of the human input used to assess and improve AI systems.

Creative Backgrounds

OpenTrain is considering professionals across a broad range of creative disciplines, including:

• UI/UX Design.
• Graphic Design.
• Motion Graphics.
• Video Editing.
• Presentation Design.
• Fashion Design.
• Audio and Sound.
• Other related digital creative fields.

This makes the opportunity particularly relevant to designers interested in applying their existing expertise to AI training and evaluation work.

Tools & Workflows

Tasks may involve tools relevant to your professional background.

Examples listed for the project include:

• Figma.
• Canva.
• Adobe After Effects.
• Adobe Lightroom.
• DaVinci Resolve.
• CorelDRAW.
• CLO3D.
• Camtasia.
• Mural.
• Milanote.
• Behance.

Comparable professional tools may also be relevant depending on your specialization.

The important requirement is being able to apply genuine professional judgment when evaluating AI-generated creative work.

AI Training Experience Required

This is an important requirement:

Previous verified, paid human-data experience working with AI training is required.

Relevant experience could include:

• AI output evaluation.
• Data annotation.
• Data labeling.
• RLHF.
• Model evaluation.
• Rubric-based grading.
• Other paid human-feedback work used to train or evaluate AI systems.

So while the role is open to creative professionals, general design experience alone isn't sufficient.

What You'll Need

Candidates should have:

• At least 2 years of professional creative or design experience.
• Strong proficiency with tools relevant to their creative specialization.
• Previous verified paid experience in human-data or AI-training projects.
• The ability to evaluate creative work carefully and consistently.
• Strong written communication skills for explaining evaluation decisions.
• English proficiency of at least B2 level.
• Reliable internet access.
• Availability to begin participating promptly.

A university degree is not required. Practical professional experience is the main qualification.

Who This Role Could Suit

This opportunity could be a strong fit if you're already a designer or creative professional and have previous experience working on AI-training projects.

It's particularly relevant for professionals interested in the intersection of:

Creative expertise + Generative AI + Human feedback

Rather than designing a traditional digital product from beginning to end, you'll use your existing creative knowledge to judge AI-generated work and help identify where AI systems succeed or fail.

About OpenTrain AI

OpenTrain AI connects professionals with projects involving AI training and human data.

The platform focuses on opportunities where human expertise is used to evaluate, annotate and improve the outputs produced by modern AI systems.

For this project, OpenTrain is specifically seeking people who can combine professional creative experience with previous AI-evaluation expertise.

Contract & Compensation

This is a remote contractor opportunity available worldwide.

Compensation: $30–$100/hour
Expected duration: 3–6 months
Location: Worldwide
Language: English

The listing also references a $90/hour rate, while presenting the overall compensation range as $30–$100/hour. I'd keep the range as the headline salary to avoid implying that every successful applicant will receive $90/hour.

Build deeper AI skills as a designer

AI is creating new opportunities for designers, from AI-assisted workflows and rapid prototyping to designing AI-powered experiences and evaluating the quality of generative systems.

Designlab's AI Product Design Certification is built for experienced UX and Product Designers who want to develop practical skills working with AI across the modern product design process.

Explore the AI Product Design Certification Affiliate link