English LLM Linguistic Evaluator

OpenTrain AI is looking for an English LLM Linguistic Evaluator to help improve the quality of language produced by large language models.

You'll review AI-generated English across dialogue, summarization, rewriting, grammar correction and reasoning tasks, identifying problems and making precise improvements to clarity, accuracy, style and naturalness.

The opportunity is fully remote and open worldwide, with flexible asynchronous working hours. Compensation is $50 per hour, with an expected commitment of at least 20 hours each week.

Use Your English Expertise to Improve AI

This role is built around something large language models still depend heavily on: human linguistic judgment.

You'll examine generated responses and determine whether they communicate effectively for the intended context, audience and purpose.

Sometimes that means correcting grammar. Other tasks may require recognizing ambiguity, improving awkward phrasing, adjusting tone or identifying more subtle problems with meaning and context.

The goal is to help AI systems produce English that feels more accurate, clear and natural.

What You'll Evaluate

You'll work across several types of LLM-generated content, including:

• Conversational dialogue.
• Summaries.
• Rewritten content.
• Grammar corrections.
• Reasoning-based responses.
• Other English-language AI outputs.

Your evaluations and edits will become part of the feedback used to improve model performance.

What You'll Do

Your responsibilities will include:

• Assess English text generated by large language models.
• Evaluate outputs for accuracy, clarity and overall quality.
• Edit and rewrite content to improve grammar and style.
• Identify unnatural or awkward language.
• Detect ambiguity, inconsistencies and language gaps.
• Evaluate whether tone is appropriate for the intended context.
• Consider regional and cultural differences in English usage.
• Annotate grammatical, syntactic, semantic and stylistic characteristics.
• Explain why particular model responses need improvement.
• Provide detailed, actionable linguistic feedback for AI training.
• Apply consistent evaluation standards across different tasks.

What OpenTrain Is Looking For

You don't need to be an AI engineer.

The core requirement is a high level of English proficiency combined with professional experience working with language.

Relevant backgrounds can include:

• Editing.
• Proofreading.
• Professional writing.
• Linguistic annotation.
• Language quality evaluation.
• English NLP data work.
• Other roles requiring detailed analysis of written English.

Skills & Experience

Candidates should have:

• Native or near-native English fluency.
• Excellent command of English grammar and syntax.
• Strong vocabulary and stylistic control.
• Professional experience in editing, proofreading, writing, linguistic annotation or related language work.
• The ability to recognize subtle errors in generated text.
• Strong understanding of tone and audience.
• Awareness of regional English variations.
• Good cultural and contextual judgment.
• The ability to identify semantic ambiguity.
• Excellent attention to detail.
• Strong analytical judgment.
• Clear written communication skills.
• The ability to work independently in a distributed remote environment.

Previous AI Experience

Previous specialist AI experience isn't listed as a requirement.

An interest in large language models and artificial intelligence is useful, particularly if you've already worked with structured linguistic feedback or language datasets.

This makes the opportunity potentially accessible to experienced writers, editors and language professionals looking to apply their existing expertise to AI evaluation and training.

Flexible, Asynchronous Remote Work

One particularly attractive aspect of this opportunity is its working arrangement.

The role is remote worldwide and asynchronous, giving contributors more flexibility over when they complete their work.

You'll need to commit at least 20 hours per week, but the asynchronous structure can make the project easier to combine with other professional commitments.

Contract Details

Pay: $50/hour
Location: Worldwide
Work arrangement: 100% Remote
Schedule: Flexible & asynchronous
Commitment: 20+ hours/week
Contract: Part-time contractor
Experience: Entry level
Language: English

About OpenTrain AI

OpenTrain connects professionals with projects supporting the training and evaluation of artificial intelligence systems.

Contributors provide the human expertise required to review model outputs, evaluate quality and prepare better training data.

For this project, OpenTrain is looking specifically for people who can apply sophisticated English-language judgment to large language model evaluation.