Experience: 3+ years
Job Type: Full-time (Contractual / Freelancing)
Location: Remote (Candidates from Europe, Namer, LATAM and US)
Required Skills: critical thinking, analytical reasoning, attention to detail, quality assurance, written communication, technica documentation, prompt authoring & refinement, AI Output Evaluation, Professional Writing, Report Writing, Business Communication, Problem Solving, Content Review, Data Interpretation, Logical Resoning, Professional Editing, Independent Research, Data Annotation, Rubric-Based Evaluation, Content Evaluation, AI Model Evaluation, Fact Checking, RLHFTechnical Editing, Prompt Engineering
Job Summary:
We are engaging AI Software Engineering Domain Experts to contribute to a project focused on developing and refining advanced AI systems. In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. No prior experience in AI is required, your domain knowledge is what matters.
Scope of Work:
- Analyze, review, and enhance AI-generated technical content, ensuring clarity, accuracy, and alignment with best practices in software engineering.
- Create, refine, and evaluate prompts and instructions designed to guide AI models in producing high-quality technical deliverables.
- Conduct rubric-based assessments of AI model outputs, providing detailed feedback on quality, correctness, and completeness.
- Draft and edit technical documentation, architecture plans, RFCs, design specifications, and engineering proposals for use in AI training.
- Perform independent research and fact-checking to validate technical assertions and ensure data-driven accuracy in content.
- Interpret and annotate data, leveraging software engineering expertise to support nuanced evaluation and labeling tasks.
- Collaborate asynchronously with project leads and other experts to meet deliverable requirements within established guidelines.
Preferred Qualifications:
- 3+ years of professional experience in software engineering roles such as Software Engineer, Senior Software Engineer, Staff Engineer, Technical Lead, Engineering Manager, or Solutions Architect.
- Track record of authoring or reviewing technical artifacts, including documentation, architecture documents, design specifications, RFCs, engineering proposals, postmortems, technical blogs, or code reviews.
- Exceptional critical thinking, analytical reasoning, and logical problem-solving skills.
- Demonstrated attention to detail and commitment to quality assurance in technical outputs.
- Strong written communication abilities, with experience in professional or technical writing and editing.
- Familiarity with AI coding tools (eg, code assistants, automated documentation generators) is a plus, but not required.
- Advanced degree (Master's, JD, MBA, PhD) or credentials from highly selective universities or equivalent academic programs are highly regarded.