Experience: 3+ years
Job Type: Full-time (Contractual / Freelancing)
Location: Remote
100% Remote | Flexible Hours | INR 1,600 per hour | ~160 hours per month
Job Summary:
We are looking for finance professionals to support an AI model training and evaluation project. The role involves reviewing complex finance-related questions, analyzing financial filings and supporting documents, validating financial evidence and calculations, developing accurate reference answers, creating grading criteria, and evaluating AI-generated responses.
This is not a traditional data annotation role. The work requires genuine financial knowledge, analytical judgment, strong attention to detail, and the ability to determine whether a financial conclusion is properly supported by the underlying evidence.
What You Will Do:
- Review finance-related questions and determine whether they are clear, precise, answerable, and have one defensible interpretation.
- Analyze financial filings, annual reports, quarterly reports, and other financial documents provided as part of the task.
- Work with US-focused financial information and public-company filings, including documents such as 10-Ks, 10-Qs, annual reports, quarterly reports, and SEC filings.
- Verify the relevant company, fiscal period, accounting basis, and specific financial line items before relying on information from a source.
- Identify the sources that are actually relevant to answering a question and distinguish them from plausible but unnecessary sources.
- Verify every material financial figure used in an answer.
- Determine whether a figure is directly sourced or derived through a calculation.
- For derived figures, verify the inputs, formula, period, scope, units, and sign convention.
- Develop a clear chain of reasoning from the financial evidence to the final conclusion.
- Create accurate "gold" or reference answers that reflect the requested answer format and include relevant qualifications.
- Develop clear and measurable criteria for grading an answer.
- Identify the calculations, assumptions, conclusions, and exclusions that distinguish a correct answer from an incorrect one.
- Review AI-generated responses against the verified question, evidence, answer, and rubric.
- Identify incorrect conclusions, calculation errors, unsupported claims, incorrect assumptions, missing information, terminology issues, or inadequate evidence.
- Assign an appropriate quality score to AI-generated responses.
- Perform final validation to ensure that the question, sources, figures, reasoning, answer, and rubric are consistent before submission.
Relevant Finance Background:
This role may be a strong fit for professionals with experience in areas such as:
- Financial analysis
- Financial statement analysis
- Investment analysis
- Equity research
- Financial reporting
- Corporate finance
- Accounting
- Audit
- Valuation
- Financial modelling
- Investment management
- Asset management
- Wealth management
- Portfolio management
- Private equity
- Fund management
- Transaction or financial advisory
- Risk analysis
- Due diligence
Experience working directly with financial filings and financial statements is particularly relevant. Candidates should be comfortable locating specific information within detailed financial documents and using that information to support an analytical conclusion.
Accounting and Regulatory Knowledge:
- Knowledge of financial reporting concepts and accounting principles is relevant to the role.
- Experience with US GAAP, SEC reporting, public-company disclosures, 10-Ks, 10-Qs, and related financial documentation is particularly useful.
- A US-specific professional certification is not required. Candidates with relevant finance expertise and practical experience may be suitable even without a US CPA certification.
- Professional qualifications such as CFA, CPA, CA, ACCA, or equivalent finance/accounting credentials are relevant but should not be viewed as the only qualification for the role.
Investment and Wealth Management Experience:
Professionals from investment and wealth-management backgrounds may also be a strong fit. Experience evaluating investments, analyzing portfolios, assessing financial performance, understanding investment products, or making investment-related recommendations can be relevant to the work.
Analytical and Reasoning Skills:
The role requires more than finding the correct number or producing an answer.
You should be comfortable asking:
- Is this the correct source?
- Is this the correct company and reporting period?
- Does this figure actually answer the question?
- Is the calculation using the correct inputs and methodology?
- Does the conclusion logically follow from the evidence?
- Has the AI made an unsupported assumption?
- Is there a more appropriate interpretation of the financial information?
- What specifically makes an answer correct or incorrect?
The ability to independently identify errors, challenge unsupported conclusions, and explain the reasoning behind a financial answer is important.
AI Model Evaluation Component:
The work also involves reviewing responses generated by AI models.
You will assess whether an AI-generated response:
- Reaches the correct conclusion
- Uses the correct financial evidence
- Uses the correct calculations and methodology
- Provides sufficient reasoning
- Avoids unsupported claims
- Includes relevant qualifications or caveats
- Fully addresses the question
- Meets the defined grading criteria
You do not need to be an AI or machine-learning professional. The primary requirement is the ability to apply your finance expertise and analytical judgment to evaluate the quality of an AI response.
Who Would Be a Good Fit:
- This role is particularly suited to someone who enjoys detailed financial research and analytical problem-solving rather than purely operational finance work.
- A strong candidate should be comfortable reading financial documents, working through numbers and calculations, investigating discrepancies, forming evidence-based conclusions, and critically reviewing another person's or an AI system's analysis.
- If your experience is primarily in financial analysis, investment analysis, financial reporting, accounting, valuation, audit, equity research, asset/wealth management, or a related analytical finance function, this role may be relevant to you.