Software Engineering Evaluator

About the job

Position: Software Engineering Evaluator

Type: Contract

Compensation: $150/hr

Location: Remote

Commitment: Minimum 10 hours/week, up to 40 hours/week (partial PST overlap required)

Role Responsibilities

•Curate, build, and correct real-world code examples across multiple programming languages.

•Evaluate AI-generated code for efficiency, scalability, reliability, and correctness.

•Design automated verification mechanisms to validate software engineering solutions.

•Assess AI capabilities across the full software development lifecycle.

•Collaborate with researchers and cross-functional teams to improve AI-driven coding systems.

Requirements

•Strong professional software engineering experience.

•Continuous full-time experience at a top-tier product company.

•Strong expertise in full-stack development and production-grade system design.

•Deep understanding of software architecture, debugging, and code quality assessment.

•Excellent written and verbal communication skills.

•Access to a desktop or laptop computer

Application Process (45 min)

•Upload resume

•Automated coding exercise

•Interview

Desired Skills and Experience

• Software Development