Research Engineering Manager, STEM
- Opened · 30d
- +8,759
- Closed · 30d
- −5,427
- Signal
- ▲ Expanding+3,332 net
- Opened · 7d
- +1510% of open
- All ml / ai
- 6,602open
Accountabilities:
Lead the research engineering function responsible for developing high-quality synthetic datasets, reinforcement learning environments, and advanced evaluation benchmarks. You will combine technical leadership, people management, and hands-on research engineering to ensure that projects deliver scientifically rigorous results and measurable improvements in model performance.
Build, manage, and develop a high-performing team of research engineers, defining hiring profiles, leading recruitment, and selecting professionals with strong research judgment and engineering expertise.
Establish the team's operating structure, including project prioritization, planning, experiment reviews, technical documentation, and clear ownership of deliverables.
Coach engineers on experimental design, software quality, research methodology, and technical communication while providing regular feedback and conducting performance evaluations.
Define and maintain engineering standards for evaluation methodologies, data quality, and reproducibility, ensuring that datasets and experiments can be regenerated from documented code, configurations, and random seeds.
Partner with research scientists to translate research hypotheses into structured experiments, including baseline selection, ablation studies, evaluation criteria, and measurable success outcomes.
Contribute independent research ideas and help establish the team's technical and scientific priorities.
Translate research prototypes into scalable production systems while preserving their original scientific objectives.
Design and oversee synthetic data pipelines covering generation, verification, filtering, deduplication, and versioning through programmatic generators, LLM-based generation, automated verification, and expert review.
Evaluate synthetic data quality through fine-tuning and reinforcement learning experiments, measuring how factors such as difficulty, diversity, correctness, and coverage influence model performance.
Develop robust quality assurance systems using gold datasets, LLM-judge calibration, expert annotations, sampling audits, and agreement metrics.
Identify capability gaps in existing AI models and develop new benchmarks and evaluation methods to measure areas not adequately covered by current assessments.
Own benchmark methodology end to end, including task taxonomies, difficulty calibration, grading systems, contamination controls, held-out datasets, and statistical confidence intervals.
Build and maintain evaluation harnesses, including agent-based and sandboxed execution evaluations, ensuring deterministic, reproducible, and trustworthy results.
Assess experimental findings and determine whether observed model improvements represent statistically meaningful gains or measurement noise.
Collaborate with research scientists to publish datasets, benchmarks, and research findings at leading conferences such as NeurIPS, ICML, and ICLR.
Remain hands-on with complex technical work, dedicating at least one-third of your time to coding, prototyping, debugging, and improving critical research infrastructure.
Serve as the technical reference for complex methodology and engineering challenges, including verifier disagreements, evaluation inconsistencies, and data quality issues.
Act as a technical counterpart to researchers at leading AI laboratories, defining project requirements, acceptance criteria, and communicating results and technical trade-offs.
Coordinate with strategic project leads, delivery teams, and engineering partners to translate research advancements into client solutions and scalable platforms.
Requirements
You are an accomplished research engineering leader with extensive experience in machine learning, synthetic data generation, and AI evaluation systems. You combine strong technical expertise with proven people management capabilities and a rigorous scientific mindset. You are comfortable leading research teams while remaining actively involved in engineering implementation, experimental design, and technical decision-making.
How Jobgether works
We use an AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Our system identifies the top-fitting candidates, and this shortlist is then shared directly with the hiring company. The final decision and next steps (interviews, assessments) are managed by their internal team.
We appreciate your interest and wish you the best!
Why Apply Through Jobgether?
Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time.
#LI-CL1