# Member of Technical Staff, ML Platform (Evals) at Runway Ml

> Remote · region unclear · Staff · ML / AI · open. Source: https://alderhq.app/jobs/ashby%3Arunway-ml%3A9a5bef1b-cd54-4258-bb71-4dc7dfded54c (read 2026-11-18).

## Facts (observed)

- Company: [Runway Ml](https://alderhq.app/companies/runway-ml)
- Location text: Remote
- Where it can be done from (inferred): Remote · region unclear (evidence: "Remote, region not stated")
- Posted: 2026-11-12 (5 days ago)
- First seen by alder: 2026-11-12 · last verified: 2026-11-16
- Reposted: 0 times · edited: 0 times
- Apply on the employer's site: https://jobs.ashbyhq.com/runway-ml/9a5bef1b-cd54-4258-bb71-4dc7dfded54c
- Skills listed (inferred): Python, Kubernetes, PyTorch

## Pay and sponsorship

- Posted pay: $240k–$290k per year (from the listing's pay field)

## Description (the employer's text)

We are building AI to simulate the world through merging art and science.

We believe that world models are at the frontier of progress in artificial intelligence. Language models alone won’t solve the world’s hardest problems – robotics, disease, scientific discovery. Real progress requires models that experience the world and learn from their mistakes, the same way that humans do. And this kind of trial and error can be massively accelerated when done in simulation, rather than in the real world.

World models offer the most clear path to general-purpose simulation, changing how stories are told, how scientific progress is made and how the next frontiers of humanity are reached.

Our team consists of creative, open minded, caring and ambitious people who are determined to change the world. We aspire to continuously build impossible things and our ability to do so relies on building an incredible team. If you are driven to do the same, we'd love to hear from you.

\*Titles posted to our careers page are updated regularly to best advertise the role and expected seniority, but internally we have a flat titling system with two types of titles: one for individual contributors and one for people managers.

### About the role

We're looking for an ML infrastructure engineer to own model evaluation at Runway, end to end. Every decision we make about a model – which checkpoint to keep training, what to ship to millions of users, which datamix and architecture shows the most promise – rests on evals. Today that work is spread across the organization. You'll turn it into one platform.

Your job will be to design and build the systems that generate samples at scale, score them with automated metrics and human annotations, track results across checkpoints and releases, and put the answers in front of researchers in minutes rather than days. You'll define what "better" means operationally – how we measure it, how confident we are, and how a result becomes a ship/no-ship decision.

You'll be embedded within research teams as a member of ML Platform, and you'll set the technical direction for evals across the company. This is an extremely high-leverage role: the quality of our models is bounded by how well we can measure them.

### A peek at our technical stack

Our inference and training code is written in Python (PyTorch) and is cloud-native. We leverage multiple clouds and use a combination of Kubernetes native and home-grown tooling for efficient job orchestration.

We’re big users of agentic development and operations. We have a robust internal platform and provide broad access to the latest models and harnesses.

You’ll have access to best-in-class models, agents, GPUs, storage and cloud services you need to drive a world class evaluation pipeline that helps us deliver frontier models.

### What you'll do

Own the evaluation platform end to end: the tooling and systems required to generate, annotate, review and adapt at frontier scale

Define the CLIs, APIs, GUIs and storage layers required to make this process seamless, fast, sophisticated and collaborative

Work directly with research teams on video, image, audio, agents, and robotics to understand what they need to measure and build it, then generalize the result into the platform

Help set the standards for how we evaluate models at Runway: reproducibility, metric definitions, reporting formats, and when a result is trustworthy enough to act on

Support broad adoption of the platform and its integration throughout Runway’s research efforts across training, production model serving and more

Contribute broadly as a member of the ML Platform team to tools and systems that help Runway train and serve frontier models

### What you'll need

5+ years of experience building ML infrastructure or data platforms in production environments, with at least some of that time spent on evaluation, experimentation, or benchmarking systems

Strong Python and PyTorch, and hands-on experience running large batch GPU workloads on Kubernetes

Experience designing data pipelines and storage for large volumes of media or model outputs, with attention to versioning and reproducibility

---
Data: alder (https://alderhq.app). Cite https://alderhq.app/jobs/ashby%3Arunway-ml%3A9a5bef1b-cd54-4258-bb71-4dc7dfded54c and the date you read it. Observed facts come from the employer's own listing; location reach, level, family and skills are inferences.
