Skip to main content
40% Launch offerEnds 31 Dec 2026See plans

Software Engineer II, Autonomy Evaluation & Metrics Platform

Rivian Automotive · Palo Alto, CA
Software EngineeringFull-time

USD142k–178kper year

Report a problem

Job description

Role Summary

Rivian’s Autonomy Eval Infrastructure team builds the software that helps engineers understand
and improve the ML models behind our driving systems and gives release teams evidence they
can trust. Within Autonomy’s AI Platform organization, we connect model development with
evaluation workflows, metrics, triage and visualization across simulation and real-world vehicle
data.


As a metrics-platform engineer, you will build backend services, Python libraries and data
pipelines that turn model outputs into reproducible measurements and useful comparisons.
Working alongside Perception, Planning and Systems engineers, you will learn how models
behave, investigate regressions and help turn evaluation findings into better models and data,
as well as trusted release scorecards.


You will own well-scoped components from implementation through deployment and operation,
with support from senior engineers on design and complex trade-offs. Joining this newly formed
team offers the opportunity to help shape a shared platform while developing your software
engineering and distributed-systems skills.

Responsibilities

  • Build and test services, APIs and libraries for registering metric definitions, computing
    results and retrieving them consistently across engineering tools.
  • Implement scalable metric-processing pipelines with safe retries, incremental
    computation and backfills. Make missing inputs, failed jobs and incomplete results
    visible.
  • Capture code, metric, model, dataset and scenario versions so a reported result can be
    traced to its inputs and reproduced.
  • Build tools for comparing model versions and exploring results by scenario, geography,
    vehicle platform and operating conditions, using consistent aggregation and
    denominators.
  • Work with model developers to run evaluation experiments, inspect predictions and
    investigate failure patterns. Help translate findings into targeted evaluation datasets and
    regression tests.
  • Integrate metrics into evaluation workflows, CI regression checks and release
    scorecards, and connect results to recordings and triage tools for investigation.
  • Improve automated tests, performance, observability and deployment tooling. Debug
    production issues and document the components you support.
  • Work with engineers in Palo Alto, London and Belgrade to turn user needs into
    maintainable software, participate in design and code reviews, and deliver improvements
    iteratively.

Qualifications

  • 2+ years of software engineering experience, or equivalent demonstrated experience
    building and maintaining substantial software systems.
  • Strong Python programming skills and a solid foundation in data structures, algorithms,
    software design and debugging.
  • Practical SQL skills, with AI coding tools expected to support writing and refining
    queries; ability to validate query logic, results and performance.
  • Experience building backend services, reusable libraries or data-processing pipelines
    with automated tests, version control and code review.
  • Ability to reason about APIs, data models and component design, explain trade-offs, and
    identify failure cases such as duplicate, delayed or missing data.
  • Experience with cloud services, containers and CI/CD, and an understanding of how
    software is deployed and monitored in production.
  • Care with data correctness and basic statistical reasoning, including sample sizes, rates
    and variability; curiosity about how measurements reflect real driving behavior.
  • Clear written communication and a collaborative approach to gathering requirements,
    asking for feedback and resolving technical problems.
  • Bonus Points
    Hands-on experience with ML models using PyTorch or similar frameworks, such as
    running inference or analyzing prediction errors; experience in autonomy, robotics or
    simulation.
  • Experience with distributed data processing or analytical storage, such as Spark,
    Databricks, Delta Lake or comparable systems.
  • Experience with AWS, Docker and GitLab CI, or with developer tools, experiment
    tracking, data lineage or results visualization.
    Prior autonomy or robotics experience is welcome but is not required for this role.

Pay Disclosure

Salary Range for California Based Applicants: $142,000-$177,500 (actual compensation will be determined based on experience, location, and other factors permitted by law).

Benefits Summary: Rivian provides robust medical/Rx, dental and vision insurance packages for full-time employees, their spouse or domestic partner, and children up to age 26. Coverage is effective on the first day of employment, and Rivian covers most of the premiums.

Role details

Experience
0 - 2 years
Posted
12 Nov 2026
Closing date
No closing date

Similar live roles