Software Engineer, Metrics, AI Evaluation

AI Evaluation Team MemberThe AI Evaluation team is the main line of defense in ensuring product safety. Working alongside our AI team, you will design metrics for open and closed loop simulation testing on telemetry collected from the fleet. These results help drive key decisions about end-to-end model architecture, data integrity, and exported model performance. Your work will directly impact L4 Unsupervised robotaxi operation, FSD v14+ customer satisfaction, and Optimus success. A strong candidate will have a computer science, ML or robotics engineering background, strong attention to detail, self-driven attitude, and passion to make an impact.ResponsibilitiesDesign metrics to evaluate model predictions and vehicle motion across every scenario a self-driving robotaxi could ever encounterWork with AI researchers to evaluate & compare end-to-end FSD modelsOwn projects from inception to completion and present projects to org leadershipBuild tooling and automation to validate open-loop and closed-loop simulationsMeasure the correlation between real-world driving and simulated rollouts, and drive down the gaps end to endMine data sourced from the vast Customer fleet to surface high-value cases and turn them into reusable, high-signal evaluation scenariosDe-noise eval results to surface high value signal that guides model iterations and signoff decisionsRequirementsDegree in Computer Science, Physics or Robotics Engineering, or equivalent in experience and evidence of exceptional abilityStrong Python coding abilitiesExposure to NumPy and Pandas for data manipulationExperience with SIL, HIL, open-loop, and closed-loop robotics eval a plusExperience with computer vision systems, ADAS features, path-planning, real-time embedded systems, sensor calibration, C++ and/or CAN is a plusCompensation & BenefitsBenefitsAlong with competitive pay, as a full-time Tesla employee, you are eligible for the following benefits at day 1 of hire:Medical plans > plan options with $0 payroll deductionFamily-building, fertility, adoption and surrogacy benefitsDental (including orthodontic coverage) and vision plans, both have options with a $0 paycheck contributionCompany Paid (Health Savings Accounts) HSA Contribution when enrolled in the High-Deductible medical plan with HSAHealthcare and Dependent Care Flexible Spending Accounts (FSA)401(k) with employer match, Employee Stock Purchase Plans, and other financial benefitsCompany paid Basic Life, AD&DShort-term and long-term disability insurance (90 day waiting period)Employee Assistance ProgramSick and Vacation time (Flex time for salary positions, Accrued hours for Hourly positions), and Paid HolidaysBack-up childcare and parenting support resourcesVoluntary benefits to include: critical illness, hospital indemnity, accident insurance, theft & legal services, and pet insuranceWeight Loss and Tobacco Cessation ProgramsTesla Babies programCommuter benefitsEmployee discounts and perks programExpected Compensation $140,000 - $360,000/annual salary + cash and stock awards + benefitsPay offered may vary depending on multiple individualized factors, including market location, job-related knowledge, skills, and experience. The total compensation package for this position may also include other elements dependent on the position offered. Details of participation in these benefit plans will be provided if an employee receives an offer of employment.