Senior Software Systems Engineer, Autonomous Vehicles - Metrics & Evaluation

Autonomous Vehicle Software Evaluation EngineerYou will be part of a team that drives systematic and data-driven improvements to the Autonomous Vehicle software by designing, implementing, and maintaining robust processes for evaluation and validation of our AVs. To achieve this objective, we are looking for a highly motivated individual with excellent analytical skills to own end to end execution, methodology improvements and insight articulation/communication to ensure high-quality evaluation and release of our End-to-End ML Stack.In this position, you will work closely with AI/ML Engineers, Simulation Engineers, Systems Engineers, Product Managers to identify, analyze, monitor and prioritize the most important signals to assess performance of our ML based stack leveraging simulation and on-road data and building scalable processes to evaluate compliance to our KPIs.If you're interested in having a major impact on accelerating AV Behavioral Evaluation assessment on ML-driven autonomy through creative problem solving, let's chat!What you'll be doing:Define an AV evaluation process that spans from initial conception through implementation, ensuring it is applied to the release of our end-to-end (E2E) ML stack.Provide hands-on implementation of infrastructure solutions to assess AV performance from E LT tooling at GM from simulation and on-road data.Proactively scope and identify metrics needed to improve our evaluation workflows and devise paths for implementation if not available.Contribute to automated triage strategies for AV deficiencies in an End-to-End stack architecture and present findings to relevant stakeholders.Articulate insights, summaries and recommendations to AV developers and executives based on continuous analysis of AV performance.Define and maintain scalable processes to identify, monitor and improve evaluation KPIs as definition of success of evaluation initiatives.Map and articulate link between continuous improvement processes with the product safety case and compliance with safety standards.What you must have:Strong Python and SQL programmingStrong skills in high quality SW Development using AI toolsPrior knowledge and implementation of ELT pipelines for product quality analysisExperience with GitHub and Jira or equivalent toolsStrong problem-solving skills - End to End ownership from problem definition to deriving the desired outcomeProven track record of analytical and systems engineering skills while dealing with complex systems and ambiguous AI functionsProven track record of root cause analysis in complex SW/HW systemsFamiliarity with analytical methods for driving behavioral analysisAbility to creatively problem solve with limited supervisionMotivated by a fast paced, challenging environment with high expectations and quick turnaroundsAbility to learn quickly, starting with little information and quickly becoming an expert in your domainStrong cross functional communication and collaboration skillsProven experience at communicating data driven decisions to leadershipPassionate about robotics/AI complexitiesBS, MS or PhD in Engineering or related discipline or equivalent combination education and experienceBonus Points!Experience with AVs and/or Production grade robotics developments and AV/ADAS systemsExperience with statistical methods for product evaluation and risk assessmentExperience with developing data driven metricsCompensation: The compensation information is a good faith estimate only. It is based on what a successful applicant might be paid in accordance with applicable state laws. The compensation may not be representative for positions located outside of New York, Colorado, California, or Washington. The salary range for this role: is $153,200 to $234,100. The actual base salary a successful candidate will be offered within this range will vary based on factors relevant to the position. Bonus Potential: An incentive pay program offers payouts based on company performance, job level, and individual performance. Benefits: GM offers a variety of health and wellbeing benefit programs. Benefit options include medical, dental, vision, Health Savings Account, Flexible Spending Accounts, retirement savings plan, sickness and accident benefits, life insurance, paid vacation & holidays, tuition assistance programs, employee assistance program, GM vehicle discounts and more