Principal Software & Data Engineer

Principal Data/Software Engineer & ArchitectChicago or NYC based – work from home 3-4 days/weekWe're seeking a Principal Software Engineer & Architect that is well versed in cloud-based (ideally Azure) data platforms, data pipelines, and distributed systems, to join our team. The purpose of this role is to work on a range of business-critical projects on a rotational basis while maintaining oversight of overall product and technical architecture; ensuring we make forward progress against our architectural goals at all times. At the same time, we do expect our principal architects to be hands on and write code. These projects will generally be high visibility and high impact in nature.What You'll Be DoingWork on a range of product initiatives on a rotational basis, which require special engineering and architectural guidanceProvide architectural guidance on the most important technical projects within the organizationActively mentor and positively influence the teams you'll be working with, in particular junior engineersActively contribute to the code bases and software development activities for the initiatives you will overseeOwn and develop the architectural standards and collaborate on technical vision-setting in conjunction with the VP, Engineering, Tech Leads, and Product ManagersWork in close collaboration with product management to ensure software is developed that anticipates future needs and maintains option valueSkills We're Seeking10+ years of total experience in with software and/or data engineering5+ years of experience with OO programming and architecture Ideally using Python or Scala, but Java, Go or .NET experience is okay5+ years of experience with data engineering/architecture 2+ years of experience with cloud-based data engineering/architectureIdeally with Azure, but AWS/GCP experience is okayAt least some experience in data modeling and API designExperience leading teams and mentoring other engineersNice To Have ExperienceExperience with Spark or PySparkExperience with Azure DataBricks and/or DevOpsExperience with front-end developmentExperience building a platform (not an application or a single utility site)Experience in designing, building and running highly available and highly reliable distributed systemsExperience with issues of web performance, availability, scalability, reliability, and maintainability of data pipelines