Lead Data Engineer

San Francisco, CA, United States

Lead Data Engineer (Remote) Lead Data Engineer (Remote) Lead Software Engineer Your opportunity We are looking for a highly skilled and motivated Lead Data Engineer to join our Data Platform Team. As a team member, you will play a meaningful role in designing, building, and maintaining scalable and reliable data pipelines and platforms. You will work with great technologies such as Snowflake, Airflow, and dbt to enable the efficient processing and analysis of large volumes of data.

What you'll do Design and develop robust and scalable data pipelines to support data integration using Kafka, Fivetran, Snowflake, Airflow, and dbt.

Help lead the implementation and maintenance of the data platform solutions, ensuring data integrity, performance, and security.

Collaborate with multi-functional teams including data scientists, analysts, and software engineers to understand data requirements and deliver high-quality solutions.

Evaluate and implement standard practices for data ingestion, ETL processes, and data quality frameworks.

Optimize and tune data processing workflows and SQL queries for improved performance and efficiency.

Provide technical leadership and mentorship to junior data engineers, guiding them in implementing ideal practices and delivering high-quality solutions.

Stay up-to-date with industry trends and advancements in data engineering, continuously improving the team's technical knowledge and skills.

Collaborate with infrastructure and operations teams to ensure reliable and scalable data storage, processing, and monitoring solutions.

Help support on-call engineers on SEV-1 Incidents

This role requires Bachelor's degree in Computer Science, Engineering, or a related field. Advanced degree preferred.

Proven experience (5+ years) in data engineering, designing and implementing data pipelines, and building data infrastructure.

Strong expertise in working with Snowflake, Airflow, and dbt, including data modeling, ETL, and data quality assurance.

Proficiency in SQL and experience with optimizing and tuning queries for performance.

Solid understanding of data warehousing concepts, dimensional modeling, and data integration techniques.

Experience with cloud platforms (e.g., AWS, Azure, GCP) and cloud-based data technologies.

Strong programming skills in Python or other scripting languages for data manipulation and automation.

Excellent problem-solving and troubleshooting abilities with a keen attention to detail.

Strong communication skills with the ability to effectively collaborate with multi-functional teams and partners.

Leadership experience, mentoring junior team members, and guiding technical projects.

Bonus points if you have Experience with streaming data processing frameworks (e.g., Apache Kafka, Apache Flink).

Familiarity with containerization technologies (e.g., Docker, Kubernetes).

Knowledge of distributed computing frameworks (e.g., Spark, Hadoop).

Experience with data governance, data security, and compliance practices.

Understanding of DevOps principles and experience with CI/CD pipelines.

We're looking for bold and passionate people to be a part of our mission to help every engineer do their best work, every day, using data, not opinions, at every stage of the software lifecycle. We'd love to have you apply, even if you don't feel you meet every single requirement. What's most important to us is finding authentic and accountable people who feel connected to our mission and values, not just candidates who check off all the boxes.

We believe in empowering all Relics to achieve professional and business success through a workforce model called Flex First. Flex First allows us to work in a variety of workplaces that best support our success, including fully office-based, fully remote, or hybrid.

Read more about Flex First.

Our hiring process

Qualified applicants may inquire about visa sponsorship (including transfer of a current H-1B visa), but the company does not support or sponsor O-1, F-1, or J-1 visas, or candidates who require commencement of an H-1B "cap case" petition for future work authorization. This position is to be filled as soon as possible.

In compliance with applicable law, all persons hired will be required to verify identity and eligibility to work and to complete employment eligibility verification. Note: Our stewardship of the data of thousands of customers’ means that a criminal background check is required to join New Relic.

We will consider qualified applicants with arrest and conviction records based on individual circumstances and in accordance with applicable law including, but not limited to, the San Francisco Fair Chance Ordinance.

Headhunters and recruitment agencies may not submit resumes/CVs through this website or directly to managers. New Relic does not accept unsolicited headhunter and agency resumes, and will not pay fees to any third-party agency or company that does not have a signed agreement with New Relic.

New Relic is an equal opportunity employer. We eagerly seek applicants of diverse background and hire without regard to race, color, gender identity, religion, national origin, ancestry, citizenship, physical abilities (or disability), age, sexual orientation, veteran status, or any other characteristic protected by law.

Interested in the details of our privacy policy? Read more here.

Estimated Base Pay Range: $ 167,000 - $ 209,000

The pay range above represents a reasonable estimate of the salary for the listed position. This role is eligible for a corporate bonus plan and may be eligible for a competitive equity package. Pay within this range varies by work location and may also depend on job-related factors such as an applicant’s skills, qualifications, and experience.

New Relic provides a variety of benefits for this role, including healthcare, dental, vision, parental leave and planning, mental health benefits, a 401(k) plan and match, flex time-off, 11 paid holidays, volunteer time off, and other competitive benefits designed to improve the lives of our employees.

Wage - midpoint 209,000 Wage - minimum 167,000 #LI-LM1 #LI-Remote This field has no functionality and it was added so that we could display the separator above