Data Engineer

Data Engineer Seeking a highly skilled and motivated Data Engineer to join a dynamic team. As a key contributor, you will be responsible for integrating into the Common Data Platform (CDP) Program Team to build and migrate data assets to a new AWS technology stack using Immuta, Starburst, Collibra, Databricks, Alteryx, and Tableau.

Required Skills:

SQL

Databricks, Collibra, and/or Alteryx.

Familiarity with cloud-based data platforms, particularly AWS.

Job Duties:

Integrate into the Common Data Platform (CDP) Program Team to build and migrate data assets to a new AWS technology stack using Immuta, Starburst, Collibra, Databricks, Alteryx, and Tableau.

Perform data engineering and analytics tasks, including data ingestion, SQL orchestration, and data modeling.

Troubleshoot and resolve issues during testing and validation activities.

Design and build data ingestion pipelines.

Participate in Agile methodology, delivering assigned stories according to engineering standards and guidelines.

Collaborate in pair programming, code reviews, and documentation of data models.

Implement automated tests, logging, and alerting for data processes.

Provide data engineering consulting expertise, especially in Starburst and Immuta.

Support data migration activities.

Key Deliverables:

Completion of assigned stories, including design, data ingestion pipeline builds, data modeling, coding, analytics solutions, and documentation.

Jira Stories and Epics for each Agile program increment.

Deliver high-quality solutions accepted by the CDP Program Team's product owners, adhering to FRS engineering standards and guidelines.

Job Requirements:

5+ years of experience in data engineering.

Experience with Databricks, Collibra, and/or Alteryx.

Strong SQL skills and experience in building data ingestion pipelines.

Familiarity with cloud-based data platforms, particularly AWS.

Proficiency in Agile methodologies and tools such as Jira.

Excellent troubleshooting and problem-solving skills.

Ability to work collaboratively within a team and communicate effectively with stakeholders.

Experience in Immuta and Starburst preferred.