AWS Data Engineer

AWS ETL Technical Lead The role focuses on designing, developing, and automating end-to-end data pipelines to deliver scalable data integration and data warehouse solutions. The technical lead will guide the development of ETL pipelines using AWS Glue, orchestrated with Airflow, ensuring data quality, performance, and reliability.

Responsibilities Design and deliver scalable data integration and data warehouse solutions.

Lead development of ETL pipelines using AWS Glue and orchestration tools such as Airflow.

Ensure high data quality, performance, and reliability of data workflows.

Design scalable, event-driven architecture utilizing services like Glue, Lambda, EventBridge, S3, RDS Aurora/PostgreSQL, and MSK/Kinesis.

Work with relational and cloud-native databases, including Snowflake, Aurora, PostgreSQL, and MS SQL Server.

Build CI/CD pipelines and implement infrastructure-as-code with Terraform.

Support automated deployments and maintain environment consistency.

Collaborate effectively with cross-functional teams and influence both technical and business stakeholders.

Qualifications Extensive hands‑on experience designing, developing, and automating end-to-end data pipelines, including ETL/ELT workflows using AWS Glue with PySpark.

Deep knowledge of AWS services such as Glue, Lambda, EventBridge, S3, RDS Aurora/PostgreSQL, and MSK/Kinesis.

Proficiency with relational and cloud-native databases including Snowflake, Aurora, PostgreSQL, and MS SQL Server.

Strong SQL and data modeling skills.

Hands‑on experience with CI/CD pipelines, infrastructure-as-code (Terraform), and modern DevOps practices.

Strong communication and leadership skills.

Preferred AWS certifications (Solutions Architect, Data Engineer).

#J-18808-Ljbffr