AWS Data Engineer

AWS Data Engineer

Plano, TX (Hybrid role)

Must have skills: AWS, Java/ Python, Lake formation, Glue (ETL), Spark/PySpark, ETL

Domain: Banking / Credit card

Required qualifications, capabilities, and skills

• Formal training or certification in software engineering concepts and 3+ years applied experience

• Experience with AWS cloud technologies, including S3

• Experience with SQL-based technologies (e.g., MySQL/ Oracle DB)

• Proficient in coding in one or more languages; Java or Python

• Experience in developing, debugging, and maintaining code in a large corporate environment with one or more modern programming languages and database querying languages

• Cloud implementation experience with AWS including:

o AWS Data Services: Proficiency in Lake formation, Glue ETL (or) EMR, S3, Glue Catalog, Athena, Kinesis (or) MSK, Airflow (or) Lambda + Step Functions + Event Bridge

o Data De/Serialization: Expertise in at least 2 of the formats: Parquet, Iceberg, AVRO, JSON-LD

o AWS Data Security: Good Understanding of security concepts such as: Lake formation, IAM, Service roles, Encryption, KMS, Secrets Manager

• Experience with statistical data analysis and ability to determine appropriate tools and data patterns to perform analysis

• Demonstrated knowledge of software applications and technical processes within a technical discipline (e.g., cloud, artificial intelligence, machine learning, mobile, etc.)

• Proficiency in automation and continuous delivery methods.

• Proficient in all aspects of the Software Development Life Cycle.

• Solid understanding of agile methodologies such as CI/CD, Applicant Resiliency, and Security

Preferred qualifications, capabilities, and skills

• Snowflake knowledge or experience preferred

• In-depth knowledge of the financial services industry and their IT systems

• Worked with building Data lake, built Data platforms, built Data frameworks, Built/Design of Data as a Service AP