Technology Lead | Azure Data Engineering

We are seeking an experienced Technology Lead / Azure Data Engineer with strong hands-on expertise in Azure Synapse Analytics and PySpark. The ideal candidate will have a deep understanding of Apache Spark, distributed data processing, Data Lake architecture, and modern data engineering practices.

Must-Have Skills

• Azure Synapse Analytics
• PySpark
• Apache Spark architecture
• Spark SQL
• Data Lake architecture
• Medallion Architecture
• Data transformation and processing
• Strong troubleshooting and problem-solving skills

Nice-to-Have

• Microsoft Fabric
• Experience with modern cloud data platforms

Responsibilities

• Design, develop, and optimize data solutions using Azure Synapse Analytics.
• Develop scalable data pipelines and transformations using PySpark and Spark SQL.
• Apply Apache Spark architecture and distributed processing concepts to large-scale data workloads.
• Design and implement Data Lake and Medallion Architecture solutions.
• Troubleshoot performance, data quality, and pipeline-related issues.
• Collaborate with cross-functional teams to understand requirements and deliver scalable solutions.
• Evaluate and leverage Microsoft Fabric capabilities where appropriate.
• Provide technical leadership and contribute to solution architecture and development standards.

Required Qualifications

• 8+ years of experience in data engineering, cloud platforms, or related technology roles.
• Strong hands-on experience with Azure Synapse Analytics.
• Strong programming experience with PySpark and Spark SQL.
• Deep understanding of Apache Spark and distributed data processing.
• Experience designing and implementing Data Lake architectures.
• Excellent communication and collaboration skills.
• Strong analytical, troubleshooting, and problem-solving abilities.