Technology Lead | Azure Data Engineering

We are seekingan experiencedTechnology Lead / AzureData Engineerwith strong hands-on expertiseinAzure Synapse Analyticsand PySpark. The ideal candidatewill have adeep understanding ofApache Spark, distributeddata processing, DataLake architecture, andmodern data engineeringpractices.

Must-Have Skills Azure Synapse Analytics

PySpark

Apache Spark architecture

Spark SQL

Data Lake architecture

Medallion Architecture

Data transformationand processing

Strong troubleshooting andproblem-solving skills

Nice-to-Have Microsoft Fabric

Experience with moderncloud data platforms

Responsibilities Design, develop, and optimizedata solutions usingAzure Synapse Analytics.

Develop scalable datapipelines and transformationsusingPySpark and SparkSQL.

ApplyApache Spark architectureand distributed processingconcepts to large-scale data workloads.

Design and implementData Lake andMedallion Architecturesolutions.

Troubleshoot performance,data quality, andpipeline-related issues.

Collaborate with cross-functional teams tounderstand requirementsand deliver scalablesolutions.

Evaluate and leverageMicrosoft Fabriccapabilities where appropriate.

Provide technical leadershipand contribute tosolution architecture anddevelopment standards.

Required Qualifications 8+ years ofexperiencein data engineering, cloud platforms, orrelated technology roles.

Strong hands-onexperience withAzure Synapse Analytics.

Strong programming experiencewithPySparkandSpark SQL.

Deep understanding ofApache Sparkand distributed dataprocessing.

Experience designing andimplementingData Lake architectures.

Excellent communicationand collaboration skills.

Strong analytical, troubleshooting, and problem-solving abilities.

#J-18808-Ljbffr