Azure Databricks Data Engineer

Azure Databricks Data EngineerOur client, an IT Services and Consultant company, is looking for an Azure Databricks Data Engineer for their Fort Worth, TX / Tempe, AZ / Hybrid location. Responsibilities:Design, develop, and maintain scalable data pipelines using Azure Databricks and Python.Build and optimize ETL/ELT workflows for structured and unstructured data.Develop high-performance data processing solutions using Py Spark and Spark SQL.Design and implement data lake architecture leveraging Delta Lake.Create and manage data ingestion frameworks from multiple enterprise sources.Implement data quality, validation, governance, and monitoring mechanisms.Must have hands on experience using Gen AI tools like GitHub CoPilotOptimize Databricks jobs, clusters, notebooks, and workflows for performance and cost efficiency.Collaborate with business analysts, data scientists, architects, and application teams to deliver enterprise data solutions.Support batch and near real-time data processing requirements.Participate in architecture discussions, code reviews, and best-practice implementation.Ensure secure, scalable, and reliable cloud data solutions aligned with organizational standards.Requirements:Primary Skills (Must Have):Azure DatabricksPythonPy SparkDelta LakeSpark SQLData EngineeringETL/ELT DevelopmentAzure Data Lake Storage (ADLS Gen2)SQLAzure Platform SkillsAzure DatabricksAzure Data Factory (ADF)Azure Storage AccountsAzure Key VaultAzure MonitorAzure App InsightsAzure Networking ConceptsSecondary Skills:Data Modeling (Star Schema, Snowflake Schema)DataWarehousing ConceptsPerformance Tuning and OptimizationREST API IntegrationNoSQL DatabasesAzure Synapse AnalyticsYears of Experience:7-9 Years of ExperienceWhy Should You Apply?Health BenefitsReferral ProgramExcellent growth and advancement opportunities