Senior Databricks Engineer
Weehawken, NJ, United States
Job Description Job Description Must have
Bachelor's and/or Master's degree in Computer Science, Computer Engineering or related technical discipline
Senior Data Engineer with at least 15+ years of industry experience (10+ minimum experience working in Financing Domain)
At least 10+ years of experience in working in large global teams, especially for high-performance, large-scale systems data warehouse solution using Data bricks , Spark (Python/Scala) (good hands-on development experience on Databricks and spark)
Microsoft Azure experience is a must
Spark/Databricks batch and streaming solutions (Delta Lake, Lakehouse)
Knowledge of Azure Data Factory and Cosmos DB
Knowledge of Kafka, Event hubs and ADLS Gen2 on Microsoft Azure
Understanding of dev ops tools and engineering practices using micro-services, ci/cd pipeline and test automation
Cloud technologies & design patterns
building and optimizing 'big data' data pipelines, architectures, and data sets
proven skills in performance tuning and quality improvements
Strong in Algorithms and Data Structures
Infrastructure-as-code, using tools such as Terraform, ARM, Bicep or CloudFormation
Azure CLI, setting up ADO pipelines, Terraform Enterprise, etc
#J-18808-Ljbffr