Data Platform Engineer - AI

We are looking for a hands-on Technical Lead – Data Platform & Services Engineering with strong expertise in Azure Data Engineering, backend services, APIs, analytics, and cloud architecture. The candidate will design, build, modernize, and operate enterprise-scale data platforms and services on Microsoft Azure.

Learn more about the general tasks related to this opportunity below, as well as required skills.

Key Responsibilities:

Data Platform & Engineering:

Design and build scalable Azure data platforms, ETL/ELT pipelines, and analytical solutions.

Develop large-scale data processing using Azure Databricks, Spark/PySpark, Azure Synapse, and Azure Data Factory.

Design Lakehouse/Medallion architectures using ADLS Gen2, Delta Lake, and Bronze/Silver/Gold layers

Backend Services & Integration:

Design and develop REST APIs and backend services using C#, .NET, and ASP.NET Core.

Build data and integration services using Azure SQL, Cosmos DB, Kusto, Azure Functions, Event Hubs, and Service Bus.

Implement microservices and event-driven processing patterns with secure authentication and authorization.

Modernization & Reliability

Modernize legacy data pipelines, services, APIs, storage platforms, and application components.

Support platform and data migrations while ensuring functional and data parity.

Implement logging, telemetry, dashboards, and proactive alerting using Azure Monitor and Application Insights

Cloud, DevOps & Technical Leadership

Build and maintain CI/CD pipelines using Azure DevOps and Git.

Implement secure cloud practices using Azure Key Vault, identity, authentication, and access controls.

Support Docker and Kubernetes/AKS-based workloads where applicable. xsgimln

Mandatory Skills:

Data Engineering

Azure Databricks, Spark/PySpark

Azure Synapse Analytics, Azure Data Factory

ADLS Gen2, Delta Lake

SQL Server / Azure SQL

Cosmos DB, Kusto / Azure Data Explorer

ETL/ELT, Data Warehousing & Data Modeling

Lakehouse / Medallion Architecture

Data Quality, Reconciliation & Governance

Backend & Services

C#, .NET / ASP.NET Core

REST APIs & Microservices

Azure Functions

Event Hubs & Service Bus

Entity Framework Core

Authentication & Authorization

Cloud & DevOps

Microsoft Azure

Azure DevOps, Git & CI/CD

Azure Monitor & Application Insights

Azure Key Vault

Docker / Kubernetes

Good to Have

React or Angular, TypeScript

GraphQL

Power BI

Infrastructure as Code

SRE / Production Support experience

AI/ML or AI-enabled analytics exposure