Cloud Data Engineer, Sr. Consultant
, NY, United States
Lead a small team of data platform engineers in the design, development, and implementation of data engineering solutions.
Gather requirements from stakeholders and translate them into technical specifications.
Design and implement data pipelines to collect, transform, and load data into data warehouses and data lakes.
Maintain and optimize data systems to ensure high availability and performance.
Work with other engineering teams to integrate data engineering solutions with other systems.
Stay up to date on the latest data engineering technologies and trends.
Assists with the data platform blueprint and design, encompassing the relevant data platform components.
Collaborates with the Integration Architects and Data Architects to ensure cohesive integration between systems and data models.
High degree of (hands-on) technical guidance & vision with broad subject matter expertise in cloud, data and security technologies, specifically AWS, Azure, GCP, Oracle, and SIEM platforms (Splunk ES and Sentinel)
Experience with Terraform
Extensive experience and expertise across the Splunk platform, its architecture and distributed components including premium apps (ITSI, Enterprise Security, Phantom, etc…)
Experience with data streaming technologies
Experience of agile methodologies and associated toolsets and code repositories
Coding experience using languages such as Python and/or Bash
Experience working with CI/CD, Infrastructure-as-Code, and other automation tools
Strong collaboration and stakeholder engagement skills
Self-motivated and organised person
High level of attention to detail, the ability to think architecturally at ‘big picture’ and able to translate this into practical implementation
Excellent ability to execute where information is ambiguous, utilising professionalism, experience and prior knowledge
Excellent analytical and problem-solving skills
Strong interpersonal skills: role will require engagement with a varied and senior stakeholder base
Requirements
6 - 10 years of experience.
Familiar with industry big data platform stack like Databricks, Spark, Hadoop, Flink, Airflow, MPP Database, etc.
Cloud certified with experience
Required strong technical skills and demonstrated experience in each of the following areas:
Excellent communication (written and oral) and interpersonal skills
Deliver right solution architecture, automation and technology choices starting from experimentation and proof of concept phases of new analytical models
#J-18808-Ljbffr