Data Engineer
, NY, United States
The Data Engineer is responsible for expanding and optimizing our data and data pipeline architecture, optimizing data flow and collection, and ensuring a consistent and reliable data delivery system. This role involves building and maintaining data systems from the ground up and supporting software developers, architects, and data owners across various initiatives. The ideal candidate is self-directed and comfortable managing the data needs of multiple teams, systems, and products.
Responsibilities:
Design, construct, test, and maintain data architectures and data pipelines.
Ensure the data architecture meets business requirements.
Develop custom data models and algorithms to apply to data sets.
Assess the effectiveness and accuracy of new data sources and data gathering techniques, and identify opportunities for data acquisition.
Develop data set processes for data modeling, mining, and production.
Use a variety of languages and tools to integrate systems.
Recommend ways to improve data reliability, efficiency, and quality.
Utilize large volumes of data from internal and external sources to meet business demands.
Automate data preparation and integration tasks using innovative tools and techniques.
Propose appropriate data ingestion, preparation, integration, and operationalization techniques.
Lead the development of data governance policies and best practices for data consumers and users.
Coordinate with different functional teams to implement models and monitor outcomes.
Develop processes and tools to monitor and analyze model performance and data accuracy.
Required Skills:
Bachelor's or Master's degree in Computer Science, Statistics, Applied Mathematics, Data Management, Information Systems, Information Science, or a related quantitative field, or equivalent work experience.
At least five years of experience in data management disciplines, including data integration, modeling, optimization, and data quality.
At least three years of experience working in cross-functional teams and collaborating with business stakeholders to support departmental and multi-departmental data management and analytics initiatives.
Excellent communication and collaboration skills.
Excellent problem-solving and analytical skills.
Highly effective in a collaborative environment.
Ability to independently resolve issues and efficiently self-direct work activities based on capturing, organizing, and analyzing information.
Compensation :
$110k-$160k base salary
#J-18808-Ljbffr