Data Engineer Lead
Boston, MA, United States
Boston Energy Trading & Marketing (BETM) is looking for an innovative Lead Data Engineer who is passionate about data and analytics, highly motivated and can take technical ownership of data solutions with an emphasis on engineering efficiency and on-time delivery. This position is a critical hands-on role partnering closely with other product teams to build and enhance solutions that drive value for our clients. The Lead Data Engineer will focus on designing backend data models, architecting data flows, maintaining the stability of the platform and beyond. The role requires a strong ability to work independently while collaborating with other IT teams at BETM. This position will report to the head of IT Team and will be in our Boston, MA office.
Responsibilities:
Provide technical leadership in data architecture, ensuring best practices for data modeling, storage, and retrieval.
Lead the scoping, design and implementation of complex features including multi-layered data workflows.
Oversee data governance and quality, ensuring data accuracy, consistency, and compliance with industry standards.
Build and maintain data models and data pipelines to enable performant and scalable products.
Work with multiple sources of data, storage systems, and building processes and pipelines to provide cohesive datasets for analysis and modeling.
Ensure a high-quality code base by writing and reviewing performant & scalable, well-tested code.
Collaborate with cross-functional teams to define data requirements and design solutions that align with business objectives.
Mentor software engineers & data engineers, establishing data best practices and creating up-skilling opportunities for the team.
Drive innovative improvements to team development processes.
Build and manage a team of data engineers.
Qualifications:
Bachelor's or higher degree in Computer Science, Mathematics, Physics, Quantitative Finance, Engineering, Statistics or equivalent field.
7+ years of data engineering experience in an agile production environment.
Experience handling large amounts of fundamental datasets and market data.
Experience in building and deploying production-level data-driven applications and data processing workflows/pipelines.
Experience working with enterprise databases and modern cloud-based environments leveraging industry best practices to manage large data sets supporting analytics and regression.
Experience in Python, Java/.Net technologies to manage data lifecycle across data ingestion, feature engineering, modeling, tuning, evaluating, monitoring, and presenting.
Experience utilizing DevOps framework tools. Familiarity with Microsoft Azure tools is a plus
Effective communication and collaboration skills to work with both technical and non-technical stakeholders.
Results-oriented team player, with the ability to handle a rapidly changing set of projects and priorities while maintaining a strong professional presence.
Strong analytical skillset with demonstrated attention to detail.
Fast learner with the ability to adapt quickly and work in a dynamic environment.
Excellent time management skills.
Desired Experience:
Hands-on professional programming experience across commodities or other financial markets
Experience across power industry and power trading is a big plus. Knowledge of US ISO power markets strongly preferred.
Familiarity with industry best practices for collection and use of data.
Strong technologist eager to learn new technologies and frameworks.
Project management skills and a demonstrated ability to understand complex information product constructs.