Data Engineer

Required Skills: Bachelors degree, or equivalent work experience

10+ years' experience in ETL processes and tools such as Apache Spark, Java, Spring batch, J2EE

5+ years' experience in Hadoop, Hive, SQL and noSQL databases

Roles & Responsibilities: Data Engineering ETL role Design, code, test, debug, document, maintain, and modify computer programs of high complexity, significance, and risk Participate in application architecture functions including estimating and defining time tables, cost and project tasks Recommend solutions to improve business with a focus on core architecture, technology strategies and standards Guide others through change impact analysis Establish, refine and integrate development and test environment tools and software as needed Review, analyze, refine and integrate development and test environment tools and software as needed Create and recommend improvements to unit, test plans and testing process based on assessment of organizational needs Collaborate closely with teams in all stages of software development lifecycle including design, development and testing of the system Design basic and detailed program specifications while ensuring that expected application performance levels are achieved by managing interfaces, service levels, standards, and configurations Guide technical staff and business partners to investigate, review, and solve complex, multidisciplinary business problems Monitor operating efficiency and organizational needs of existing application systems and identify opportunities to fine-tune and optimize applications of developed projects and recommend technical solutions Demonstrate solid understanding of the business needs driving the projects