Hadoop Developer

We are looking for a Senior Hadoop Developer with strong experience in Big Data, Hadoop/Cloudera, Spark, Python, SQL, and ETL to design, develop, and support scalable data solutions in a production environment.

Roles and Requirements

4+ years of experience in Big Data and data warehousing.

Strong hands-on experience with Hadoop/Cloudera, HDFS, Hive, and Spark/PySpark.

Proficiency in Python, Scala, SQL, and Unix/Shell scripting.

Strong experience in ETL, data ingestion, transformation, and integration.

Experience with complex SQL query optimization and performance tuning.

Experience with AutoSys or similar enterprise scheduling tools.

Strong understanding of distributed systems and large-scale data processing.

Experience supporting production Big Data applications and troubleshooting critical issues.

Understanding of Agile methodologies and enterprise development/operational processes.

Strong analytical, problem-solving, communication, and collaboration skills.

Experience designing analytical/data warehouse environments and BI solutions.

Financial services/banking experience preferred.

Primary Responsibilities

Develop and maintain scalable Hadoop/Spark-based data pipelines.

Support data ingestion from multiple source systems.

Develop ETL and data transformation solutions using Hive, Spark, Python, and SQL.

Optimize SQL queries and Big Data jobs for performance.

Troubleshoot production issues and perform root-cause analysis.

Support scheduling, monitoring, and operational processes.

Collaborate with architects, developers, analysts, and business teams.

Evaluate and adopt emerging Big Data technologies where appropriate.