Big Data Engineer

Big Data Engineer Visa status: U.S. Citizens and those authorized to work in the U.S. are encouraged to apply. Tax Terms: W2, 1099 Corp-Corp or 3rd Parties: Yes SO#000452348623 Austin, TX

Skill Description - Hadoop, Kafka, Hbase, Spark, big data admin

Essential Functions:

Perform Big Data Platform Administration and Engineering activities on multiple Hadoop, Kafka, Hbase, and Spark clusters

Work on Performance Tuning and Increase Operational efficiency on a continuous basis

Monitor health of the platforms and Generate Performance Reports and Monitor and provide continuous improvements

Working closely with development, engineering, and operation teams jointly work on key deliverables ensuring production scalability and stability

Develop and enhance platform best practices

Ensure the Hadoop platform can effectively meet performance & SLA requirements

Responsible for Big Data Production environment which includes Hadoop (HDFS and YARN), Hive, Spark, Livy, SOLR, Oozie, Kafka, Airflow, Nifi, Hbase, etc

Perform optimization, debugging, and capacity planning of a Big Data cluster

Perform security remediation, automation, and self heal as per the requirement

Qualifications:

Basic Qualifications:

2 years of work experience with a Bachelor's Degree or an Advanced Degree

Hands on Experience in Hadoop Admin, Hive, Spark, Kafka is must

Preferred Qualifications:

Minimum 3 years of work experience in maintaining optimization issue resolution of Big Data large scale clusters supporting Business users and Batch process

Hands-on Experience No SQL Databases HBASE is plus

Prior Experience in Linux / Unix OS Services Administration Shell awk scripting is a plus

Excellent oral and written communication and presentation skills

Analytical and problem solving skills

Self-driven Ability to work independently and as part of a team with proven track record

Experience on Hortonworks distribution or Open Source preferred

Work Hours:

Incumbent must make themselves available during core business hours. Occasional weekend and evening hours needed on a rotational basis for operational support.

Travel Requirements:

This position requires the incumbent to travel for work 5% of the time.

Physical Requirements:

This position will be performed in an office setting. The position will require the incumbent to sit and stand at a desk, communicate in person and by telephone frequently, operate standard office equipment such as telephones and computers, and reach with hands and arms.