Lead Big Data Developer
Rockville, MD, United States
Software Guidance & Assistance, Inc., (SGA), is searching for aSr.
Java/Big Data developer
for a
Contract
engagement with a financial services firm in
Rockville, MD .
This position is 100% Remote.
Responsibilities
:Understand complex business requirementsDesign and develop ETL pipeline for collecting, validating and transforming data according to the specificationDevelop automated unit tests, functional tests and performance tests.Maintain optimal data pipeline architectureDesign ETL jobs for optimal execution in AWS cloud environmentReduce processing time and cost of ETL workloadsLead peer reviews and design/code review meetingsProvide support for production support operations teamImplement data quality checks.Identify areas where machine learning can be used to identify data anomaliesRequired
Skills :
Strong experience in Java or ScalaStrong experience in big data technologies like AWS EMR, AWS EKS, Apache SparkStrong experience with serverless technologies like AWS Dynamo DB, AWS LambdaStrong experience in processing with JSON and csv filesMust be able to write complex SQL queriesExperience in performance tuning and optimizationFamiliar with columnar storage formats (ORC, Parquet) and various compression techniquesExperience in writing Unix shell scriptsUnit testing using JUnit or ScalaTestGit/Maven/GradleCode ReviewsExperience with CI/CD pipelinesAgileExperience & Qualifications
:
7+ years of experience in programming language Java or Scala7+ years of experience in ETL projects5+ years of experience in big data projects3+ years of experience with API development (REST API's)Believes in Scrum/Agile, and has deep experience delivering software when working on teams that use Scrum/Agile methodologyStrong and creative analytical and problem-solving skillsPreferred
Skills :
AWS CloudBPM/ AWS Step FunctionsPython scriptingPerformance testing tools like Gatling or JMeter
SGA is a technology and resource solutions provider driven to stand out. We are a women-owned business. Our mission: to solve big IT problems with a more personal, boutique approach. Each year, we match consultants like you to more than 1,000 engagements. When we say let's work better together, we mean it. You'll join a diverse team built on these core values: customer service, employee development, and quality and integrity in everything we do. Be yourself, love what you do and find your passion at work. Please find us at https://sgainc.com/ .
SGA is an Equal Opportunity Employer and does not discriminate on the basis of Race, Color, Sex, Sexual Orientation, Gender Identity, Religion, National Origin, Disability, Veteran Status, Age, Marital Status, Pregnancy, Genetic Information, or Other Legally Protected Status. We are committed to providing access, equal opportunity, and reasonable accommodation for individuals with disabilities in employment, and our services, programs, and activities. Please visit our company EEO page to request an accommodation or assistance regarding our policy.
#J-18808-Ljbffr