Big Data Developer
McLean, VA, United States
Position Overview:
Freddie Mac's Single-Family Division is currently seeking a Senior Big Data Developer to implement Big Data tools and methods of data processing and ingestion as a member of the Credit Analytics and Reporting team.
Responsibilities include:
• Cleanse, manipulate and analyze large datasets (Structured and Unstructured data - XMLs, JSONs, PDFs) using Hadoop platform.
• Develop Python, PySpark, Spark scripts to filter/cleanse/map/aggregate data.
• Manage and implement data processes (Data Quality reports)
• Develop data profiling, deduping logic, matching logic for analysis
• Programming Languages experience in Python, PySpark and Spark for data ingestion
• Programming experience in BigData platform using Hadoop platform
• Present ideas and recommendations on Hadoop and other technologies best use to management
Qualifications:
• 5+ years of experience in processing large volumes and variety of data (Structured and unstructured data, writing code for parallel processing, XMLS, JSONs, PDFs) - Mandatory
• 3+ years of programming experience in Python, Spark for data processing and analysis. - Mandatory
• Strong SQL experience is a must - Mandatory
• 3+ years of experience - using Hadoop platform and performing analysis. Familiarity with Hadoop cluster environment and configurations for resource management for analysis work
• 2+ years of experience with containerization and orchestration. Hands on experience with AWS, Kubernetes, Kubeflow, Docker etc.
- Optional
• Detail oriented. Excellent communication skills (verbal and written)
• Must be able to manage multiple priorities and meet deadlines
• Degree in Statistics, Economics, Business, Mathematics, Computer Science or related field
EEO Employer
Apex Systems is an equal opportunity employer. We do not discriminate or allow discrimination on the basis of race, color, religion, creed, sex (including pregnancy, childbirth, breastfeeding, or related medical conditions), age, sexual orientation, gender identity, national origin, ancestry, citizenship, genetic information, registered domestic partner status, marital status, disability, status as a crime victim, protected veteran status, political affiliation, union membership, or any other characteristic protected by law. Apex will consider qualified applicants with criminal histories in a manner consistent with the requirements of applicable law. If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation in using our website for a search or application, please contact our Employee Services Department at [email protected] or 844-463-6178.
Required Skills : This is a Senior Level Data Engineer opening - Must haves include PySpark, Hadoop, Snowflake, SQL. Experience with AWS Cloud is preferred.
Basic Qualification : • 5+ years of experience in processing large volumes and variety of data (Structured and unstructured data, writing code for parallel processing, XMLS, JSONs, PDFs) - Mandatory • 3+ years of programming experience in Python, Spark for data processing and analysis. - Mandatory • Strong SQL experience is a must - Mandatory • 3+ years of experience - using Hadoop platform and performing analysis. Familiarity with Hadoop cluster environment and configurations for resource management for analysis work • Degree in Statistics, Economics, Business, Mathematics, Computer Science or related field
Additional Skills : • 5+ years of experience in processing large volumes and variety of data (Structured and unstructured data, writing code for parallel processing, XMLS, JSONs, PDFs) - Mandatory • 3+ years of programming experience in Python, Spark for data processing and analysis. - Mandatory • Strong SQL experience is a must - Mandatory • 3+ years of experience - using Hadoop platform and performing analysis. Familiarity with Hadoop cluster environment and configurations for resource management for analysis work • Degree in Statistics, Economics, Business, Mathematics, Computer Science or related field
Background Check :Yes
Drug Screen :Yes
Notes :Staff Aug
Selling points for candidate :
Project Verification Info :
Candidate must be your W2 Employee :Yes
Exclusive to Apex :No
Face to face interview required :No
Candidate must be local :No
Candidate must be authorized to work without sponsorship ::No
Interview times set : :No
Type of project :Development/Engineering
Master Job Title :VMS Access Entry
Branch Code :DC Metro Commercial