Sr Cloud Engineer

San Francisco, CA, United States

Company Federal Reserve Bank of San Francisco We are the Federal Reserve Bank of San Francisco—public servants with a mission to advance the nation’s monetary, financial, and payment systems to build a stronger economy for all Americans. We are a community-engaged bank, and are committed to understanding and serving the vibrant, expansive communities of the Twelfth District. That means we seek and appreciate new perspectives. We respect people for what they do and for who they are. We build opportunities to learn and grow. When you join the SF Fed, you become part of a diverse team united in its purpose to promote an economy that works for everyone. The Federal Reserve Bank of San Francisco is looking for a Sr. Cloud Data Engineer to join the Data and Analytics Service (DAS) Team. We are a team based out of San Francisco that partners with business lines across the Federal Reserve System to deliver the cloud + big data solutions and advanced analytics products.

The successful candidate will design, implement, and manage cloud-based data and AI solutions, ensuring scalable, secure, and repeatable data pipelines. The ideal candidate will have a strong background in data engineering, cloud infrastructure, scripting languages, and excellent analytical and communication skills.

Essential Responsibilities: Builds next-generation AI & analytics framework developed on a group of core technologies.

Lead multi-functional teams in designing and implementing cloud-based data and AI solutions.

Ensure data pipelines are scalable, secure, and repeatable.

Collaborate with stakeholders to understand business requirements and turn data into insights.

Develop and maintain cloud infrastructure, including data lakes, warehouses, and analytics platforms.

Implement data governance and security best practices.

Acts as a role model, thought leader, and change management for new software and technology throughout the company.

Works on multiple projects as a technical team member driving business requirements end to end

Takes end to end accountability of all data products and solutions.

Leads training bootcamps, & cross training workshops for internal & stakeholders.

Participates in pilots, Proof of Concepts and research on future data technologies and industry trends.

Qualifications: Bachelor’s degree in computer science, Information Systems, or other related technical field or equivalent work

Must be a U.S. Citizen or a Green Card holder with the intent to become a U.S. Citizen

Typically requires 7 or more years of experience in data engineering, data science, and software engineering.

Advanced knowledge of Amazon Web Services (AWS) and cloud infrastructure

Strong programming skills in Java or Python, or Scala

Design, build, and maintain machine learning data pipelines.

Experience in developing an end-to-end AWS native platform for building Data lakes (S3, Glue (Crawlers, ETL, Catalog), IAM, CodePipeline, CodeCommit, CloudFormation/Terraform, CloudTrail, CloudWatch, AWS Config, Guard Duty, Secrets Manager, KMS, EC2, Data Visualization Tool: Tableau run on an EC2 or AWS Quicksight), Athena, AWS AI (Bedrock, SageMaker, Q)

Experience in Ansible/Terraform/Cloud Formation scripts and Infrastructure as Code scripting is required.

Experience in Continuous Integration, Continuous Delivery, and Continuous Deployment software tools to support, enhance and grow our CI and CD capabilities.

Experience in Databricks, Alteryx, Collibra etc.,

Desired Skills: Background in data security, governance and cybersecurity solutions.

Domain experience in HR, Information Security, Finance, Business as IT

Experience with and/or working knowledge the Financial Industry, Government Agencies, Federal Reserve Bank Lines of Business (LoBs) Applications

Experienced in implementing AI, Data and Advanced Analytics solutions, and SaaS or related experience in the Cloud.

Hands on experience in Generative AI implementation and optimization (HuggingFace, GPT, NLP, LLM)

Base Salary Range: Min: $138,900 - Mid: $180,400 - Max: $221,900 (Location: San Francisco)

Final salary and offer will be determined by the applicant’s background, experience, skills, internal equity, and alignment with market data.

We offer a wonderful benefits package including Medical, Dental, Vision, Pre-tax Flexible Spending Account, Backup Childcare Program, Pre-Tax Day Care Flexible Spending Account, Paid Family Care Leave, Vacation Days, Sick Days, Paid Holidays, Pet Insurance, Matching 401(k), and Retirement/Pension.

We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, perform essential job functions, and receive other benefits and privileges of employment. The SF Fed is an Equal Opportunity Employer.

#LI-Hybrid

Full Time / Part Time Full time Regular / Temporary Regular Job Exempt (Yes / No) Yes Job Category Analytical Work Shift First (United States of America) The Federal Reserve Banks believe that diversity and inclusion among our employees is critical to our success as an organization, and we seek to recruit, develop and retain the most talented people from a diverse candidate pool. The Federal Reserve Banks are committed to equal employment opportunity for employees and job applicants in compliance with applicable law and to an environment where employees are valued for their differences.

Privacy Notice