Backend Software Engineer
San Mateo, CA, United States
Backend Software Engineer
Location: Foster City, CA/Hybrid
Duration: 6 months with possible extension
Description:
The Data Team leverages data from our autonomous vehicles and operations to determine autonomy and service readiness.
We provide the foundation for strategic decision-making at Client.
You will help develop and implement the next generation of our data pipeline to ensure visibility into our business as we scale toward the launch of an autonomous mobility service.
You will define the system and build the pipeline to enable Client to develop and scale with a data-first culture.
Responsibilities
Design, build, and maintain a platform used by Client teams to build large-scale data pipelines
Drive platform efficiency improvements to reduce latency and improve data freshness
Support data-driven engineering decisions through improved observability and key metrics
Partner with engineering teams to support long-term scaling of their data pipelines
Qualifications
5+ years of software engineering experience
Strong fluency with Python
Strong understanding of distributed systems
Strong written and verbal communication skills
Good experience building and maintaining data intensive production systems at scale
Good experience with relational databases and non-relational (NoSQL) databases
Good experience with infrastructure-as-code tools (e.g. Terraform, ...)
Experience with large scale streaming platforms (e.g. Kafka, Kinesis)
Bonus Qualifications
Experience with data warehouse platforms (e.g. Redshift, BigQuery, Databricks, ...)
Experience building scalable and maintainable data pipelines
Experience with AWS ECS and/or Kubernetes
Experience with a workflow manager such as Airflow
Experience with large scale processing frameworks (e.g. Spark, Hadoop, ...)
Call Notes:
Will largely revolve around microservice development in Python
Focus on increasing efficiency, optimization and resolving edge cases rather than adding new features
Daily responsibilities - creating pull requests for Python code or Terra Form deployment code
Needs experience with AWS and Terra Form for deployment
Additional beneficial skills: knowledge of AWS ECS and Python libraries like SQL Al chemy
Bonus if they have knowledge of data warehouse platforms Redshift, Big Query, Dada bricks, Airflow
#J-18808-Ljbffr