Big Data Platform Engineer
Irving, TX, United States
*This is a hybrid role, based in G-Research’s office in Dallas.*
G-Research is Europe’s leading quantitative finance research firm. We hire the brightest minds in the world to tackle some of the biggest questions in finance. We pair this expertise with machine learning, big data, and some of the most advanced technology available to predict movements in financial markets.
Opened in 2022, the Dallas office is a key infrastructure hub where we work on the latest technologies in a cutting-edge environment.
*The role*
G-Research is a fast-growing, software-driven organisation. We use large-scale deployments of distributed systems to drive research and monitoring capabilities within the business.
We are looking for a Big Data Platform Engineer to build, maintain, and support key big data platforms.
Key responsibilities of the role include:
* Developing, maintaining and supporting scalable and reliable big data solutions
* Collaborating with cross-functional teams to gather requirements, assess technical feasibility, and provide recommendations for optimal solution implementation
* Owning the design and delivery of small to medium sized projects, ensuring adherence to best practices, performance optimisation, and alignment with overall platform architecture
* Proactively identifying and addressing system performance bottlenecks, potential security vulnerabilities, and areas for improvement to ensure systems are stable and robust
* Providing metrics, documentation, and self-service infrastructure that help our users to work at pace and optimise their use of the platform
* Keeping up-to-date with industry trends, emerging technologies, and best practices in the field of big data platform engineering, and contributing to the continuous improvement of the platform
*Who are we looking for?*
The Big Data Platform Engineering team have a diverse set of complementary skills. Typically, team members will have strong abilities in infrastructure automation, Big Data technologies or software development. Whatever your technical background, strong coding skills are key.
The ideal candidate will have the following skills and experience:
* A strong desire to continually learn about new technologies, approaches, and systems, along with the agility to work across multiple teams
* A willingness to learn by working with users across different business areas, experiences and cultures to drive towards the best outcome for G-Research
* Excellent problem solving skills
* Linux and Networking fundamentals
* Python, used for automation and integration
* Experience with CI/CD (preferably Jenkins and ArgoCD) and Configuration Management tools, such as Ansible and Terraform
* Experience deploying and running applications on Docker and Kubernetes, including the creation of Helm charts
* Experience working with distributed systems
Highly desirable but not essential:
* Experience working with the Prometheus Grafana monitoring stack
* Experience working with Big Data technologies, such as Spark, Trino, Hive, Airflow, YARN, HDFS, and Ozone
* Experience working with distributed storage systems
* Data Engineering experience (Spark application development, SQL)
*Why should you apply?*
* Market-leading compensation plus annual discretionary bonus
* Informal dress code and excellent work/life balance
* Excellent paid time off allowance
* Sick days, military leave, and family and medical leave
* Generous 401(k) plan
* 12-weeks’ fully paid parental leave
* Medical and Prescription, Dental, and Vision insurance
* Life and Accidental Death & Dismemberment (AD&D) insurance
* Employee Assistance and Wellness programs
* Generous relocation allowance and support
* Great selection of office snacks, and hot and cold drinks
* On-site gym and car park
Job Type: Full-time
Salary: $200,000.00 - $350,000.00 per year
Benefits:
* 401(k)
* Dental insurance
* Health insurance
* Paid time off
* Relocation assistance
* Vision insurance
Compensation package:
* Bonus opportunities
Schedule:
* Monday to Friday
Ability to commute/relocate:
* Irving, TX 75039: Reliably commute or planning to relocate before starting work (Required)
Work Location: Hybrid remote in Irving, TX 75039