Email Alert for
ⓘ There was an unexpected error processing your request.
Please refresh the page and try again.
If the problem persists, please contact us with your issue.
You can always manage your preferences and update your interests to ensure you receive the most relevant opportunities.
Get ready to discover your next great opportunity.
Saxon Global
Jersey City, NJ, United States
The Role: You'll work with a cross-functional team of research scientists and engineers to contribute to our software and data platforms. Drive the design and implementation of data models, ETL pipelines, and data processing logic while working closely with the other teams in order to translate operational data with microservices into business valu
Job Source: Saxon GlobalCiti
Jersey City, NJ, United States
About Citi Citi, the leading global bank, has approximately 200 million customer accounts and does business in more than 160 countries and jurisdictions. Our core activities are safeguarding assets, lending money, making payments and accessing the capital markets on behalf of our clients. Citi’s Mission and Value Proposition explain what we do and
Job Source: CitiThe Cypress Group
New York, NY, United States
My client is a profitable, growing, software company that builds the leading ad solution in the country. Their services consume huge volumes of data from a variety of sources. They utilize a home-grown Hadoop-based big data analytics platform to execute analytics and data mining on the data sets. They are currently looking for a talented Software E
Job Source: The Cypress GroupSaxon Global
New York, NY, United States
Big Data Engineer Hybrid-Atlanta GA 12+ Months Contract Phone and Skype Visa: OPT/H4-EAD/GC-EAD/GC/USC Job Description Client Corporation is currently seeking an experienced Data Engineer - Big Data individual for their Midtown office in Atlanta, GA. The successful candidate must have Big Data engineering experience and must demonstrate an af
Job Source: Saxon GlobalAbode Techzone LLC
Jersey City, NJ, United States
Job Description: Looking for consultants local to NY, NJ & CT Mainly we are looking for AWS Not Azure OR GCP NEED EXTENSIVE EXPERIENCE WORKING WITH BANKING CLIENTS Looking for 9 Plus years of experience As a Software Engineer within the Corporate Investment Banking Treasury Services, you are part of an agile team that works to enhance, design
Job Source: Abode Techzone LLCS&P Global
New York, NY, United States
About the Role: Grade Level (for internal use): 12 About the Role: Title: Lead Data Engineer – Big Data The Team: You will be an expert contributor and part of the Rating Organization’s Ingestion Pipelines Engineering Team. This team, who has a broad and expert knowledge on Ratings organization’s critical data domains, technology stacks and a
Job Source: S&P GlobalIntegral Ad Science
New York, NY, United States
Integral Ad Science (IAS) is a global technology and data company that builds verification, optimization, and analytics solutions for the advertising industry and we’re looking for A Senior Data Engineer to join our team. If you are excited by technology that has the power to handle hundreds of thousands of transactions per second; collect tens o
Job Source: Integral Ad ScienceYahoo
Little Ferry, NJ, United States
Yahoo Mail is the ultimate consumer inbox with hundreds of millions of users. It’s the best way to access your email and stay organized from a computer, phone or tablet. With its beautiful design and lightning fast speed, Yahoo Mail makes reading, organizing, and sending emails easier than ever. A Little About Us The Yahoo Mail engineering team d
Job Source: YahooNew York, NY, United States
Hudson River Trading (HRT) is looking for Systems Engineers to join our growing Research & Development team. This team builds and maintains an exceptionally large and growing distributed compute cluster, many-PB-scale storage systems, operating systems, automation software, and development tools.
We are seeking a highly skilled engineer with expertise in Linux administration and experience with Big Data technologies, particularly Kafka, Trino, and Elasticsearch. As a Big Data Systems Engineer, you will play a critical role in ensuring our data infrastructure is robust, scalable, and reliable. You will work closely with our engineering and research teams to design, deploy, and maintain systems that support our research and trading activities.
Responsibilities
Trino Administration: Set up and manage Trino clusters for large-scale data analytics. Optimize and troubleshoot query performance and ensure data integrity across the system
Kafka Administration: Design, deploy, and maintain Apache Kafka clusters. Implement and monitor Kafka-based data pipelines to ensure efficient and reliable data flow
Elasticsearch Administration: Configure and maintain Elasticsearch clusters on managed compute platforms such as Kubernetes
System Monitoring: Develop and implement monitoring solutions to ensure high system uptime and reliability; utilize tools to detect and resolve issues proactively
Linux Administration: Maintain and manage a large-scale Linux-based infrastructure; ensure system stability, security, and performance through best practices in system administration
Collaboration: Work closely with development and research teams to understand their requirements and provide robust data infrastructure solutions, participating in cross-functional projects as needed
Documentation: Create and maintain comprehensive documentation for system architecture, processes, and best practices
Skills
Bachelor's degree in computer science, information technology, or a related field
Minimum of 3-5 years of experience in systems engineering, with a focus on Linux administration
Experience with large scale, big data query engines and technologies such as Trino, Presto, Iceberg, and Hive
Experience with operating and managing large scale Kafka clusters, including design, deployment, and capacity management
Experience with operating and managing large scale Elasticsearch clusters
Experience with container orchestration platforms and technologies such as Kubernetes, Terraform, and Helm
Proficiency in scripting languages such as Python or Bash
Strong problem-solving skills and the ability to work in a fast-paced environment
Excellent communication and collaboration skills
Annual base salary range of $150,000 to $250,000. Pay (base and bonus) may vary depending on job-related skills and experience. A sign-on and discretionary performance bonus may be provided as part of the total compensation package, in addition to company-paid medical and/or other benefits.
#J-18808-Ljbffr
Email Alert for Systems Engineer - Big Data jobs in New York, NY, United States
ⓘ There was an unexpected error processing your request.
Please refresh the page and try again.
If the problem persists, please contact us with your issue.
You can always manage your preferences and update your interests to ensure you receive the most relevant opportunities.
Get ready to discover your next great opportunity.