Azure Data Engineer - Hybrid in Palo Alto,CA
Palo Alto, CA, United States
One of our clients in Palo Alto is looking for Azure Data Engineer with the following skills and experience:
NOTE: This is a DIRECT HIRE position. Candidates will be working 3 days onsite in Palo Alto,CA
Position: Azure Data Engineer
Must-Haves:
Expertise in Azure Cloud platform services.
Proficient in SQL with a focus on Azure SQL.
Heavy experience with RESTful API development.
Familiarity with Azure Data Factory (ADF).
Experience working with Prophecy and Purview for data pipeline design and data governance.
Responsibilities:
Design and develop end-to-end data pipelines across various data sources and systems, ensuring data quality and integrity.
Develop data models, structures, and ETL jobs for efficient data acquisition and transformation.
Work closely with cloud service providers to align solutions with platform offerings.
Manage and maintain cloud-based data and analytics platforms, including performing quick proof of concepts for data solutions.
Implement Unified Data governance and Data Quality Management solutions for enterprise data governance.
Interact with business stakeholders to understand requirements and translate them into technology solutions.
Qualifications:
Bachelor's degree in computer science, computer engineering, or related field with 10+ years of experience.
Strong expertise in Azure SQL, including complex SQL queries and performance tuning.
Experience with Azure API Management Service and RESTful API development.
Proficiency in real-time data processing using Azure Event Hubs, Service Bus, and Stream Analytics.
Knowledge of data transformation languages like .Net/C#, Python, Java, R, or Scala, preferably with Databricks/Spark.
Experience with NoSQL Databases and Azure CosmosDB.
Familiarity with Azure Purview for data cataloging and metadata management.
Experience with Azure Data Lake Storage Gen2 and Azure BLOB storage.
Understanding of different data formats such as Parquet, Avro, CSV, ORC, etc.
Experience in creating, scheduling, and monitoring Azure Data Factory (ADF) pipelines.
Previous experience in a fast-paced, agile environment.
Ability to work with on-shore/off-shore teams.
Interested candidates may submit their resumes online or call at 310-906-4780 for further information regarding the position.
Beacon Hill is an Equal Opportunity Employer that values the strength diversity brings to the workplace. Individuals with Disabilities and Protected Veterans are encouraged to apply.
If you would like to complete our voluntary self-identification form, please click here or copy and paste the following link into an open window in your browser: https://jobs.beaconhillstaffing.com/eeoc/
Completion of this form is voluntary and will not affect your opportunity for employment, or the terms or conditions of your employment. This form will be used for reporting purposes only and will be kept separate from all other records.
Company Profile:
Beacon Hill Technologies, a premier National Information Technology Staffing Group, provides world class technology talent across all industries utilizing a complete suite of staffing services. Beacon Hill Technologies' dedicated team of recruiting and staffing experts consistently delivers quality IT professionals to solve our customers' technical and business needs.
Beacon Hill Technologies covers a broad spectrum of IT positions, including Project Management and Business Analysis, Programming/Development, Database, Infrastructure, Quality Assurance, Production/Support and ERP roles.
Learn more about Beacon Hill Staffing Group and our specialty divisions, Beacon Hill Associates, Beacon Hill Financial, Beacon Hill HR, Beacon Hill Legal, Beacon Hill Life Sciences and Beacon Hill Technologies by visiting www.beaconhillstaffing.com.
We look forward to working with you.
Beacon Hill. Employing the Future
#J-18808-Ljbffr