TalentCapture

Senior Azure Data Engineer

Apply

Industry: Information Technology | nationwide

2 month's ago

Primary Skills Required
Azure Data platform, SQL, Azure Data Factory (ETL), Key Vault, Azure Synapse, Azure Data Lake, Databricks

Resource Type
Direct Hire

Compensation
160,000.00 to 185,000.00 Salary - Total Comp

Relocate?
No

Job Description

Our client is a leading Microsoft managed partner consulting company.  As a Sr. Azure Data Engineer you will build and manage data pipeline (Data Ingestion, Data Distribution, Data Transformation, Data storage, etc.) for the Azure cloud-based data platform. The candidate should have strong technical, analytical, programming, and critical thinking skills.

Responsibilities/Requirements:

  • Designs, develops, and maintains reliable automated data solutions based on identifying, collecting, and evaluating business requirements, including data models, database objects, stored procedures, and views.
  • Builds complex technical solutions that turn business requirements into operational processes
  • Designs, builds and optimizes big data pipelines, architectures, and data sets.
  • Aligns complex technical solutions to corporate governance requirements to ensure data security and maintain data quality standards
  • Must have an excellent understanding of Big Data Solutions with recent experience as a developer/ data engineer.
  • Partners with Big Data architects and other key stakeholders to ensure that project deliverables align with cost and timing standards.
  • Partners with the data platform engineering team and data architects to build the data pipelines.
  • Overall 6 - 8 Years of experience in Data Integration/ Warehousing projects.
  • Minimum of 3 yrs of experience in Architecture of modern Analytics Solutions using Azure / Databricks
  • Minimum 1 full implementation of Azure / Databricks solution
  • Must have hands-on Azure / Databricks, Azure Data Factory, Azure SQL Data Warehouse, Azure Data Lake experience & Data Integrations.
  • Must be very Strong in SQL & SPARK SQL.
  • Performance Tuning of Spark SQL running on DELTA LAKE storage and Strong Knowledge on Databricks and Cluster Configurations.
  • Strong understanding of Data Warehousing, Data Model, Data Validation, Data Migration.
  • Should have experience in any other ETL tool and projects
  • Working knowledge in Python, Spark, & Scala.
  • Evaluate and recommend key technology elements for the Analytics platform
  • Collaborate with Solution Architects to ensure the technical direction
  • Development of big data pipeline using Azure Data Factory (ETL), Key Vault, SQL SERVER, Azure Synapse, etc.
  • Understanding of Azure Active Directory/Vnet
  • Experience with Java, Scala, .net, python, or R

US Citizens or Green Card holders are encouraged to apply.  We are unable to offer sponsorship at this time.