TalentCapture

Senior Azure Data Engineer

Apply

Industry: Technology Consulting | United States - Remote

2 month's ago

Primary Skills Required
previous experience in similar role

Resource Type
Direct Hire

Compensation
150,000.00 to 160,000.00 Salary + Bonus

Relocate?
No

Job Description

Our client is a leading Microsoft-focused consulting company.  Support great clients while working 100% of the time remote.  As a Sr. Azure Data Engineer you will build and manage data pipeline (Data Ingestion, Data Distribution, Data Transformation, Data storage, etc.) for Azure cloud-based data platform. The candidate should have strong technical, analytical, programming, and critical thinking skills.

Responsibilities/Requirements:

  • Designs, develops, and maintains reliable automated data solutions based on identifying, collecting, and evaluating business requirements, including data models, database objects, stored procedures, and views.
  • Builds complex technical solutions that turn business requirements into operational processes
  • Designs, builds and optimizes big data pipelines, architectures, and data sets.
  • Aligns complex technical solutions to corporate governance requirements to ensure data security and maintain data quality standards
  • Must have an excellent understanding of Big Data Solutions with recent experience as a developer/ data engineer.
  • Partners with Big Data architects and other key stakeholders to ensure that project deliverables align with cost and timing standards.
  • Partners with the data platform engineering team and data architects to build the data pipelines.Quisitive
  • Overall 6 - 8 Years of experience in Data Integration/ Warehousing projects.
  • Minimum of 3 yrs of experience in Architecture of modern Analytics Solutions using Azure / Databricks
  • Minimum 1 full implementation of Azure / Databricks solution
  • Must have hands-on Azure / Databricks, Azure Data Factory, Azure SQL Data Warehouse, Azure Data Lake experience & Data Integrations.
  • Must be very Strong in SQL & SPARK SQL.
  • Performance Tuning of Spark SQL running on DELTA LAKE storage and Strong Knowledge on Databricks and Cluster Configurations.
  • Strong understanding of Data Warehousing, Data Model, Data Validation, Data Migration.
  • Should have experience in any other ETL tool and projects • Working knowledge in Python, Spark, & Scala.
  • Evaluate and recommend key technology elements for the Analytics platform
  • Collaborate with Solution Architects to ensure the technical direction
  • Development of big data pipeline using Azure Data Factory (ETL), Key Vault, SQL SERVER, Azure Synapse, etc.
  • Understanding of Azure Active Directory/Vnet
  • Experience with any of the following: Java, .Net, or Python