Our client is a leading Microsoft-focused consulting company.  Support great clients while working 100% of the time remote.  As a Sr. Azure Data Engineer you will build and manage data pipeline (Data Ingestion, Data Distribution, Data Transformation, Data storage, etc.) for Azure cloud-based data platform. The candidate should have strong technical, analytical, programming, and critical thinking skills.

Responsibilities/Requirements:

• Designs, develops, and maintains reliable automated data solutions based on identifying, collecting, and evaluating business requirements, including data models, database objects, stored procedures, and views.
• Builds complex technical solutions that turn business requirements into operational processes
• Designs, builds and optimizes big data pipelines, architectures, and data sets.
• Aligns complex technical solutions to corporate governance requirements to ensure data security and maintain data quality standards
• Must have an excellent understanding of Big Data Solutions with recent experience as a developer/ data engineer.
• Partners with Big Data architects and other key stakeholders to ensure that project deliverables align with cost and timing standards.
• Partners with the data platform engineering team and data architects to build the data pipelines.Quisitive
• Overall 6 - 8 Years of experience in Data Integration/ Warehousing projects.
• Minimum of 3 yrs of experience in Architecture of modern Analytics Solutions using Azure / Databricks
• Minimum 1 full implementation of Azure / Databricks solution
• Must have hands-on Azure / Databricks, Azure Data Factory, Azure SQL Data Warehouse, Azure Data Lake experience & Data Integrations.
• Must be very Strong in SQL & SPARK SQL.
• Performance Tuning of Spark SQL running on DELTA LAKE storage and Strong Knowledge on Databricks and Cluster Configurations.
• Strong understanding of Data Warehousing, Data Model, Data Validation, Data Migration.
• Should have experience in any other ETL tool and projects • Working knowledge in Python, Spark, & Scala.
• Evaluate and recommend key technology elements for the Analytics platform
• Collaborate with Solution Architects to ensure the technical direction
• Development of big data pipeline using Azure Data Factory (ETL), Key Vault, SQL SERVER, Azure Synapse, etc.
• Understanding of Azure Active Directory/Vnet
• Experience with any of the following: Java, .Net, or Python