Data Engineer


Industry: Information Technology | Houston, TX, USA

3 years ago

Primary Skills Required
Data Warehousing background and experience with Azure services and big data

Resource Type
Direct Hire

120,000.00 to 160,000.00 Salary - Total Comp


Job Description

About the Role:

This role will work within a team of data scientists and engineers in the Houston office and with a larger team around the country. As part of the data science group, this position will work directly with clients and internal teams to create complete scalable production ready solutions. In addition to technical expertise, this role is expected to communicate highly technical work to all levels of stakeholders in a clear and persuasive manner. G

General Skills:

  • Exposure to Azure Services and big data processing solutions
  • Solid experience in Microsoft traditional data warehousing and BI (SQL Server, SSIS, SSAS, SSRS)

Specific Skills:

  • Data Ingestion and Orchestration from on-premise to Azure using Azure Data Factory and Integration Runtime
  • Azure Databricks notebooks including knowledge of pipeline scripting, data movement, data processing, Delta Lakes, MLFlow and API access/ingestion (REST, SOAP to REST, etc)
  • Experience in Hadoop, SPARK, Hive SSIS extension for Azure DevOps experience including Azure Repos and Azure Pipelines Azure Event Hub/IoT and Stream Analytics Azure Logic App/Functions Azure Data Lake Analytics
  • (USQL) Database development, Data Modeling, architecture and storage Core understanding of Azure security including policies, governance, keys, and service principals
  • Azure Blob Storage and/or Azure Data Lake Store SSAS and experience with tabular data
  • Experience with scripting in SQL, Python, R, Scala and Java Business Skills Analytic Problem-Solving: Approaching high-level challenges with a clear eye on what is important; employing the right approach/methods to make the maximum use of time and human resources.
  • Effective Communication: Detailing your techniques and discoveries to technical and non-technical audiences in a language they can understand.
  • Intellectual Curiosity: Exploring new territories and finding creative and unusual ways to solve problems.
  • Data Analysis Knowledge: Understanding how data is collected, analyzed and utilized.
  • Deep understanding of Data Warehousing including ingestion, transformation and consumption of data