Azure Data Engineer

Role & responsibilities

Job Description:

As a Data Engineer, you will work with multiple teams to deliver solutions on the Azure Cloud using core cloud data warehouse tools (Azure Data Factory, Azure Databricks, Azure SQL DW and other Big Data related technologies). In addition to building the next generation of application data platforms (not infrastructure) and/or improving recent implementations. Note: This is a data engineer from the application side. Must be able to analyze data and develop strategies for populating data lakes. This is not an infrastructure position. This person may be called upon to do complex coding using U-SQL, Scala or Python and T-SQL.

Responsibilities:

•              Work as part of a team to develop Cloud Data and Analytics solutions
  
•              Participate in development of cloud data warehouses, data as a service, business intelligence solutions
  
•              Data wrangling of heterogeneous data
  
•              Ability to provide solutions that are forward-thinking in data and analytics
  
•              Deliver a quality product
  
•              Coding complex U-SQL, Spark (Scala or Python). T-SQL
  
•              Developing Modern Data Warehouse solutions using Azure Stack (Azure Data Lake, Azure Data Factory, Azure Databricks)
  

Skills/Qualifications

•              Expertise in Any ETL tool i.e. (SSIS, Informatica, Data Stage)
  
•              Expertise to Implementing Data warehousing Solutions 
  
•              experience as Data Engineer in Azure Big Data Environment
  
•              Programming experience in Scala or Python, SQL
  
•              Hands-on experience in Azure stack (Azure Data Lake, Azure Data Factory, Azure Databricks)  -- Mandatory
  
•              Good understanding of other Azure services like Azure Data Lake Analytics & U-SQL, Azure SQL DW
  
•              Good understanding of Azure Databricks platform and can build data analytics solutions to support the required performance & scale
  
•              Demonstrated analytical and problem-solving skills, particularly those that apply to a big data environment
  
•              Good Understanding of Modern Data Warehouse/Lambda Architecture, Data warehousing concepts
  
•              Proficient in a source code control system such as GIT
  
•              Knowledge of C#
  
•              Ability to code
  
•              Ability to use word to create required technical documentation
  
•              Soft Skills
  
•              Excellent written and verbal skills (English)