Data Engineer

Job Title-Data Engineer

Exp-6-8 Yeras

Location- Mumbai

Job Responsibilities-

Actionable

· Designing and implementing data storage solutions on Azure

· Building and maintaining data pipelines for data integration and processing

· Optimizing data processing performance through tuning and monitoring

· Developing and maintaining data models and schemas

· Ensuring data security and privacy prerequisites are followed

· Designing and developing BI reports and dashboards

· Collect data from various sources, transform into a practical format, and load into the appropriate data storage solution on Azure using tools such as Azure Data Factory and Azure Databricks.

· Develop and maintain data models and schemas optimized for specific use cases.

· Ensure that the data stored and processed on Azure conforms with applicable data security and privacy requirements

· Develop operational and functional reports

· Build automated reports and dashboards with the help of Power BI and other reporting tools

· Understand business requirements to set functional specifications for reporting applications

· Be experienced in tools and systems on MS SQL Server BI Stack, including SSRS and TSQL, Power Query, PowerBI

· Be able to quickly shape data into reporting and analytics solutions

Educational Qualifications (examples listed below)

Key Skills

Bachelors degree in Computer Science, IT or related area

· 5 - 8 years of experience in design and development – particularly in databases and reporting ( relational and otherwise)

· Data Engineer with Pyspark, Databricks skillset 4+ years of experience Data Engineering with min 3+ years hands on experience in Pyspark for data transformations

· Proficiency in reporting tools and systems on MS SQL Server BI Stack, including SSRS and TSQL, Power Query, MDX, PowerBI

· Proficiency in Azure Data Factory (ADF) , Azure Data Lake and Databricks

· Delta Lake, Azure SQL and Azure blob storage, Azure logic apps, Azure Functions and Azure Synapse, Azure Purview.

· Extensive knowledge on big data concepts like Hive, and spark framework.

· Should be able to write complex SQL queries. Sound understanding of DWH concepts.

· Strong hands-on experience on Python and/or Scala.