Data Engineer

Job Title-Data Engineer

Exp-6-8 Yeras

Location- Mumbai

Job Responsibilities-

Actionable

Designing and implementing data storage solutions on Azure

Building and maintaining data pipelines for data integration and processing

Optimizing data processing performance through tuning and monitoring

Developing and maintaining data models and schemas

Ensuring data security and privacy prerequisites are followed

Designing and developing BI reports and dashboards

Collect data from various sources, transform into a practical format, and load into the appropriate data storage solution on Azure using tools such as Azure Data Factory and Azure Databricks.

Develop and maintain data models and schemas optimized for specific use cases.

Ensure that the data stored and processed on Azure conforms with applicable data security and privacy requirements

Develop operational and functional reports

Build automated reports and dashboards with the help of Power BI and other reporting tools

Understand business requirements to set functional specifications for reporting applications

Be experienced in tools and systems on MS SQL Server BI Stack, including SSRS and TSQL, Power Query, PowerBI

Be able to quickly shape data into reporting and analytics solutions

Educational Qualifications (examples listed below)

Key Skills

Bachelors degree in Computer Science, IT or related area

5 - 8 years of experience in design and development particularly in databases and reporting ( relational and otherwise)

Data Engineer with Pyspark, Databricks skillset 4+ years of experience Data Engineering with min 3+ years hands on experience in Pyspark for data transformations

Proficiency in reporting tools and systems on MS SQL Server BI Stack, including SSRS and TSQL, Power Query, MDX, PowerBI

Proficiency in Azure Data Factory (ADF) , Azure Data Lake and Databricks

Delta Lake, Azure SQL and Azure blob storage, Azure logic apps, Azure Functions and Azure Synapse, Azure Purview.

Extensive knowledge on big data concepts like Hive, and spark framework.

Should be able to write complex SQL queries. Sound understanding of DWH concepts.

Strong hands-on experience on Python and/or Scala.