Senior Data Engineer

Role & responsibilities

Understand the business requirements for analytics and data interpretation

Understands requirements and is involved in the discussions relating to technical and functional design of

the sprint/ module/project

Design and implement end-to-end data solutions (storage, integration, processing, visualization) in Azure.

Used various sources to ingest data into Azure Data Lake Storage (ADLS) such as SQL Server, Excel, Oracle,

SQL Azure etc.

Extract data from one database and load it into another

Build data architecture for ingestion, processing, and surfacing of data for large-scale applications

Use many different scripting languages, understanding the nuances and benefits of each, to combine

systems

Research and discover new methods to acquire data, and new applications for existing data

Work with other members of the data team, including data architects, data analysts, and data scientists

Prepare data sets for analysis and interpretation

Perform statistical analysis and fine-tuning using test results

Create libraries and extend the existing frameworks

Create design documents basis discussions and assists in providing technical solutions for the business

process

Preferred candidate profile

In-depth understanding of database management systems, online analytical processing (OLAP) and ETL

(Extract, transform, load) framework

Knowledge in Azure SQL Database, Azure Data Lake, Azure Data Factory(ADF), Azure Blob Storage.

Recreate existing application logic and functionality in the Azure Data Lake, Data Factory, SQL Database and

SQL data warehouse environment.

Demonstrates strong technical leadership by making architectural decisions and

guiding the team in data pipeline design.

Communicates effectively with stakeholders to align on technical requirements across

product, analytics, and infrastructure teams.

Provides mentoring and technical guidance to mid-level and junior members to support

their skill development.

8-10 Years of experience.