Senior Associate - Senior Data Engineer

Acuity Knowledge Partners

7 - 12 years

4 - 8 Lacs

Bengaluru

Posted:1 month ago| Platform:

Apply

Skills Required

c# azure databricks activebatch ps orchestration data warehousing azure sql dw data pipeline data engineering sql data bricks equity market sql azure system oracle adf writing powershell mysql ssis etl data lake batch script communication skills

Work Mode

Work from Office

Job Type

Full Time

Job Description

Conduct technical analyses of existing data pipelines, ETL processes, and on-premises/cloud system, identify technical bottlenecks, evaluate migration complexities, and propose optimizations.

Desired Skills and experience

Candidates should have a B.E./B.Tech/MCA/MBA in Finance, Information Systems, Computer Science or a related field
7+ years of experience as a Data and Cloud architecture with client stakeholders
Strong experience in Synapse Analytics, Databricks, ADF, Azure SQL (DW/DB), SSIS.
Strong experience in Advanced PS, Batch Scripting, C# (.NET 3.0).
Expertise on Orchestration systems with ActiveBatch and AZ orchestration tools.
Strong understanding of data warehousing, DLs, and Lakehouse concepts.
Excellent communication skills, both written and verbal
Extremely strong organizational and analytical skills with strong attention to detail
Strong track record of excellent results delivered to internal and external clients
Able to work independently without the needs for close supervision and collaboratively as part of cross-team efforts
Experience with delivering projects within an agile environment
Experience in project management and team management

Key responsibilities include:

Understand and review PowerShell (PS), SSIS, Batch Scripts, and C# (.NET 3.0) codebases for data processes.
Assess the complexity of trigger migration across Active Batch (AB), Synapse, ADF, and Azure Databricks (ADB).
Define usage of Azure SQL DW, SQL DB, and Data Lake (DL) for various workloads, proposing transitions where beneficial.
Analyze data patterns for optimization, including direct raw-to-consumption loading and zone elimination (e.g., stg/app zones).
Understand requirements for external tables (Lakehouse)
Lead project deliverables, ensuring actionable and strategic outputs.
Evaluate and ensure quality of deliverables within project timelines
Develop a strong understanding of equity market domain knowledge
Collaborate with domain experts and business stakeholders to understand business rules/logics
Ensure effective, efficient, and continuous communication (written and verbally) with global stakeholders
Independently troubleshoot difficult and complex issues on dev, test, UAT and production environments
Responsible for end-to-end delivery of projects, coordination between client and internal offshore teams and manage client queries
Demonstrate high attention to detail, should work in a dynamic environment whilst maintaining high quality standards, a natural aptitude to develop good internal working relationships and a flexible work ethic
Responsible for Quality Checks and adhering to the agreed Service Level Agreement (SLA) / Turn Around Time (TAT)

More Jobs at Acuity Knowledge Partners

Senior Professional- Billing Ops - Reporting & Mgmt

Gurugram

6 - 11 yrs

INR 10 - 15 Lacs

Senior Associate/Associate-Qual & Quant

Gurugram

2 - 5 yrs

INR 6 - 9 Lacs

Professional - Sales & Revenue Reporting

Gurugram

3 - 6 yrs

INR 5 - 10 Lacs

Associate - DCM

Gurugram

2 - 4 yrs

INR 6 - 8 Lacs

Associate-Qual & Quant

Gurugram, Haryana, India

2 - 5 yrs

Salary: Not disclosed

Mock Interview

Practice Video Interview with JobPe AI

Start Job-Specific Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.