Senior Data Engineer

Experience - 8yrs - 16yrs

Note - Immediate, 15days, serving notice period.

Responsibilities & Required Skills:

Key Responsibilities

Database Engineering & Development

• Develop, optimize, and maintain complex SQL queries, stored procedures, triggers, and packages (Oracle / SQL Server).
• Write high-quality PL/SQL code for performance-intensive applications.
• Perform query tuning using execution plan analysis, statistics review, and optimizer hints.
• Apply strong understanding of database internals indexing strategies, caching, buffer pools, memory management, etc.
• Implement partitioning, sharding, and parallel query execution techniques for large datasets.

Data Pipeline Engineering

• Build and optimize ETL/ELT pipelines for large-scale batch and streaming data processing.
• Improve data ingestion, transformation, and consumption efficiency across systems.
• Collaborate with trading, finance, risk, and operations teams to ensure data quality, consistency, and usability.

Performance Engineering & Optimization

• Conduct detailed performance profiling using AWR, ASH, OEM, Query Store, and EXPLAIN PLAN.
• Identify system bottlenecks and implement tuning strategies across applications, databases, and pipelines.
• Execute load testing and benchmarking using Python, JMeter, or similar tools.
• Design and implement frameworks for monitoring performance, scalability, and stability.

Python Development

• Develop Python scripts and utilities for automation, performance testing, data validation, and pipeline orchestration.
• Work with Python-based ETL/ELT frameworks and custom processing modules.
• Integrate Python applications with databases, APIs, and internal systems.

Core Skills

• Strong proficiency in SQL (Oracle / SQLSERVER).
• Advanced experience in PL/SQL for stored procedures, triggers, and packages.
• Solid Python programming experience.
• Hands-on with query tuning, execution plan analysis, and optimizer hints.
• Strong understanding of database internals (indexes, caching, buffer pools, and memory management).

Performance Engineering Expertise

• Experience in performance profiling tools (AWR, ASH, OEM, EXPLAIN PLAN, Query Store).
• Experience with load testing and benchmarking using Python, JMeter, or similar tools.
• Familiar with data pipeline optimization (ETL, batch vs. stream processing).
• Knowledge of partitioning, sharding, and parallel query execution strategies.