Senior Data Engineer

Key Responsibilities

• Design, develop, and optimize ETL/ELT pipelines for large-scale data processing.
• Build and maintain data engineering solutions using Apache Spark, Databricks, SQL, and Python.
• Develop batch and real-time data ingestion frameworks.
• Design and implement enterprise data warehouses, data marts, and lakehouse architectures.
• Create and maintain logical and physical data models aligned with business requirements.
• Ensure data quality, governance, security, and compliance across data platforms.
• Develop streaming data solutions using event-driven architectures and real-time processing frameworks.
• Use Azure Data Factory (ADF), Azure Synapse Analytics, and other Azure data services for data orchestration and transformation.
• Collaborate with data scientists, analysts, and business stakeholders to deliver data-driven solutions.
• Monitor, troubleshoot, and optimize data platform performance, scalability, and reliability.

Required Skills and Qualifications

• 7+ years of experience in Data Engineering.
• Strong knowledge of data engineering and data architecture.
• Hands-on experience developing ETL/ELT pipelines.
• Proficiency in Apache Spark and Databricks.
• Strong SQL and Python programming skills.
• Experience with data warehousing and data modeling.
• Knowledge of data quality, governance, and data management practices.
• Experience with streaming data processing.
• Hands-on experience with Azure Data Factory (ADF).
• Experience with Azure Synapse Analytics and Azure Data Lake Storage (ADLS).
• Strong understanding of performance tuning and optimization.
• Good analytical, problem-solving, and stakeholder management skills.

Preferred Qualifications

• Bachelor's or Master's degree in Computer Science, Engineering, Data Science, or a related field.
• Experience with CI/CD, DevOps, and cloud-based data platforms.
• Azure Data Engineer Associate certification.

Pay: ₹1,000,000.00 - ₹1,440,000.00 per year

Application Question(s):

• By applying, you agree that your resume and personal details may be stored securely for up to 2 years for recruitment purposes.

Work Location: Hybrid remote in Bangalore City, Bengaluru, Karnataka