Data Engineer L2

About the Role

We are looking for experienced data engineers who can independently build, optimize, and manage scalable data pipelines and platforms. In this role, youll work closely with clients and internal teams to deliver robust data solutions that power analytics, AI/ML, and operational systems. Youll also help mentor junior engineers and bring engineering discipline into our data engagements.

Key Responsibilities

• Design, build, and optimize large-scale, distributed data pipelines for both batch and streaming use cases.
• Implement scalable data models, data warehouses/lakehouses, and data lakes to support analytics and decision-making.
• Collaborate with cross-functional stakeholders to understand business requirements and translate them into technical data solutions.
• Drive performance tuning, monitoring, and reliability of data pipelines.
• Write clean, modular, and production-ready code with proper documentation and testing.
• Contribute to architectural discussions, tool evaluations, and platform setup.
• Mentor junior engineers and participate in code/design reviews.

Must-Have Skills

• Strong programming skills in Python and advanced SQL expertise.
• Deep understanding of data engineering concepts such as ETL/ELT, data modeling (OLTP & OLAP), warehousing, and stream processing.
• Experience with distributed data processing frameworks (e.g., Apache Spark, Flink, or similar).
• Experience with building pipelines using orchestration tools like Airflow or similar.
• Familiarity with CI/CD pipelines and version control tools like Git.
• Ability to debug, optimize, and scale data pipelines in real-world settings.

Good to Have

• Experience working on any major cloud platform (AWS preferred; GCP or Azure also welcome).
• Exposure to Databricks, dbt, or similar platforms is a plus.
• Understanding of data governance, data quality frameworks, and observability.
• Certification in AWS (e.g., Data Analytics, Solutions Architect) or Databricks is a plus.
• Other Expectations
• Comfortable working in fast-paced, client-facing environments.
• Strong analytical and problem-solving skills with attention to detail.
• Ability to adapt across tools, stacks, and business domains.
• Willingness to travel within India for short/medium-term client engagements as needed.