Senior Data Engineer

Note: This is a remote role with occasional office visits. Candidates from Mumbai or Pune will be preferred

About The Opportunity

Role & Responsibilities

• Architect, build, and optimize end-to-end data pipelines (ingestion → transformation → consumption) using Databricks, Spark, and cloud object storage.
• Design scalable data warehouses and marts that enable self-service analytics and machine-learning workloads.
• Translate logical data models into physical schemas; own database design, partitioning, and lifecycle management for cost-efficient performance.
• Develop, automate, and monitor ETL/ELT workflows with Apache Airflow or dbt, ensuring reliability, observability, and robust error handling.
• Performance-tune Spark jobs and SQL queries, optimizing cluster configurations and indexing strategies for sub-second response times.
• Provide production support and continuous improvement for existing data assets; champion best practices and mentor junior engineers.
  

Skills & Qualifications

Must-Have

• 6+ years of experience building production-grade data platforms, including 3+ years of hands-on Apache Spark and Databricks.
• Expert proficiency in PySpark, Python, and advanced SQL with a track record of performance tuning distributed jobs.
• Proven ability to model data warehouses/marts and orchestrate ETL/ELT pipelines using Apache Airflow or dbt.
• Hands-on experience with a major cloud platform (AWS or Azure) and modern lakehouse/data-lake patterns.
• Strong problem-solving skills, DevOps mindset, and commitment to code quality; comfortable mentoring peers.
• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
  

Preferred

• Deep familiarity with AWS analytics stack (Redshift, Glue, S3) or Hadoop ecosystem components.
• Experience building streaming pipelines (Kafka, Kinesis, Delta Live Tables) and real-time analytics solutions.
• Exposure to ML feature stores, MLOps workflows, and data governance/compliance frameworks.
• Relevant certifications (Databricks, AWS, Azure) or contributions to open-source projects.
  

Benefits & Culture Highlights

• Hybrid work model with flexible hours and occasional office meet-ups in Mumbai/Pune.
• Collaborative, innovation-driven culture offering continuous learning and career growth.
• Competitive compensation and comprehensive health and wellness benefits.