Senior Data Engineer

About the Role Term: 1 yr contract to PERMANENT 100% onsite in Pune, Maharashtra, India Amenable to wear formal attire and drug testing We are seeking two highly skilled Senior Data Engineers to join our agile, fast-paced team on a long-term contract. You’ll work alongside 17 team members based in India and collaborate closely with a time-conscious Hiring Manager to design and implement complex, large-scale data solutions. This role requires deep expertise in building robust, secure, and scalable pipelines—from scratch—handling billions of rows and large data structures (e.g., 2M+ chassis records ). You will work in a cloud-native environment with a focus on AWS (preferred) and Azure , leveraging modern tools like Kafka, Terraform, GitHub, SQL, PostgreSQL , and Python . Key Responsibilities Design, develop, and optimize scalable data pipelines and systems to support data ingestion, transformation, and delivery Ensure data integrity, quality, and security throughout all stages of the pipeline Collaborate across teams to prioritize workloads and align with evolving business needs Work with structured and unstructured datasets, developing pipelines to process large volumes of data Create and maintain detailed technical documentation Actively participate in an Agile/Scrum development cycle and proactively communicate blockers or delays Engage in code reviews and support continuous improvement within the engineering team Optimize cloud resources and ensure efficient storage and compute practices Build reusable infrastructure using Terraform and implement real-time streaming pipelines using Kafka Show more Show less