Senior Data Engineer

We are looking for a highly skilled Data Engineer with 4+ years of experience in building scalable data pipelines, transforming large datasets, and working with modern data platforms. The ideal candidate is proficient in Python, SQL, Apache Spark, and Google Cloud Platform (GCP), and demonstrates strong communication and collaboration skills. You will play a key role in designing and developing data engineering solutions that enable data-driven decision-making across the organization.

Responsibilities

• Design, build, and optimize scalable and reliable data pipelines using Python, SQL, and Apache Spark.
• Develop and maintain data models, ETL/ELT workflows, and data integration solutions on GCP.
• Implement data quality checks, validation, and monitoring processes.
• Collaborate closely with data analysts, data scientists, and business stakeholders to understand data needs.
• Maintain and enhance the data infrastructure to ensure performance, scalability, and availability.
• Automate workflows and optimize resource usage for cost efficiency in cloud environments.
• Communicate complex technical solutions clearly and concisely to both technical and non-technical stakeholders.
  

Requirements

• 4+ years of professional experience in data engineering.
• Strong proficiency in Python for scripting and data manipulation.
• Deep knowledge of SQL for data querying, transformation, and optimization.
• Hands-on experience with Spark.
• Proven expertise with Google Cloud Platform (GCP) services such as BigQuery, Dataflow, Pub/Sub, Cloud Storage, etc.
• Experience with CI/CD, version control, and DevOps practices for data workflows.
• Strong communication and interpersonal skills with the ability to explain technical concepts to diverse audiences.
  

This job was posted by Vaishnavi Sundaram from Indium Software.