Senior Software Engineer - Data Engineering

Job Responsibilities: Technical Leadership: Provide technical leadership and mentorship to a team of data engineers. Design, architect, and implement highly scalable, resilient, and performant data pipelines, using GCP technologies is a plus (e.g., Dataproc, Cloud Composer, Pub/Sub, BigQuery). Guide the team in adopting best practices for data engineering, including CI/CD, infrastructure-as-code, and automated testing. Conduct code reviews, design reviews, and provide constructive feedback to team members. Stay up-to-date with the latest technologies and trends in data engineering, Data Pipeline Development: Develop and maintain robust and efficient data pipelines to ingest, process, and transform large volumes of structured and unstructured data from various sources. Implement data quality checks and monitoring systems to ensure data accuracy and integrity. Collaborate with cross functional teams, and business stakeholders to understand data requirements and deliver data solutions that meet their needs. Platform Building & Maintenance: Design and implement secure and scalable data storage solutions Manage and optimize cloud infrastructure costs related to data engineering workloads. Contribute to the development and maintenance of data engineering tooling and infrastructure to improve team productivity and efficiency. Collaboration & Communication: Effectively communicate technical designs and concepts to both technical and non-technical audiences. Collaborate effectively with other engineering teams, product managers, and business stakeholders. Contribute to knowledge sharing within the team and across the organization. Required Qualifications: Bachelors or Masters degree in Computer Science, Engineering, or a related field. 7+ years of experience in data engineering and Software Development. 7+ years of experience of coding in SQL and Python/Java. 3+ years of hands-on experience building and managing data pipelines in cloud environment like GCP. Strong programming skills in Python or Java, with experience in developing data-intensive applications. Expertise in SQL and data modeling techniques for both transactional and analytical workloads. Experience with CI/CD pipelines and automated testing frameworks. Excellent communication, interpersonal, and problem-solving skills. Experience leading or mentoring a team of engineers