Lead Data Engineer

As a Lead Data Engineer with over 7 years of experience, you will be responsible for designing, developing, and maintaining data pipelines, ETL processes, and data warehouses. You will be based in Hyderabad and should be able to join immediately. Your primary skills should include proficiency in SQL, Python, PySpark, AWS, Airflow, Snowflake, and DBT. Additionally, you should have a Bachelor's or Master's degree in Computer Science, Information Systems, Engineering, or a related field. In this role, you will need a minimum of 4+ years of hands-on experience in data engineering, ETL, and data warehouse development. You should have expertise in ETL tools such as Informatica Power Center or IDMC, as well as strong programming skills in Python and PySpark for efficient data processing. Your responsibilities will also involve working with cloud-based data platforms like AWS Glue, Snowflake, Databricks, or Redshift. Proficiency in SQL and experience with RDBMS platforms like Oracle, MySQL, and PostgreSQL are essential. Familiarity with data orchestration tools like Apache Airflow will be advantageous. From a technical perspective, you are expected to have advanced knowledge of data warehousing concepts, data modeling, schema design, and data governance. You should be capable of designing and implementing scalable ETL pipelines and have experience with cloud infrastructure for data storage and processing on platforms such as AWS, Azure, or GCP. In addition to technical skills, soft skills are equally important. You should possess excellent communication and collaboration skills, be able to lead and mentor a team of engineers, and demonstrate strong problem-solving and analytical thinking abilities. The ability to manage multiple projects and prioritize tasks effectively is crucial. Preferred qualifications for this role include experience with machine learning workflows and data science tools, certifications in AWS, Snowflake, Databricks, or relevant data engineering technologies, as well as familiarity with Agile methodologies and DevOps practices.,