Lead Data Engineer

As a Lead Data Engineer at the company, you will play a crucial role in designing, developing, and optimizing data pipelines and architectures to meet the increasing data and analytics requirements. Collaborating with data scientists, analysts, and software engineers, you will ensure efficient data flow, storage, and processing. **Key Responsibilities:** - Design, build, and maintain scalable, efficient, and reliable data pipelines. - Develop and optimize ETL/ELT processes for transforming raw data into usable formats. - Implement data warehousing solutions and manage data lakes. - Ensure data quality, consistency, and security across different platforms. - Collaborate with cross-functional teams to translate business requirements into technical solutions. - Monitor and troubleshoot data pipeline performance issues. - Optimize database queries and enhance data retrieval times. - Implement best practices for data governance, compliance, and security. - Stay updated with emerging trends and technologies in data engineering. **Qualifications Required:** - Bachelor's or Masters degree in Computer Science, Information Systems, or a related field. - 5+ years of experience in data engineering or a related role. - Proficiency in programming languages like Python, Java, or Scala. - Strong experience with SQL and relational databases (e.g., PostgreSQL, MySQL, SQL Server). - Hands-on experience with big data technologies (e.g., Hadoop, Spark, Kafka). - Experience with cloud platforms such as AWS, Azure, or GCP (e.g., Redshift, BigQuery, Snowflake). - Knowledge of data modeling, ETL frameworks, and data warehouse design. - Familiarity with CI/CD pipelines and DevOps practices for data engineering. - Strong problem-solving skills and ability to work in an agile environment.,