Lead Data Engineer

Job Summary:

As a Data Engineer, you will be responsible for designing, developing, and maintaining data integration solutions using SQL, Databricks, Python, and Snowflake. You will work closely with data analysts, data scientists, and other stakeholders to ensure data availability, quality, and performance.

Key Responsibilities:

• Design and implement data pipelines using Databricks and Python to integrate data from various sources into Snowflake.
• Develop and optimize data models in Snowflake to support analytical workloads and reporting needs.
• Write complex SQL queries for data manipulation, transformation, and analysis within Snowflake.
• Utilize Databricks for data processing and transformation tasks, ensuring efficient data workflows.
• Monitor and optimize the performance of data pipelines and Snowflake queries to ensure efficient data processing.
• Collaborate with cross-functional teams to understand data requirements and deliver high-quality data solutions.
• Implement data governance practices, including data quality checks, data lineage, and compliance measures.
• Troubleshoot and resolve data-related issues, ensuring data integrity and reliability.
• Stay updated with the latest trends and best practices in data engineering, Databricks, Python, and Snowflake.

Qualifications:

• 8+ years of versatile experience in building data pipelines.
• Bachelors degree in computer science, Information Technology, or a related field.
• Proven experience as a Data Engineer or in a similar role, with a strong focus on SQL, Databricks, Python, and Snowflake.
• Proficiency in SQL and experience with data modeling concepts.
• Experience in Batch/ NRT use cases and needs to know Spark, Kafka (streaming).
• Snowflake good to have.
• Familiarity with data warehousing principles and best practices.
• Experience with cloud platforms (AWS, Azure, or GCP) is a plus.
• Strong analytical and problem-solving skills.
• Excellent communication and collaboration abilities.

Please feel free to contact me on

Sreekanth Y

9676997160