Senior Data Engineer

About the role

We are seeking a results-driven Senior Data Engineer with over 6+ years of experience in designing and implementing scalable data solutions using Python, SQL Server, Oracle, Snowflake, AWS, and Power BI. Exposure to Azure, Databricks, and Microsoft Fabric is added advantage. The ideal candidate will have a strong background in Lakehouse architecture, ETL/ELT pipelines, and real-time data processing, with a passion for leveraging cloud technologies to solve complex business challenges and optimize data workflows.

Responsibilities

• Design, develop, and maintain robust and scalable data pipelines using AWS, SQL, Snowflake & Databricks.
• Work with large-scale structured and unstructured data from various sources including SQL Server, Oracle and Snowflake.
• Work with other teams to source and ingest data in a variety of forms
• Optimize data workflows and ensure high performance and reliability of ETL processes.
• Collaborate with data analysts, data scientists, and business stakeholders to understand data requirements and deliver solutions.
• Ensure data quality, security, and governance using Unity Catalog, RBAC, and data lineage tools.
• Develop and maintain data models and schemas for analytics and reporting.
• Leverage AWS services (e.g., S3, Lambda, Glue, Redshift) for cloud-based data engineering solutions.
• Automate data workflows and CI/CD pipelines using Azure DevOps, GitHub, and other DevOps tools.
• Integrate third-party ETL tools like DBT, Fivetran, and Informatica into the data ecosystem.
• Integrate and support BI tools (e.g., Power BI, SSRS) for dashboarding and reporting.
• Writing performant and maintainable code to provide value from data
• Monitor and troubleshoot data pipeline issues and ensure timely resolution.
• Collaborate with cross-functional teams to understand business requirements and deliver actionable insights.

Your skills and experience

• Bachelors or Master’s degree in Computer Science, Engineering, or related field.
• 6+ years of experience in data engineering or related roles.
• Strong programming skills in Python and advanced SQL.
• Hands-on experience with AWS services such as S3, ECS, and Redshift.
• Strong analytical & problem-solving skills with a logical approach
• Knowledge of data warehousing and data processing concepts
• Hands-on experience with SQL Server, Oracle and Snowflake databases.
• Excellent data analytical skills – Data mining / discovery
• Experience with workflow orchestration tools like Apache Airflow or AWS Step Functions.