Software Developer

Interested candidate share your resume to VS00825391@techmahindra.com

Required Skills: Microsoft Azure, Snowflake, SQL Domain Preference: CPG / FMCG / Manufacturing

Job Summary

We are looking for an experienced Developer with strong hands-on expertise in Microsoft Azure and Snowflake to design, develop, and maintain scalable data engineering solutions. The ideal candidate should have experience building end-to-end data pipelines, implementing data integration and transformation solutions, and working with large datasets across cloud-based data platforms.

Candidates with prior experience in the CPG, FMCG, or Manufacturing domain will be preferred, particularly those familiar with supply chain, sales, inventory, procurement, production, and distribution analytics.

Key Responsibilities

• Design, develop, and maintain scalable ETL/ELT data pipelines using Azure and Snowflake.
• Build and manage data integration workflows using Azure Data Factory (ADF).
• Develop data transformation and processing solutions using Snowflake SQL, stored procedures, and related Snowflake capabilities.
• Work with Azure services such as Azure Data Lake Storage (ADLS Gen2), Azure Data Factory, Azure Databricks, and Azure Functions.
• Develop optimized SQL queries, views, stored procedures, and data models in Snowflake.
• Implement data ingestion strategies to load structured and semi-structured data into Snowflake.
• Perform data cleansing, transformation, validation, and quality checks.
• Optimize Snowflake performance through query tuning, warehouse management, and cost optimization.
• Implement incremental data loads, CDC (Change Data Capture), and scheduling mechanisms.
• Work with business analysts, data architects, and other stakeholders to understand data requirements and translate them into technical solutions.
• Ensure data security, governance, monitoring, and adherence to best practices.
• Troubleshoot data pipeline failures and resolve data-related issues.

Mandatory Technical Skills

1. Minimum 5 years of experience in Data Engineering, ETL development, or Data Warehousing.

2. Strong hands-on experience with Microsoft Azure data services.

3. Good experience in Snowflake, including:

• Snowflake architecture and concepts.
• Virtual warehouses and database objects.
• Snowflake SQL, views, and stored procedures.
• Data loading using COPY INTO and Snowpipe.
• Query performance optimization.

4. Hands-on experience with Azure Data Factory (ADF) for building and orchestrating data pipelines.

5. Experience with Azure Data Lake Storage (ADLS Gen2).

6. Strong SQL skills, including complex queries, joins, CTEs, window functions, and query optimization.

7. Good understanding of ETL/ELT concepts, data warehousing, and dimensional data modelling.

8. Experience handling large volumes of data and building scalable data pipelines.

Good-to-Have Skills

• Experience with Azure Databricks and PySpark.
• Knowledge of Python scripting.
• Experience with Azure DevOps and CI/CD pipelines.
• Familiarity with Git and version control.
• Knowledge of Snowflake Streams, Tasks, Time Travel, and Dynamic Tables.
• Experience implementing data quality and data governance frameworks.
• Knowledge of REST APIs and integration with external data sources.

Preferred Domain Experience CPG / Manufacturing

Candidates with experience in the CPG, FMCG, or Manufacturing domain will be preferred.

Educational Qualification

Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related discipline.

Ideal Candidate Profile

• Strong analytical and problem-solving skills.
• Ability to work independently and deliver high-quality solutions.
• Good communication and stakeholder management skills.
• Ability to understand business requirements and convert them into technical solutions.
• Experience working in Agile development environments.