Senior Data Engineer

The Role:

We are urgently seeking a highly autonomous Senior Data Engineer (Contingent Worker) to join our DGS Data & Analytics products squad. This is a hands-on, high-impact contract role requiring a practitioner who can hit the ground running on Day 1. You will be operating directly within our Agile product team, turning complex commercial data requirements into optimised production pipelines. You must be fully comfortable working in sprint cycles, modularising your tasks independently, and communicating daily progress clearly to global stakeholders.

Your Contribution:

● Immediate Hands-On Delivery: Rapidly build, tune, and deploy robust ETL/ELT pipelines ingesting commercial data from Oracle R12 ERP, third-party retail APIs, S3 buckets, JSON, XML, and flat files into Snowflake.

● Dual Pentaho & Snowflake Execution: Maintain, debug, and refactor existing Pentaho Data Integration (DI) workflows while writing clean, modern SQL/Python transformations natively in Snowflake.

● Agile Sprint Execution: Take ownership of Jira user stories, break them down into modular technical tasks, and drive them independently to completion within sprint cycles.

● Commercial Data Modelling: Design performant dimensional models (star schemas) in Snowflake tailored for high-speed consumption in Tableau dashboards.

● Defensive Engineering & Data Profiling: Profile source data prior to build (checking null rates, cardinality, and referential integrity) and implement automated reconciliation scripts to prevent data regressions.

● AI & Advanced Analytics Enablement: Assist in structuring clean data foundations and leverage Snowflake utilities/Python to prepare datasets for Cortex AI and advanced analytics use cases.

● Collaborative Delivery: Provide concise daily updates in standups, partner closely with Technical Delivery Leads, and support BIOPS teams during quarter-end reconciliation cycles.

Key Qualifications (including but not limited to):

● 5 to 8 years of dedicated, hands-on experience in ETL/ELT pipeline engineering and enterprise data warehousing.

● Minimum 3+ years of hands-on experience with Pentaho Data Integration (DI).

● Minimum 3+ years of production experience in Snowflake, including multi-cluster warehouses, Snowpipe, Tasks, Streams, Time Travel, clustering keys, and stored procedures.

● Demonstrated Commercial Domain Experience: Hands-on experience ingesting and modelling commercial data, specifically Point-of-Sale (POS), distributor inventory, sales orders, pricing, or ERP transaction feeds (e.g. Oracle R12 ERP).

● Expert-Level SQL & Python: Ability to write and tune complex, multi-table analytical SQL transformations on massive datasets, paired with robust Python scripting for API integrations.

● Agile Delivery Fluency: Proven experience delivering within 2-week sprints; must know how to modularise complex user stories into deliverable daily increments rather than monolithic end-of-sprint commits.

● Language & Communication: Exceptional, professional English fluency is mandatory. Must be able to independently explain technical logic, pipeline schemas, and blockers during daily standups.

● Solid software engineering foundations: Unix/Linux environments, Git version control, CI/CD pipelines, and ticketing tools.

Job Type: Contractual / Temporary
Contract length: 3 months

Pay: ₹50,000.00 - ₹100,000.00 per month

Experience:

• AI: 4 years (Preferred)

Work Location: Hybrid remote in Chennai, Tamil Nadu 600083