Lead Data Engineer

Important Notice: Beware of Recruitment Scams

We’ve been made aware of fraudulent activity involving individuals falsely claiming to be part of our hiring team. Please be advised of the following:

• All official communication from our company will come from a verified company email address (@elemica.com)
• We will never make an upfront request for sensitive personal information and/or never make a job offer before a thorough interview process
• Elemica will never request an exchange of money during the application process

If you are in doubt about a communication claiming to be from our company, please reach out directly: harish.kaki@elemica.com

Interested in shaping the future of Supply Chain Technology?

Elemica, a global leader in digital supply chain solutions, is seeking a Software Engineer to ensure product excellence across our SaaS-based solutions. This is an exciting opportunity to be part of a growing, high-impact engineering team that helps Fortune 100 clients optimize their supply chain operations through automation, analytics, and AI-driven insights.

At Elemica, you’ll contribute to transforming how enterprises collaborate and transact across their networks — driving innovation, scalability, and performance in a dynamic environment.

Our Values

At Elemica, we believe that embodying our values is essential for all team members. These qualities show up in our interactions with each other, our clients, and our collective community:

• Curiosity – We delight in discovering new challenges and feel compelled to solve them.
• Integrity – We are trustworthy and steadfast in our commitment to our colleagues, clients, and partners.
• Accountability – We deliver measurable, meaningful business value consistently.
• Passion – We share an enthusiasm for transforming our clients’ supply chain.

Role Overview:

Elemica is seeking a Lead Data Engineer who is responsible for designing, building, and enhancing the data infrastructure that powers our analytics, reporting, and data-driven products. In this role, you'll be involved in all the phases of the product development lifecycle including the design, development, deployment, and maintenance of new and existing features. You will own complex ingestion pipelines, ensure the reliability and scalability of our data platform, and serve as the technical bridge between application engineering teams who produce data and analysts who depend on it.

You will play a critical role in shaping our data architecture, scaling our data lake, and ensuring that high-quality, trusted data is available across the organization. You should be a systems thinker and solver of complex challenges, always seeking new ways to achieve better results for the team and customers through your leadership abilities and professional strengths.

What You’ll Do:

Responsibilities

• Architect, build, and maintain scalable data infrastructure supporting batch and streaming data.

• Lead the evolution and optimization of our AWS-based data lake, ensuring performance, security, and reliability.

• Implement robust data governance, metadata management, and partitioning strategies to support fast, cost-efficient queries.

• Own end-to-end design and development of ingestion pipelines from multiple internal and external systems.

• Build resilient, automated ETL/ELT pipelines using modern frameworks and AWS services ensuring pipelines are fault-tolerant, well-tested, monitored, and instrumented for reliability at scale.

• Collaborate closely with application engineering teams to define event schemas, logging standards, and data contracts.

• Partner with analysts, BI teams, data scientists, and business stakeholders to understand data needs and deliver reliable, well-modeled datasets.

• Establish best practices and drive adoption of data engineering standards across the organization.

• Implement data validation, lineage, and observability tools to identify inconsistencies and ensure data accuracy.

• Drive continuous improvements around data quality, accessibility, and documentation.

What You’ll Need

Experience and Skills Required

• 8+ years of experience building and scaling AWS data lakes
• Expertise with AWS services, including but not limited to:

o S3, Glue, Lambda, Step Functions, EMR, Athena, Redshift, Kinesis, IAM.

• AWS certifications (Solutions Architect or Data Analytics specialty preferred)
• Proven track record of building and scaling data lakes in a production environment.
• Strong proficiency in Python and/or Scala for ETL/ELT development.
• Solid understanding of modern data architectures (data lake, lakehouse, medallion architecture, streaming, etc.).
• Experience with workflow orchestration tools (Airflow, Dagster, Step Functions, etc.).
• Strong SQL skills, including performance tuning and working with large datasets.
• Familiarity with distributed processing frameworks (Spark, Flink, Glue ETL).
• Analytical skills and creative thinking.
• Good Communication skills

Good to have skills:

• Supply Chain Management / Logistics domain knowledge.
• Knowledge in Security, Performance Engineering
• Familiarity with cloud BI platforms (MicroStrategy, Tableau, Qlik, PowerBI)
• Comfortable with CI/CD and DevOps practices for data engineering workloads.

Education and Certification:

• Bachelor's Degree in Computer Science or related field

Who We Are

• Elemica is a leading provider of Digital Supply Chain Management solutions and the premier multi-enterprise collaboration network for global process manufacturing industries. Its portfolio of SaaS-based, network-powered digitization and visibility solutions automate critical information flows, enable multi-channel data strategies, and improve end-to-end supply chain performance. Elemica solutions connect many of the world’s largest manufacturers to their direct material suppliers, logistics service providers and end customers, helping them realize the promise of, and return on, their investments in supply chain digitization. Today, global leaders—including Arkema, BASF, Continental, Dow, Goodyear, Michelin, and Shell—use Elemica, driving over $1 trillion in commerce annually.

Your Success. Your Well-being. Our Commitment: Elemica Benefits.

We're passionate about empowering our team. Our comprehensive benefits package is thoughtfully designed to support every facet of your life and career journey:

• Market-Leading Pay: We ensure your talent is rewarded with competitive compensation.
• Complete Family Health: Comprehensive health insurance to protect you and your entire family.
• Secure Tomorrow: Build a strong financial future with robust retirement plans including EPF, Corporate NPS, and Gratuity.
• Flexible Work-Life: Embrace work-life balance through our hybrid model and flexible hours.
• Celebrate Achievement: Our annual and quarterly recognition programs foster a high-performance culture by consistently rewarding your excellence and driving success.
• Support for Life's Milestones: Beyond standard annual, sick, and casual leave, we offer dedicated time off for significant life events like marriage and paternity.

It is the responsibility of all Elemica employees to ensure the security, availability, processing integrity, confidentiality, and privacy of Elemica systems and data and the data of our customers. Using best practices in these areas, all Elemica employees will observe a ‘security first’ approach to their daily responsibilities. All employees are accountable for securing their work devices, work areas, and communications in the execution of their daily duties.