As a Data Engineer, you will play a key role in designing, developing, and maintaining our data infrastructure and pipelines. You will collaborate closely with the rest of our Data and Analytics Engineering team and with engineering and operations teams to ensure the smooth flow and availability of high-quality data for analysis and reporting purposes. Your expertise will be essential in optimizing data workflows, ensuring data integrity, and scaling our data infrastructure to support our companys growth.

This is an exceptional opportunity for someone who relishes the chance to engage with cutting-edge technology, influence the development of a world-class data ecosystem and work in a fast-paced environment on a small, high-impact team.

Our core data stack makes heavy use of Snowflake and dbt Core, orchestrated in Prefect and Argo in our broader AWS-based ecosystem. Most of our wide range of data sources are loaded with Fivetran or Segment, but we use custom Python when it s the right tool for the job.

What you'll do

Design, develop, and maintain scalable and efficient data pipelines in an AWS environment, centered on our Snowflake instance and using Fivetran, Prefect, Argo, and dbt.
Collaborate with business analysts, analytics engineers, and software engineers to understand data requirements and deliver reliable solutions.
Design, build and maintain tooling that enables users and services to interact with our data platform, including CI/CD pipelines for our data lakehouse, unit/integration/validation testing frameworks for our data pipelines, and command-line tools for ad-hoc data evaluation.
Identify and implement best practices for data ingestion, transformation, and storage to ensure data integrity and accuracy.
Optimize and tune data pipelines for improved performance, scalability, and reliability.
Monitor data pipelines and proactively address any issues or bottlenecks to ensure uninterrupted data flow.
Develop and maintain documentation for data pipelines, ensuring knowledge sharing and smooth onboarding of new team members.
Implement data governance and security measures to ensure compliance with industry standards and regulations.
Keep up to date with emerging technologies and trends in data engineering and recommend their adoption as appropriate.

What will help you succeed Must-haves

3+ years as a Data Engineer, data-adjacent Software Engineer, or a did-everything small data team member with a focus on building and maintaining data pipelines.
Strong Python skills, especially in the context of data orchestration.
Strong understanding of database management and design, including experience with Snowflake or an equivalent platform.
Proficiency in SQL
Familiarity with data integration patterns, ETL/ELT processes, and data warehousing concepts.
Experience with Argo, Prefect, Airflow, or similar data orchestration tools.
Excellent problem-solving and analytical skills with a strong attention to detail.
Ability to bring a customer-oriented and empathetic approach to understanding how data is used to drive the business.
Strong communication skills.

Nice-to-haves

Undergraduate and/or graduate degree in math, statistics, engineering, computer science, or related technical field
Experience with our stack: AWS, Snowflake, Fivetran, Argo, Prefect, dbt, and Github Actions, along with some ancillary tools
Experience with DevOps practices, especially CI/CD
Previous experience managing enterprise-level data pipelines and working with large datasets
Experience in the energy sector

Benefits:

Competitive compensation based on market standards.
We are working on a hybrid model with remote first policy

Apart from Fixed Base Salary potential candidates are eligible for following benefits

Flexible Leave Policy
Office is in the heart of the city in case you need to step in for any purpose.
Medical Insurance (1+5 Family Members)
We provide comprehensive coverage including accident policy and life Insurance.
Annual performance cycle
Quarterly team engagement activities and rewards & recognitions
L&D programs to foster professional growth
A supportive engineering culture that values diversity, empathy, teamwork, trust, and efficiency

More Jobs at Arcadia

Software Engineer II - Salesforce

Chennai, Tamil Nadu, India

Experience: Not specified

Salary: Not disclosed

Software Engineer II - Python (RUDE squad)

Chennai, Tamil Nadu, India

3.0 - 3.0 yrs

Salary: Not disclosed

Analytics Engineer III

Chennai, Tamil Nadu, India

3.0 - 3.0 yrs

Salary: Not disclosed

Senior Data Analyst - Revenue Ops

Chennai, Tamil Nadu, India

5.0 - 5.0 yrs

Salary: Not disclosed

Software Engineer II - Connector Engineering

Chennai, Tamil Nadu, India

Experience: Not specified

Salary: Not disclosed

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now

Arcadia

Login to

Please Verify Your Phone or Email

Confirm Action

Search

Profile

Upskill and Grow with AI

Data Engineer III