Data Engineer III

3 - 7 years

0 Lacs

Posted:1 day ago| Platform: Shine logo

Apply

Work Mode

On-site

Job Type

Full Time

Job Description

As a Data Engineer at Perch Energy, you will be a key player in the design, development, and maintenance of our data infrastructure and pipelines. Your collaboration with the Data and Analytics Engineering team, as well as engineering and operations teams, will ensure the smooth flow and availability of high-quality data for analysis and reporting purposes. Your expertise will be crucial in optimizing data workflows, ensuring data integrity, and scaling our data infrastructure to support the company's growth. You will have the opportunity to engage with cutting-edge technology, influence the development of a world-class data ecosystem, and work in a fast-paced environment as part of a small, high-impact team. The core data stack at Perch Energy includes Snowflake and dbt Core, orchestrated in Prefect and Argo within our AWS-based ecosystem. Data from a wide range of sources is loaded using Fivetran or Segment, with custom Python utilized when necessary. Your responsibilities will include designing, developing, and maintaining scalable and efficient data pipelines in an AWS environment, focusing on the Snowflake instance and utilizing tools such as Fivetran, Prefect, Argo, and dbt. Collaboration with business analysts, analytics engineers, and software engineers to understand data requirements and deliver reliable solutions will be essential. Additionally, you will design, build, and maintain tooling that facilitates interaction with the data platform, including CI/CD pipelines, testing frameworks, and command-line tools. To succeed in this role, you should have at least 3 years of experience as a Data Engineer, data-adjacent Software Engineer, or member of a small data team, with a strong focus on building and maintaining data pipelines. Proficiency in Python, SQL, database management, and design is required, along with familiarity with data integration patterns, ETL/ELT processes, and data warehousing concepts. Experience with data orchestration tools like Argo, Prefect, or Airflow is a must, along with excellent problem-solving skills and attention to detail. While not mandatory, an undergraduate or graduate degree in a technical field, experience with AWS, Snowflake, Fivetran, Argo, Prefect, dbt, and Github Actions, as well as DevOps practices, would be advantageous. Previous experience in managing enterprise-level data pipelines and working with large datasets or knowledge of the energy sector would also be beneficial. Perch Energy offers competitive compensation, a remote-first policy, flexible leave policy, medical insurance, annual performance cycle, team engagement activities, L&D programs, and a supportive engineering culture that values diversity, empathy, teamwork, trust, and efficiency. Perch Energy is committed to providing reasonable accommodations for individuals with disabilities throughout the job application, interview process, and employment tenure.,

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now

RecommendedJobs for You

chennai, tamil nadu

Chennai, Tamil Nadu, India

Chennai, Tamil Nadu, India