Associate Data Engineer

Job Description

About the role: We are seeking an Associate Data Engineer to join our growing Data Engineering team! The Associate Data engineer will be responsible for supporting the end-to-end ETL development of data pipelines leveraging big data technologies. Under supervision of Senior and Principal Data Engineer, the Associate Data Engineer will contribute to the development of end to end data pipelines, data transformations, and data visualizations for our data consumers. Requirements: 3+ years experience in a similar capacity using Databricks or Snowflake, Python/SQL, Apache Spark; ideally, you have delivered business-critical software to large/medium/small enterprises You are comfortable manipulating large data sets and handling raw SQL Experience using technologies such as Pyspark/AWS/Databricks/Snowflake is essential Experience creating ETL data pipelines from scratch English fluency, verbal and written BTech or MCA or BSc(Computer Science) is essential Responsibilities: Collaborating closely with Product, Backend, and Data Science teams to design, build, and maintain scalable data pipelines and infrastructure Developing, deploying, and monitoring data pipelines for ingestion, transformation, and storage at high scale Designing and implementing tools and abstractions on top of data infrastructure for a variety of analytics, recommendations, and machine learning use cases Designing and maintaining data orchestration and streaming pipelines Working closely with product teams to develop reusable data resources and design patterns Show more Show less