ConveGenius.AI logo

Junior Data Engineer

ConveGenius.AI

1 - 3 years

Shimla

Posted:2 days ago

Job Description

About ConveGenius

AI-native education infrastructure company


Role Overview

We are looking for a Junior Data Engineer to join our Data Platform team. You will design and maintain scalable data pipelines and architectures using AWS services, enabling reliable data movement, transformation, and analytics at scale. You will collaborate with analytics, product, and engineering teams to support reporting, dashboards, and insights for millions of students and schools.

Key Responsibilities

  • Design, build, and maintain ETL/ELT pipelines for large-scale data ingestion, transformation, and loading.
  • Develop and optimize Spark and PySpark jobs for batch and real-time data processing.
  • Work with AWS services (S3, Glue, Lambda, Redshift, Athena, EMR) to manage the data ecosystem.
  • Support the design and implementation of Data Lake and Data Warehouse architectures.
  • Implement data validation, partitioning, and schema management for efficient query performance.
  • Collaborate with data analysts and BI teams to ensure data availability and consistency.
  • Maintain data lineage, metadata, data quality, and governance.
  • Implement monitoring and alerting for data pipelines.
  • Use Git and CI/CD tools to manage code and automate deployment of data workflows.

Qualifications

  • Education: Bachelor's degree in Computer Science, Information Technology, Data Engineering, or a related field.
  • Experience: 1-3 years of hands-on experience in data engineering, pipeline development, or cloud-based data systems.
  • Core Skills: Strong knowledge of SQL and Python/PySpark.
  • Cloud & Data Stack: Practical experience with AWS (S3, Glue, Lambda, Redshift, Athena, EMR, Step Functions).
  • Architecture: Solid understanding of Data Lake architecture, ETL/ELT frameworks, and data warehousing concepts.
  • Frameworks: Familiarity with Delta Lake, Spark SQL, or other big data frameworks, along with data modeling and performance tuning.

Nice to Have

  • Exposure to GCP (BigQuery, Dataflow) or Azure (Data Factory, Synapse, Databricks).
  • Experience with Databricks, PostgreSQL, MySQL, NoSQL, or Airflow.
  • Understanding of DevOps practices, CI/CD pipelines, and infrastructure automation.
  • Prior experience in an EdTech or public data ecosystem.


Skills Required

B2b Automation Analytics AWS ETL Data Ingestion Spark Pyspark Data Processing Data Lake Data Warehouse Data Validation

Learn the skills this job asks for

See your skill gap for Data Engineer →

Free courses, interview questions and practice for each skill.

Job Type

Full Time

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

coding practice

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now
ConveGenius.AI logo
ConveGenius.AI

RecommendedJobs for You

Hiringhood logo

Hyderabad

ConveGenius.AI logo

Junior Data Engineer

ConveGenius.AI

Shimla

Acabes International logo

Junior Data Engineer

Acabes International

Chennai

Medpace logo

Navi mumbai

Medpace Clinical Research India logo

Junior Data Engineer

Medpace Clinical Research India

Navi mumbai

Hiringhood logo

Hyderabad

C

Junior Data Engineer

Crowe Capability Center - India

Hyderabad

Techila Global Services logo

Junior Data Engineer

Techila Global Services

Bengaluru

Hiringhood logo

Hyderabad