DE&A - Data Engineer

Bengaluru

Posted:7 hours ago

Job Description

  • Strong understanding of ETL and ELT patterns, data integration, data modeling, and distributed data processing.
  • Hands-on development experience with Apache Spark using Scala and/or Python/PySpark.
  • Experience working with RDBMS technologies and modern lakehouse/table formats, preferably Apache Iceberg.
  • Experience with distributed SQL/query technologies such as Starburst and Trino.
  • Experience designing real-time and streaming data solutions using technologies such as Apache Kafka and Spark Streaming.
  • Understanding of integration patterns across NiFi, Kafka, Spark, RDBMS, and lakehouse platforms for batch and real-time data processing.
  • Strong knowledge of software engineering practices including CI/CD, automated testing, source control, infrastructure/platform automation, observability, and production support.
  • Experience with data governance, metadata management, data lineage, data quality, and secure data access in enterprise environments.

Skills Required

ETL Data Integration Data Modeling Data Processing Apache Spark Python Pyspark Apache SQL Kafka Spark Software Engineering

Learn the skills this job asks for

See your skill gap for Data Engineer →

Free courses, interview questions and practice for each skill.

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now

RecommendedJobs for You