Designation | Data Engineer Qualification | BE Experience (in years) | 5 Job Description | Job Title: Data Engineer Location: Bangalore About the Role We are looking for a Data Engineer to build and maintain scalable data solutions on AWS. The role involves developing data pipelines, implementing Lakehouse architecture using Apache Iceberg, and supporting analytics and reporting through reliable, high-quality data. Key Responsibilities • Develop and maintain data pipelines using DBT, AWS Glue, Spark, and basic Python. • Build and optimize data transformation workflows using dbt. • Implement and manage Lakehouse solutions using Apache Iceberg and Redshift. • Orchestrate and monitor workflows using Apache Airflow. • Optimize SQL queries and data models for performance and scalability. • Follow CI/CD and GitHub best practices for deployment and code management. • Collaborate with business and technical teams to deliver data solutions. • Ensure data quality, reliability, and operational excellence. Required Skills & Experience • Hands-on experience with AWS Glue, Spark, PySpark, basic Python, and SQL. • Experience with dbt for data transformation and testing. • Knowledge of Apache Iceberg and Lakehouse architecture. • Experience with Apache Airflow for workflow orchestration. • Strong experience with Redshift and query performance tuning. • Familiarity with GitHub and CI/CD pipelines. • Understanding of data modeling, partitioning, and performance optimization. Nice to Have • Experience with Terraform or Infrastructure as Code tools. • Knowledge of data governance and data lineage concepts. Skill Set Required | DBT, Airflow, AWS Glue, AWS services, Redshift SQL, CICD
