Qapitol Qa logo

Job Opening For Data Platform Engineer

Qapitol Qa

3 - 8 years

Hyderabad Bengaluru

Posted:10 hours ago

Job Description

  • Design, develop, build, and maintain scalable data ingestion and transformation pipelines using Python, SQL, PySpark, and ETL/ELT frameworks.
  • Develop and manage batch and streaming data processing workflows to support business and analytical requirements.
  • Work with modern data platforms such as Databricks, Snowflake, Microsoft Fabric, AWS, or Google Cloud.
  • Build and maintain data lakes, lakehouses, and data warehouse solutions using Delta Lake, Parquet, and other modern storage formats.
  • Implement data modelling, data validation, data quality checks, and data reconciliation processes.
  • Develop and optimise SQL queries, Spark jobs, and data processing workflows for improved performance.
  • Implement workflow orchestration using Apache Airflow or equivalent orchestration tools.
  • Work with dbt for data transformation, testing, and documentation.
  • Understand Kafka fundamentals and support event-driven and real-time data ingestion requirements.
  • Implement incremental data loading, partitioning strategies, and schema evolution.
  • Monitor pipeline execution, troubleshoot failures, identify root causes, and ensure data pipeline reliability.

Skills Required

Snowflake Data Bricks SQL Data Python Kafka

Learn the skills this job asks for

See your skill gap for Data Engineer →

Free courses, interview questions and practice for each skill.

Work Mode

Work from Office

Job Type

Full Time

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now
Qapitol Qa logo
Qapitol Qa

RecommendedJobs for You

Qapitol Qa logo

Hyderabad, Bengaluru

Qapitol Qa logo

Hyderabad, Bengaluru