Posted:1 hour ago|
Platform:
Work from Office
Full Time
About the Role
We are seeking a highly skilled Data Engineer to join our team, working on end-to-end data engineering and data science use cases. The ideal candidate should have strong expertise in Python or Scala, Spark (Databricks), and SQL, with proven experience in building scalable and efficient data pipelines on Azure.
Responsibilities
Design, build, and maintain scalable ETL/ELT data pipelines using Azure Data Factory, Databricks, and Spark.
Develop and optimize workflows using SQL and Python/Scala for large-scale data processing.
Implement performance tuning for data pipelines and Spark jobs.
Support feature engineering, model deployment, and end-to-end workflows.
Ensure data quality and integrity with robust validation and monitoring.
Work with structured & unstructured data using Delta Lake and Parquet.
Required Skills
Proficiency in Azure Data Factory, Databricks, Blob Storage, ADLS.
Strong expertise in SQL and Python or Scala.
Hands-on experience with ETL/ELT pipelines and Big Data technologies (Spark, Delta Lake, Parquet).
Experience in pipeline optimization, CI/CD, and data validation.
Nice-to-Have Skills
CODERS BRAIN
Upload Resume
Drag or click to upload
Your data is secure with us, protected by advanced encryption.
Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.
We have sent an OTP to your contact. Please enter it below to verify.
Instantly access job listings, apply easily, and track applications.
Practice Python coding challenges to boost your skills
Start Practicing Python Now
gurugram
9.0 - 10.0 Lacs P.A.
ahmedabad
4.0 - 7.0 Lacs P.A.
pune
Salary: Not disclosed
hyderabad
18.0 - 27.5 Lacs P.A.
gurugram
15.0 - 30.0 Lacs P.A.
hyderabad, pune
13.0 - 18.0 Lacs P.A.
gurugram
6.0 - 10.0 Lacs P.A.
bengaluru
10.0 - 18.0 Lacs P.A.
bhubaneswar, indore, pune
15.0 - 27.5 Lacs P.A.
hyderabad
4.0 - 8.0 Lacs P.A.
