5 - 9 years

24 - 31 Lacs

Hyderabad / Secunderabad, Telangana, Telangana, India

Posted:1 day ago| Platform: Foundit logo

Apply

Skills Required

Work Mode

On-site

Job Type

Full Time

Job Description

We are looking for a skilled Data Engineer with expertise in Azure Data Factory, ADLS, SQL, PySpark, Python and Azure Databricks to design, build and optimize data pipelines. Also ensuring efficient data ingestion, transformation and storage solutions. Key Responsibilities: Desing and Develop data pipelines using Azure Data Factory and SSIS Manage Cloud Data Storage and Processing (AWS S3, ADLS etc) Write complex SQL queries, optimize performance Process large datasets using PySpark Develop scripts for data processing, automation and API integration using Python Develop Databrikcs notebook, manage workflows and implement delta lake for data transactions Pipeline orchestration and Monitoring Knowledge on CI/CD using Azure DevOps /Github

Mock Interview

Practice Video Interview with JobPe AI

Start Interview Now

RecommendedJobs for You

Chennai, Coimbatore, Mumbai (All Areas)

New Delhi, Delhi, India

Hyderabad, Pune, Bengaluru