Posted:18 hours ago|
Platform:
On-site
Full Time
Job Description :
We are seeking a skilled and dynamic Azure Data Engineer to join our growing data engineering team. The ideal candidate will have a strong background in building and maintaining data pipelines and working with large datasets on the Azure cloud platform.
The Azure Data Engineer will be responsible for developing and implementing efficient ETL processes, working with data warehouses, and leveraging cloud technologies such as Azure Data Factory (ADF), Azure Databricks, PySpark, and SQL to process and transform data for analytical purposes.
Key Responsibilities :
- Data Pipeline Development : Design, develop, and implement scalable, reliable, and high-performance data pipelines using Azure Data Factory (ADF), Azure Databricks, and PySpark.
- Data Processing : Develop complex data transformations, aggregations, and cleansing processes using PySpark and Databricks for big data workloads.
- Data Integration : Integrate and process data from various sources such as databases, APIs, cloud storage (e.g., Blob Storage, Data Lake), and third-party services into Azure Data Services.
- Optimization : Optimize data workflows and ETL processes to ensure efficient data loading, transformation, and retrieval while ensuring data integrity and high performance.
- SQL Development : Write complex SQL queries for data extraction, aggregation, and transformation. Maintain and optimize relational databases and data warehouses.
- Collaboration : Work closely with data scientists, analysts, and other engineering teams to understand data requirements and design solutions that meet business and analytical needs.
- Automation & Monitoring : Implement automation for data pipeline deployment and ensure monitoring, logging, and alerting mechanisms are in place for pipeline health.
- Cloud Infrastructure Management : Work with cloud technologies (e.g., Azure Data Lake, Blob Storage) to store, manage, and process large datasets.
- Documentation & Best Practices : Maintain thorough documentation of data pipelines, workflows, and best practices for data engineering solutions.
Job Type: Full-time
Pay: Up to ₹2,000,000.00 per year
Experience:
Work Location: In person
Wincogz Business Solutions Private Limited
Upload Resume
Drag or click to upload
Your data is secure with us, protected by advanced encryption.
Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.
We have sent an OTP to your contact. Please enter it below to verify.
Instantly access job listings, apply easily, and track applications.
Practice Python coding challenges to boost your skills
Start Practicing Python Now
Hyderabad, Chennai, Bengaluru
1.0 - 5.5 Lacs P.A.
20.0 - 20.0 Lacs P.A.
Pune, Maharashtra, India
Experience: Not specified
Salary: Not disclosed
Noida, Pune, Bengaluru
25.0 - 40.0 Lacs P.A.
Pune, Maharashtra, India
Salary: Not disclosed
Hyderabad
10.0 - 20.0 Lacs P.A.
Ahmedabad, Bengaluru, Mumbai (All Areas)
10.0 - 15.0 Lacs P.A.
11.0 - 18.0 Lacs P.A.
kochi, kerala
Salary: Not disclosed
bhubaneswar
Salary: Not disclosed
