4 - 6 years
3 - 6 Lacs
Posted:12 hours ago|
Platform:
On-site
Full Time
We are looking for a PySpark Developer with expertise in data ingestion, ETL processing, and big data cloud-based solutions . The ideal candidate will have hands-on experience in building scalable data pipelines and optimizing data processing performance . Key Responsibilities: Develop and implement data ingestion pipelines from various sources such as databases, S3, and files . Build and optimize ETL and Data Warehouse transformation processes . Develop enterprise-level Big Data solutions using PySpark, SparkSQL, and related frameworks . Create scalable, reusable, and self-service frameworks for data ingestion and processing . Ensure end-to-end integration of data pipelines , maintaining data quality and consistency . Conduct performance analysis and optimization for data processing. Apply best practices in design, automation (Pipelining, IaC), testing, monitoring, and documentation . Work with structured and unstructured data for comprehensive data management. Good to Have: Experience in cloud-based solutions (AWS, Azure, GCP). Knowledge of data management principles and best practices. If you have expertise in Big Data and ETL solutions and want to work on cutting-edge cloud-based data pipelines , apply now!
SP Staffing Services Private Limited
Upload Resume
Drag or click to upload
Your data is secure with us, protected by advanced encryption.
My Connections SP Staffing Services Private Limited
Bengaluru / Bangalore, Karnataka, India
3.5 - 6.5 Lacs P.A.
Indore, Hyderabad, Pune
0.5 - 0.5 Lacs P.A.
Hyderabad
12.0 - 22.0 Lacs P.A.
Bengaluru
4.0 - 7.0 Lacs P.A.
Chennai, Tamil Nadu, India
Salary: Not disclosed
Bengaluru
32.5 - 32.5 Lacs P.A.
Chennai, Tamil Nadu, India
2.5 - 4.5 Lacs P.A.
Chennai, Bengaluru
0.6 - 1.25 Lacs P.A.
Chennai, Bengaluru
0.5 - 3.0 Lacs P.A.
Pune, Maharashtra, India
Salary: Not disclosed