Posted:1 month ago|
Platform:
Hybrid
Full Time
Job Title: Python , PySpark Exp. :- 8+ yrs Location Workplace: Hyderabad/Bangalore ( Hybrid mode ) Job Type: Full-time Job Description: 8+ years of experience in data engineering with supply chain analytics Strong knowledge on data pipelines, data modelling, metadata management Experience with data lakes, data warehouses , data hubs and ETL Tools like PySpark, Golden Gate Replication, ETL. Languages and technologies : SQL, Python, PySpark, Scala, Spark, SQL/NoSQL databases, Develop and maintain scalable PySpark-based ETL pipelines for big data processing. Optimize Spark jobs through partitioning, caching, and performance tuning techniques. Ensure data quality with validation frameworks and error-handling mechanisms. Work with structured and unstructured data, handling transformations efficiently. Implement CI/CD pipelines for automated data pipeline deployment and monitoring. Relational Databases: Experience with managing and optimizing relational databases (e.g., Oracle SQL , PostgreSQL, SQL Server). NoSQL Databases: Experience with managing and optimizing relational databases (e.g., MongoDB, Cassandra) for handling unstructured and semi-structured data. Expertise in testing and deployment of data applications (e.g., provisioning resources, deploying and monitoring workflows and data quality) Expertise apache airflow
Talworx Solutions
Upload Resume
Drag or click to upload
Your data is secure with us, protected by advanced encryption.
Pune, Mumbai (All Areas)
15.0 - 18.0 Lacs P.A.
Greater Delhi Area
Salary: Not disclosed
Bengaluru / Bangalore, Karnataka, India
1.0 - 1.0 Lacs P.A.
5.5 - 15.5 Lacs P.A.
Bengaluru
5.0 - 6.0 Lacs P.A.
Bengaluru
9.0 - 13.0 Lacs P.A.
Mumbai
20.0 - 23.0 Lacs P.A.
10.0 - 18.0 Lacs P.A.
Bengaluru
15.0 - 25.0 Lacs P.A.
Hyderabad, Bengaluru
14.0 - 24.0 Lacs P.A.