Posted:2 months ago|
Platform:
Work from Office
Full Time
We are looking for a highly skilled Data Engineers with 5 to 9 years of experience in data engineering specializing in PySpark, Python, GCP, IAM CS DataProc BigQuery SQL Airflow and building data pipelines Handling TerabyteScale Data Processing The ideal candidate will have a strong background in designing developing and maintaining scalable data pipelines and architectures
Key Responsibilities
Design develop and maintain scalable data pipelines using PySpark, Python, GCP, and Airflow
Implement data processing workflows and ETL processes to extract transform and load data from various sources into data lakes and data warehouses
Manage and optimize data storage solutions using GCP services
TerabyteScale Data Processing Developed and optimized PySpark code to handle terabytes of data efficiently Implemented performance tuning techniques to reduce processing time and improve resource utilization
Data Lake Implementation Built a scalable data lake on GCP CS to store and manage structured and unstructured data
Data Quality Framework Developed a data quality framework using PySpark and GCP to perform automated data validation and anomaly detection Improved data accuracy and reliability for downstream analytics
Collaborate with data scientists analysts and other stakeholders to understand data requirements and deliver highquality data solutions
Perform data quality checks and validation to ensure data accuracy and consistency
Monitor and troubleshoot data pipelines to ensure smooth and efficient data processing
Stay updated with the latest industry trends and technologies in data
Swift Staffing
Upload Resume
Drag or click to upload
Your data is secure with us, protected by advanced encryption.
Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.
We have sent an OTP to your contact. Please enter it below to verify.
Instantly access job listings, apply easily, and track applications.
Practice Python coding challenges to boost your skills
Start Practicing Python Now
hyderabad, chennai, bengaluru
15.0 - 25.0 Lacs P.A.
noida, hyderabad, pune, chennai, bengaluru
16.0 - 30.0 Lacs P.A.
1.5 - 2.0 Lacs P.A.
coimbatore
22.5 - 30.0 Lacs P.A.
hyderabad, chennai, bengaluru
12.0 - 22.0 Lacs P.A.
0.6 - 2.25 Lacs P.A.
bengaluru, mumbai (all areas)
10.0 - 18.0 Lacs P.A.
bengaluru
5.5 - 9.0 Lacs P.A.
noida, gurugram, delhi / ncr
10.0 - 20.0 Lacs P.A.
chennai, sholinganallur
15.0 - 25.0 Lacs P.A.
