Posted:1 month ago|
Platform:
Hybrid
Full Time
Experience Level: 10 to 12 years of relevant IT experience
Key Responsibilities:
Design, develop, test, and maintain scalable ETL data pipelines using Python.
Architect the enterprise solutions with various technologies like Kafka, multi-cloud services, auto-scaling using GKE, Load balancers, APIGEE proxy API management, DBT, using LLMs as needed in the solution, redaction of sensitive information, DLP (Data Loss Prevention) etc.
Work extensively on Google Cloud Platform (GCP) services such as:
Dataflow for real-time and batch data processing
Cloud Functions for lightweight serverless compute
BigQuery for data warehousing and analytics
Cloud Composer for orchestration of data workflows (on Apache Airflow)
Google Cloud Storage (GCS) for managing data at scale
IAM for access control and security
Cloud Run for containerized applications Should have experience in the following areas :
API framework: Python FastAPI
Processing engine: Apache Spark
Messaging and streaming data processing: Kafka
Storage: MongoDB, Redis/Bigtable
Orchestration: Airflow
Experience in deployments in GKE, Cloud Run.
Perform data ingestion from various sources and apply transformation and cleansing logic to ensure high-quality data delivery.
Implement and enforce data quality checks, validation rules, and monitoring.
Experis
Upload Resume
Drag or click to upload
Your data is secure with us, protected by advanced encryption.
Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.
We have sent an OTP to your contact. Please enter it below to verify.
Instantly access job listings, apply easily, and track applications.
Practice Python coding challenges to boost your skills
Start Practicing Python Now
hyderabad
20.0 - 30.0 Lacs P.A.
hyderabad, chennai, bengaluru
Experience: Not specified
1.0 - 4.0 Lacs P.A.
hyderabad
4.0 - 8.0 Lacs P.A.
20.0 - 25.0 Lacs P.A.
hyderabad, gurugram, bengaluru
4.0 - 7.0 Lacs P.A.
chennai, gurugram, bengaluru
2.0 - 5.0 Lacs P.A.
chennai, gurugram, bengaluru
8.0 - 12.0 Lacs P.A.
hyderabad, chennai, bengaluru
2.0 - 5.0 Lacs P.A.
hyderabad
Experience: Not specified
2.0 - 5.0 Lacs P.A.
14.0 - 18.0 Lacs P.A.
