Posted:1 day ago|
Platform:
Remote
Full Time
Key Responsibilities:
* Design, develop, and maintain scalable data pipelines and ETL/ELT solutions using
AWS cloud services.
* Ingest, process, and store structured/unstructured data from multiple sources (IoT
devices, sensors, ERP systems, drilling logs, production data, etc.).
* Implement data lake and data warehouse solutions
* Optimize data pipelines for performance, cost and scalability.
* Collaborate with domain experts, data scientists and business analysts to translate Oil
& Gas business requirements into data solutions.
* Ensure data governance, data quality and security compliance.
* Support real-time data streaming and analytics using AWS services (Kinesis, Kafka,
Lambda).
* Document technical solutions and provide knowledge transfer to the team.
* Proficiency in AWS services:
- S3, Redshift, Glue, Athena, EMR, Lake Formation
- Lambda, Kinesis, Step Functions, CloudWatch, RDS, DynamoDB (optional)
* Expertise in ETL/ELT development using PySpark, Python, or SQL.
* Experience with data modeling, warehousing, and performance tuning.
* Knowledge of data lake and modern data architecture.
* Strong SQL skills and ability to work with large datasets.
* Hands-on with CI/CD and DevOps practices for data solutions.
* Familiarity with Oil & Gas industry datasets and use cases (production, drilling,
exploration, sensor/IoT data).
* Candidate will also be judged in following skills:
- Understanding of data ingestion pattern.
- Extensive knowledge of data bricks & Azure Data Factory
- SQL Knowledge
- Incremental & Append data load
ASV Consulting Services
Upload Resume
Drag or click to upload
Your data is secure with us, protected by advanced encryption.
Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.
We have sent an OTP to your contact. Please enter it below to verify.
Instantly access job listings, apply easily, and track applications.
Practice Python coding challenges to boost your skills
Start Practicing Python Now
bengaluru
7.5 - 11.0 Lacs P.A.
6.0 - 12.0 Lacs P.A.
hyderabad, pune, chennai
15.0 - 30.0 Lacs P.A.
15.0 - 30.0 Lacs P.A.
kolkata, pune, delhi / ncr
4.0 - 8.0 Lacs P.A.
noida, kolkata, pune
8.0 - 11.0 Lacs P.A.
noida, kolkata, pune
8.0 - 11.0 Lacs P.A.
hyderabad, pune, bengaluru
0.5 - 0.5 Lacs P.A.
noida, gurugram, bengaluru
20.0 - 35.0 Lacs P.A.
bhubaneswar, nagpur, coimbatore
8.0 - 18.0 Lacs P.A.
