Principal Digital Solutions Consultant

Worleyparsons

9 - 16 years

25 - 30 Lacs

bengaluru

Posted:2 days ago| Platform:

Apply

Skills Required

amazon vpc amazon redshift pyspark ci/cd swagger azure devops sql xml waterfall json api rest based web service development events python github data manipulation nosql pipeline aws glue terraform agile aws ci cd pipeline soap sql programming

Work Mode

Work from Office

Job Type

Full Time

Job Description

Design and develop data integration solutions using AWS services such as Glue, Airflow, and DynamoDB.
Collaborate with cross-functional teams to identify business requirements and develop technical solutions.
Develop and maintain ETL jobs using AWS Glue services to process and transform data at scale.
Optimize and troubleshoot AWS Glue jobs for performance and reliability.
Utilize Python and PySpark to efficiently handle large volumes of data during the ingestion process.
Create and maintain optimal data pipeline architecture by designing and implementing data ingestion solutions on AWS using AWS native services.
Participate in client design workshops and provide tradeoffs and recommendations towards building solutions.
Develop and implement data pipelines for ingesting and collecting data from various sources into a centralized data platform.
Manage and optimize databases, both SQL and NoSQL, to support data storage and retrieval needs.
Implement monitoring solutions to track data pipeline performance and proactively identify and address issues.
Familiarity with Infrastructure as Code (IaC) tools like Terraform, AWS CDK, and others.
Proficiency in event-driven integrations, batch-based and API-led data integrations.
Proficiency in CI/CD pipelines such as Azure DevOps, AWS pipelines or Github Actions.

Disclaimer: This job description has been sourced from a public domain and may have been modified by Naukri.com to improve clarity for our users. We encourage job seekers to verify all details directly with the employer via their official channels before applying.

More Jobs at Worleyparsons

Marine Pipelines Engineer Level II

Bengaluru

5 - 15 yrs

INR 14 - 16 Lacs

Estimator II

Mumbai, Hyderabad, Karnataka

8 - 13 yrs

INR 9 - 13 Lacs

Piping Stress Engineer

Kolkata

3 - 7 yrs

INR 7 - 11 Lacs

Senior Structural Designer

Kolkata

4 - 8 yrs

INR 8 - 12 Lacs

Digital Solutions Consultant I

Hyderabad, Secunderabad

2 - 7 yrs

INR 10 - 14 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.