Home
Jobs
UST logo

Lead II - Senior Data engineer

0 years

0 Lacs

Trivandrum Kerala India

Posted:1 month ago| Platform: Linkedin logo

Apply

Skills Required

data aws etl design python processing code replication qlik apache terraform monitoring support splunk reliability testing development retention automation storage security tuning

Work Mode

On-site

Job Type

Full Time

Job Description

Role Description Job Title: Senior Data Engineer / Technical Lead (AWS & ETL) Job Summary We are looking for a skilled and proactive Data Engineer/Technical Lead to design, build, and manage cloud-based data pipelines. You'll work with AWS services, Python, and ETL tools to ensure smooth data processing, while also guiding your team and supporting project execution. Key Responsibilities Develop & Maintain Applications: Write clean, efficient, and well-tested code. Build and maintain ETL pipelines using Python and AWS tools. Reuse and improve existing components when possible. Cloud Data Work: Set up and manage data replication from DB2 to AWS Aurora using Qlik Replicate and AWS DMS. Process and store data in the cloud using AWS Lambda, Glue, and Apache Hudi. Use Terraform to manage AWS infrastructure as code (IaC). Monitoring & Support: Monitor data pipelines using CloudWatch, Splunk, and Dynatrace. Troubleshoot issues and ensure data accuracy and system reliability. Testing & Quality: Create and review unit tests. Work with the testing team to ensure quality standards are met. Reduce bugs and improve performance. Team & Project Support: Help manage project tasks and timelines. Support and mentor team members. Set goals, track progress, and support team development and retention. Work with Customers: Understand customer needs and clarify requirements. Present solutions and demos to clients. Coordinate with customer architects for finalizing technical designs. Mandatory Skills Python (strong experience) AWS Services: Lambda, S3, EC2, Glue, DMS, Aurora, CloudWatch, MWAA, EMR Serverless ETL Pipelines (designing and managing) Qlik Replicate (data replication) Terraform (intermediate level for infrastructure automation) Nice-to-Have Skills Apache Hudi for data lake storage Experience with Dynatrace and Splunk for monitoring Knowledge of security best practices in AWS Experience in performance tuning and design patterns Skills Python,Aws Services,ETL Pipelines Show more Show less

More Jobs at UST

Architect II - Technical SAP ABAP

Bengaluru

12 - 15 yrs
|

INR 0 - 0 Lacs

Lead I - SAP FICO with PS (Project Systems) and RAR

Bengaluru

5 - 7 yrs
|

INR 0 - 0 Lacs

Lead II - SAP ABAP

Bengaluru

7 - 9 yrs
|

INR 0 - 0 Lacs

Procurement

Bengaluru, Karnataka

Experience: Not specified

|

Salary: Not disclosed

Manual & Python Automation

Bengaluru, Karnataka

Experience: Not specified

|

Salary: Not disclosed

Mock Interview

Practice Video Interview with JobPe AI

Start Data Interview Now
UST
UST
www.ust.com

IT Services and IT Consulting

Aliso Viejo CA

10001 Employees

1129 Jobs

    Key People

  • Kris Canekeratne

    Co-Founder & CEO

  • Sandeep Reddy

    President

RecommendedJobs for You

UST logo

Lead II - Senior Data engineer

UST

Trivandrum, Kerala, India

UST logo

Lead II - Senior Data engineer

UST

Trivandrum, Kerala, India