Data Engineering Advisor

11 - 13 years

35 - 40 Lacs

Posted:Just now| Platform: Naukri logo

Apply

Work Mode

Work from Office

Job Type

Full Time

Job Description

Position Summary:
Data engineer on the Data integration team
Job Description & Responsibilities:
  • Work with business and technical leadership to understand requirements.
  • Design to the requirements and document the designs
  • Ability to write product-grade performant code for data extraction, transformations and loading using Spark, Py-Spark
  • Do data modeling as needed for the requirements.
  • Write performant queries using Teradata SQL, Hive SQL and Spark SQL against Teradata and Hive
  • Implementing dev-ops pipelines to deploy code artifacts on to the designated platform/servers like AWS.
  • Troubleshooting the issues, providing effective solutions and jobs monitoring in the production environment
  • Participate in sprint planning sessions, refinement/story-grooming sessions, daily scrums, demos and retrospectives.
Experience Required:
  • Overall 11-13 years of experience
Experience Desired:
  • Strong development experience in Spark, Py-Spark, Shell scripting, Teradata.
  • Strong experience in writing complex and effective SQLs (using Teradata SQL, Hive SQL and Spark SQL) and Stored Procedures
  • Healthcare domain knowledge is a plus
  • Education and Training Required:
Primary Skills:
  • Excellent work experience on Databricks as Data Lake implementations
  • Experience in Agile and working knowledge on DevOps tools (Git, Jenkins, Artifactory)
  • AWS (S3, EC2, SNS, SQS, Lambda, ECS, Glue, IAM, and CloudWatch)
  • Databricks (Delta lake, Notebooks, Pipelines, cluster management, Azure/AWS integration
  • Additional Skills:
  • Experience in Jira and Confluence
  • Exercises considerable creativity, foresight, and judgment in conceiving, planning, and delivering initiatives.
Location & Hours of Work
Hyderabad /General Shift (11:30 AM - 8:30 PM IST / 1:00 AM - 10:00 AM EST / 2:00 AM - 11:00 AM EDT)

Mock Interview

Practice Video Interview with JobPe AI

Start Job-Specific Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now

RecommendedJobs for You

Hyderabad / Secunderabad, Telangana, Telangana, India