Home
Jobs

ETL Data Engineer – Python/ AWS/ SQL

6 - 11 years

10 - 20 Lacs

Posted:8 hours ago| Platform: Naukri logo

Apply

Work Mode

Work from Office

Job Type

Full Time

Job Description

We are looking for energetic, self-motivated and exceptional Data engineer to work on extraordinary enterprise products based on AI and Big Data engineering leveraging AWS/Databricks tech stack. He/she will work with star team of Architects, Data Scientists/AI Specialists, Data Engineers and Integration.
Skills and Qualifications:5+ years of experience in DWH/ETL Domain; Databricks/AWS tech stack2+ years of experience in building data pipelines with Databricks/ PySpark /SQLExperience in writing and interpreting SQL queries, designing data models and data standards.Experience in SQL Server databases, Oracle and/or cloud databases.Experience in data warehousing and data mart, Star and Snowflake model.Experience in loading data into database from databases and files.Experience in analyzing and drawing design conclusions from data profiling results.Understanding business process and relationship of systems and applications.Must be comfortable conversing with the end-users.Job Description:Our engineering team is looking for a Data Engineer who is very proficient in python, has a very good understanding of AWS cloud computing, ETL Pipelines and demonstrates proficiency with SQL and relational database concepts. In this role you will be a very mid-to senior-level individual contributor guiding our migration efforts by serving as a Senior data engineer working closely with the Data architects to evaluate best-fit solutions and processes for our team. You will work with the rest of the team as we move away from legacy tech and introduce new tools and ETL pipeline solutions. You will collaborate with subject matter experts, data architects, informaticists and data scientists to evolve our current cloud based ETL to the next Generation. ResponsibilitiesIndependently prototypes/develop data solutions of high complexity to meet the needs of the organization and business customers.Designs proof-of-concept solutions utilizing an advanced understanding of multiple coding languages to meet technical and business requirements, with an ability to perform iterative solution testing to ensure specifications are met.Designs and develops data solutions that enables effective self-service data consumption, and can describe their value to the customer.Collaborates with stakeholders in defining metrics that are impactful to the business. Prioritize efforts based on customer value.Has an in-depth understanding of Agile techniques.Can set expectations for deliverables of high complexity.Can assist in the creation of roadmaps for data solutions. Can turn vague ideas or problems into data product solutions.Influences strategic thinking across the team and the broader organization.Maintains proof-of-concepts and prototype data solutions, and manages any assessment of their viability and scalability, with own team or in partnership with IT.Working with IT, assists in building robust systems focusing on long-term and ongoing maintenance and support.Ensure data solutions include deliverables required to achieve high quality data.Displays a strong understanding of complex multi-tier, multi-platform systems, and applies principles of metadata, lineage, business definitions, compliance, and data security to project work.Has an in-depth understanding of Business Intelligence tools, including visualization and user experience techniques.Can set expectations for deliverables of high complexity.Works with IT to help scale prototypes.Demonstrates a comprehensive understanding of new technologies as needed to progress initiatives.RequirementsExpertise in Python programming, with demonstrated real-world experience building out data tools in a Python environment.Expertise in AWS Services , with demonstrated real-world experience building out data tools in a Python environment.Bachelor`s Degree in Computer Science, Computer Engineering, or related discipline preferred. Masters in same or related disciplines strongly preferred.3+ years experience in coding for data management, data warehousing, or other data environments, including, but not limited to, Python and Spark. Experience with SAS is preferred.3+ years experience as developer working in an AWS cloud computing environment.3+ years experience using GIT or Bitbucket.Experience with Redshift, RDS, DynomoDB is preferred.Strong written and oral communication skills are required.Experience in the healthcare industry with healthcare data analytics productsExperience with healthcare vocabulary and data standards (OMOP, FHIR) is a plus

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now
Wits Innovation Lab
Wits Innovation Lab

Technology/Innovation

Johannesburg

20-50 Employees

305 Jobs

    Key People

  • Dr. Sandi A. F. Naicker

    Director
  • Prof. David B. M. S. O'Sullivan

    Innovation Specialist

RecommendedJobs for You

Kolkata, Mumbai, New Delhi, Hyderabad, Pune, Chennai, Bengaluru

Hyderabad, Chennai, Bengaluru