Data Engineer - GMS

POSITION RESPONSIBILITIES

1. Design and Develop Data Solutions using Azure Data Factory & Data Bricks

• Design, develop, and implement data pipelines and workflows using

  Azure Data Factory

  and

  Azure Databricks

  .
• Integrate various data sources to ensure seamless data flow between systems.
• Optimize data processing and storage for both

  performance

  and

  cost-efficiency

  .

2. Oversee ETL/ELT Processes

• Manage and maintain

  ETL/ELT pipelines

  .

• Extract

  data from multiple sources.

• Transform

  data according to business requirements.

• Load

  data into target systems efficiently and effectively.
• Ensure data quality, consistency, and reliability across systems.

3. Cross-Team Collaboration and Continuous Learning

• Work closely with

  business stakeholders

  to gather requirements and ensure alignment with business objectives.
• Collaborate with

  infrastructure teams

  to ensure smooth deployment and integration.
• Stay up to date with the latest tools, frameworks, and technologies in the

  data engineering

  and

  cloud computing

  space.
• Engage in

  knowledge sharing

  with team members and continuously improve development processes.

4. DevOps & Agile Methodologies

• Implement and manage

  CI/CD pipelines

  for continuous integration and deployment of data solutions.
• Utilize

  Git

  for version control and collaboration, ensuring consistency and efficiency in the development process.
• Apply

  Agile practices

  in project management, ensuring timely delivery and iterative improvement.

5. Commercial Business Knowledge & System Understanding

• Develop an understanding of key business systems such as

  SAP-ERP

  ,

  Salesforce

  ,

  Vistex-Rebates

  ,

  Callidus

  ,

  Five9

  , and home-grown applications related to

  Master Data Management

  .
• Ensure that data solutions align with the business processes and objectives for improved data management and reporting.

ORGANIZATIONAL RELATIONSHIPS

• Business Stakeholders

  : Interact with business stakeholders to gather integration requirements, understand business processes, and ensure data solutions align with organizational goals.

• Implementation Partners

  : Work with third-party vendors responsible for deploying, configuring, or maintaining integrated solutions within Zoetis IT landscape.

• Development Teams

  : Coordinate with other development teams to ensure proper integration, share knowledge, and address any technical challenges.

EDUCATION AND EXPERIENCE

Education:

• Bachelor's or Master's degree in

  Computer Science

  ,

  Information Technology

  , or a related field.

Experience:

• 1.56.5 years of experience in

  Data Engineering

  or a similar field.
• Hands-on experience with

  Azure Data Factory

  and

  Azure Databricks

  .
• Proficiency in

  Python

  ,

  SQL

  , and

  ETL/ELT

  concepts.
• Strong experience with

  database management

  and

  data integration

  techniques.
• Familiarity with

  DevOps practices

  , including managing

  CI/CD pipelines

  and using

  Git

  for version control.
• Knowledge of

  Agile methodologies

  for project delivery and iterative improvements.
• Experience in

  data analysis

  ,

  data modeling

  , and architecting

  data analytics solutions

  .

TECHNICAL SKILLS REQUIREMENTS

• Cloud Technologies

  : Azure Data Factory, Azure Databricks

• Programming

  : Python

• Databases

  : SQL, PostgreSQL, Azure Databases

• ETL/ELT

  : Data extraction, transformation, and loading concepts

• Version Control

  : Git

• CI/CD Pipelines

  : Continuous integration and deployment practices

• Other

  : Data Visualization Tools (optional)

PHYSICAL POSITION REQUIREMENTS

• Standard working hours:

  11:00 PM to 8:00 AM IST

  .
• Occasional overlap with

  Eastern Standard Time (EST)

  is required, particularly during production go-live periods.

EMPLOYMENT TYPE

• Full-time

• Remote / Hybrid Flexibility

  (if applicable)