Data Engineer II

3 - 6 years

0 Lacs

Posted:1 week ago| Platform: Foundit logo

Apply

Work Mode

On-site

Job Type

Full Time

Job Description

The Data Engineeris responsible formanaging,operating, and supporting cloud-based data platforms. This role involves close collaboration with customers and internal teams to ensure stable, secure, and efficient operations of the cloud data ecosystem.
The engineer will work across multiple technologies, includingAzure Data Lake Storage, Databricks, Azure Data Factory, Azure Synapse Analytics, Snowflake, Azure Event Hub, Tidal, Pyramid, Collibra, Power BI, Tableau, MicroStrategy (MSTR), and Alteryx, ensuring reliable data ingestion, processing, analytics, and reporting.

Key Responsibilities (Level 2 Operational Support)

  • Resolve data pipeline issues and perform proactive monitoring for sensitive and critical batch processes.
  • Conduct Root Cause Analysis (RCA) and retrospectives for incidents and operational issues.
  • Create, update, andmaintainoperational runbooks and manage entitlements asrequired.
  • Implement configuration changes to batch processes and underlying cloud infrastructure.
  • Manually control and manage pipeline executions during scheduled maintenance windows.
  • Perform on-demand operational changes based on instructions provided by the Data Engineering (L3) team.
  • Handle user service requests for non-runbook-based requests, coordinate effectively with the L3 team.
  • Participate in Disaster Recovery (DR) testing activities (twice a year).
  • Support development and production data synchronization activities.
  • Represent the team in weekly change management board meetings.

  • Knowledge, Skills, and Abilities

  • Strong hands-on experience with:
  • Azure Data Lake Storage
  • Azure Databricks
  • Azure Data Factory
  • Azure Synapse Analytics
  • Snowflake
  • Azure Event Hub
  • Tidal Scheduler
  • Pyramid, Collibra
  • Power BI, Tableau, MicroStrategy (MSTR), Alteryx
  • Ability to read, write, and troubleshoot SQL queries and stored procedures.
  • Proven experience in configuring, managing, and troubleshooting cloud data platforms.
  • Strong analytical and problem-solving skills.
  • Excellent written and verbal communication skills, with the ability to clearly explain technical concepts to non-technical stakeholders.
  • Ability to work effectively in small teams while promoting collaboration and inclusiveness.
  • Job Complexity

  • Requires extensive problem-solving capabilities, including independent investigation of issues and identification of root causes.
  • Ability to research andutilizemultiple information sources, including Microsoft and vendor documentation, to resolve complex issues.
  • Must be capable of prioritizing multiple incidents and tasks while managing competing deadlines.
  • Experience and Education

  • Bachelor's degree in Computer Scienceor a related field.
  • 3-6 years of hands-on experience in configuring and managing Azure-based data analytics solutions.
  • Prior experience working in Azure cloud environments is strongly preferred.
  • Physical Demands and Work Conditions

  • General office work environment no special physical demandsrequired.
  • Schedule flexibilityrequired, including regular weekend and holiday coverage to support 24-7 operations.
  • Occasional travel may berequired(less than 10%).
  • Mock Interview

    Practice Video Interview with JobPe AI

    Start Job-Specific Interview
    cta

    Start Your Job Search Today

    Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

    Job Application AI Bot

    Job Application AI Bot

    Apply to 20+ Portals in one click

    Download Now

    Download the Mobile App

    Instantly access job listings, apply easily, and track applications.

    coding practice

    Enhance Your Skills

    Practice coding challenges to boost your skills

    Start Practicing Now
    Rackspace Technology logo
    Rackspace Technology

    Cloud Computing

    San Antonio

    RecommendedJobs for You

    ahmedabad, gujarat, india

    bengaluru, karnataka, india

    ahmedabad, gujarat, india