Data Engineer

0 years

0 Lacs

Posted:1 day ago| Platform: Linkedin logo

Apply

Work Mode

On-site

Job Type

Full Time

Job Description

Job Role:

Job Location:

Notice Period:

Primary Skill:


Role Proficiency

data pipelines

data warehousing solutions


Outcomes

  • Design and develop efficient pipelines/applications by applying proven solutions and design patterns.
  • Support Project Managers in execution and track developmental activities.
  • Interpret requirements, design architecture, and ensure alignment with specifications.
  • Write clean, optimized code; debug and test for best-in-class quality.
  • Tune performance and align with infrastructure and cost considerations.
  • Build scalable

    data schemas, models, and storage solutions

    (RDBMS, NoSQL, Data Lakes, Delta Lakes).
  • Validate results with users and ensure seamless integration.
  • Enhance customer satisfaction and team engagement.


Measures of Outcomes

  • Adherence to engineering processes, standards, and SLAs.
  • On-time delivery and reduction in post-production defects.
  • Faster turnaround for production issues.
  • Improvement in

    pipeline efficiency

    (lower resource consumption, faster runtimes).
  • Compliance with data security and governance.
  • Completion of certifications and mandatory training.
  • Improved detection and resolution times for pipeline failures.


Key Responsibilities

Coding & Development

  • Build, test, and optimize

    data processing code

    ensuring scalability.
  • Define coding standards, templates, and checklists.
  • Perform peer code reviews.


Documentation

  • Create/review design, architecture, and process documentation.
  • Develop mapping sheets, test cases, and infra cost estimations.


Configuration & Testing

  • Define configuration management plans and ensure compliance.
  • Design/review unit tests, test plans, and support QA teams.


Domain & Business Relevance

  • Guide engineers on domain-specific data use cases.
  • Understand customer domain and add business value.
  • Complete relevant domain certifications.


Project & Delivery

  • Support project planning and sprint execution.
  • Manage delivery of assigned modules.
  • Contribute to design/architecture (HLD, LLD, SAD).


Defect & Release Management

  • Conduct

    root cause analysis (RCA)

    and reduce recurring issues.
  • Execute and monitor release processes.


Customer Interaction

  • Clarify requirements and provide technical guidance.
  • Present design options and conduct product demos.
  • Collaborate with customer architects.


Team Management

  • Set goals, provide feedback, and enable upskilling.
  • Mentor team members and identify retention risks.


Skills & Expertise

Technical Skills

  • Programming:

    Python, Scala, PySpark, SQL

  • ETL Tools: Informatica, Apache Airflow, AWS Glue, Dataproc, Azure ADF, Talend
  • Cloud Platforms: AWS, Azure, GCP (Glue, BigQuery, Dataflow, ADLS, etc.)
  • Data Warehousing: Snowflake, BigQuery, Lakehouse, Delta Lake
  • Data Modeling & Schema Design
  • Performance tuning and optimization


Soft Skills

  • Strong analytical and problem-solving ability
  • Ability to explain technical concepts to business stakeholders
  • Mentorship and leadership skills


Knowledge Examples

  • Data security concepts and compliance best practices.
  • Data warehouse optimization techniques.
  • ETL services across cloud platforms.
  • Familiarity with automation practices, frameworks, and reusable components.


Certifications

  • Relevant

    cloud and domain certifications

    (AWS, Azure, GCP, Snowflake, Databricks, etc.) are highly desirable.

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now
UST logo
UST

IT Services and IT Consulting

Aliso Viejo CA

RecommendedJobs for You

gurugram, haryana, india

gurugram, haryana, india

bengaluru, karnataka, india

bengaluru, karnataka, india

hyderabad, telangana, india

hyderabad, telangana, india

chennai, tamil nadu, india