Home
Jobs

Data Engineer

8 - 13 years

4 - 8 Lacs

Posted:2 hours ago| Platform: Naukri logo

Apply

Work Mode

Work from Office

Job Type

Full Time

Job Description


ResponsibilitiesDesign and Develop Scalable Data PipelinesBuild and maintain robust data pipelines using Python to process, transform, and integrate large-scale data from diverse sources.Orchestration and AutomationImplement and manage workflows using orchestration tools such as Apache Airflow to ensure reliable and efficient data operations.Data Warehouse ManagementWork extensively with Snowflake to design and optimize data models, schemas, and queries for analytics and reporting.Queueing SystemsLeverage message queues like Kafka, SQS, or similar tools to enable real-time or batch data processing in distributed environments.CollaborationPartner with Data Science, Product, and Engineering teams to understand data requirements and deliver solutions that align with business objectives.Performance OptimizationOptimize the performance of data pipelines and queries to handle large scales of data efficiently.Data Governance and SecurityEnsure compliance with data governance and security standards to maintain data integrity and privacy.DocumentationCreate and maintain clear, detailed documentation for data solutions, pipelines, and workflows.QualificationsRequired Skills:

  • 5+ years of experience in data engineering roles with a focus on building scalable data solutions.Proficiency in Python for ETL, data manipulation, and scripting.Hands-on experience with Snowflake or equivalent cloud-based data warehouses.Strong knowledge of orchestration tools such as Apache Airflow or similar.Expertise in implementing and managing messaging queues like Kafka, AWS SQS, or similar.Demonstrated ability to build and optimize data pipelines at scale, processing terabytes of data.Experience in data modeling, data warehousing, and database design.Proficiency in working with cloud platforms like AWS, Azure, or GCP.Strong understanding of CI/CD pipelines for data engineering workflows.Experience working in an Agile development environment, collaborating with cross-functional teams.Preferred Skills:

  • Familiarity with other programming languages like Scala or Java for data engineering tasks.Knowledge of containerization and orchestration technologies (Docker, Kubernetes).Experience with stream processing frameworks like Apache Flink.Experience with Apache Iceberg for data lake optimization and management.Exposure to machine learning workflows and integration with data pipelines.Soft Skills:

  • Strong problem-solving skills with a passion for solving complex data challenges.Excellent communication and collaboration skills to work with cross-functional teams.Ability to thrive in a fast-paced, innovative environment.
  • Mock Interview

    Practice Video Interview with JobPe AI

    Start Continuous Integration Interview Now
    cta

    Start Your Job Search Today

    Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

    Job Application AI Bot

    Job Application AI Bot

    Apply to 20+ Portals in one click

    Download Now

    Download the Mobile App

    Instantly access job listings, apply easily, and track applications.

    coding practice

    Enhance Your Python Skills

    Practice Python coding challenges to boost your skills

    Start Practicing Python Now
    Virtusa
    Virtusa

    Information Technology and Services

    Southborough

    20,000+ Employees

    3544 Jobs

      Key People

    • Kris Canekeratne

      Chairman and CEO
    • Sanjay Singh

      President and COO

    RecommendedJobs for You

    Hyderabad, Chennai, Bengaluru