Home
Jobs

214 Data Engineer Jobs - Page 8

Filter
Filter Interviews
Min: 0 years
Max: 25 years
Min: ₹0
Max: ₹10000000
Setup a job Alert
JobPe aggregates results for easy application access, but you actually apply on the job portal directly.

4 - 7 years

15 - 22 Lacs

Pune, Bengaluru

Hybrid

Naukri logo

Job Role & responsibilities: - Understanding operational needs by collaborating with specialized teams Supporting key business operations. This involves architecture designing, building and deploying data systems, pipelines etc Designing and implementing agile, scalable, and cost efficiency solution on cloud data services. Lead a team of developers, implement Sprint planning and executions to ensure timely deliveries Technical Skill, Qualification & experience required:- 4-6 years of experience in Azure Cloud Data Engineering, Azure Databricks, datafactory , Pyspark, SQL,Python Hands on experience in Data Engineer, Azure Databricks, Data factory, Pyspark, SQL Proficient in Cloud Services Azure Architect and implement ETL and data movement solutions. Migrate data from traditional database systems to Cloud environment Strong hands-on experience for working with Streaming dataset Building Complex Notebook in Databricks to achieve business Transformations. Hands-on Expertise in Data Refinement using Pyspark and Spark SQL Familiarity with building dataset using Scala. Familiarity with tools such as Jira and GitHub Experience leading agile scrum, sprint planning and review sessions Good communication and interpersonal skills Comfortable working in a multidisciplinary team within a fast-paced environment * Immediate Joiners will be preferred only

Posted 3 months ago

Apply

6 - 9 years

12 - 17 Lacs

Bengaluru, Hyderabad

Hybrid

Naukri logo

Dear Candidate, Greeting for the day! Job Title: Data Engineer / Systems Analyst ITOPS Analyst team Role Overview: We are looking for a highly skilled Data Engineer/Systems Analyst who will analyze data, validate system flows, and contribute to automation efforts. The ideal candidate will have a strong background in scripting, database management, and system analysis, with a focus on improving operational efficiencies. Key Responsibilities: Analyze data in databases or system logs . Write and execute SQL queries for data analysis and validation. Develop and maintain database scripts (Oracle PL/SQL). Write and maintain Python scripts to support automation. Perform system flow validation and sanity testing. Review and troubleshoot results from scripts and system processes. Automate repetitive tasks to improve operational efficiency. Work with version control tools (e.g., GitHub) for code management. Must-Have Skills: Programming: Python, Shell Scripting, Oracle PL/SQL, Jupyter Notebooks. Databases: Oracle, PostgreSQL, MongoDB. Other Tools/Technologies: Splunk, Unix, AWS. Tools: Postman, SOAP UI. Experience with automation and version control tools like GitHub. Nice-to-Have Skills: Java Hadoop Camunda Additional experience with GitHub for advanced workflows. Role Summary: This role is ideal for candidates who enjoy solving complex data problems, scripting for automation, and validating system performance. A strong foundation in Python, SQL, and databases, along with exposure to Unix and AWS environments, is essential for success. Regards, Sushma A

Posted 3 months ago

Apply

10 - 14 years

35 - 40 Lacs

Chennai, Pune, Kolkata

Work from Office

Naukri logo

Azure Expertise: The architect should have experience in architecting large scale analytics solutions using native services such as Azure Synapse, Data Lake, Data Factory, HDInsight, Databricks, Azure Cognitive Services, Azure ML, Azure Event Hub. Work with customers, end users, technical architects, and application designers to define the data requirements and data structure for BI/Analytic/ solutions Designs conceptual and logical models for the data lake, data warehouse, data mart, and semantic layer (data structure, storage, and integration). Lead the database analysis, design, and build effort Expert in big data technologies on Azure/GCP Experience with ETL platform like ADF / Glue / Ab Initio/ Informatica / Talend / Airflow Experience in data visualization tools like Tableau, Power BI etc. 3+ years of experience in a data engineering, metadata management, database modelling and development role Strong experience in handling streaming data with kafka Understanding of Data APIs, Web services Experience in Data security and Data Archiving/Backup, Encryption and define the standard processes for same. Experience in setting up DataOps and MLOps Communicates physical database designs to lead data architect / database administrator

Posted 3 months ago

Apply

7 - 12 years

25 - 35 Lacs

Hyderabad, Noida

Hybrid

Naukri logo

Hands-on experience in development and production implementation with Databricks and Spark. Proficiency in Python (PySpark) and SQL coding. Proven ability to optimize performance for TB-scale data processing. Strong Understanding of data lake architecture, ETL processes, and data quality management. Experience with AWS data analytics services. Excellent technical writing skills for creating requirements and testing documents, with the ability to communicate technical concepts clearly and concisely. Knowledgeof Git.

Posted 3 months ago

Apply

5 - 10 years

40 - 60 Lacs

Hyderabad

Work from Office

Naukri logo

About Client Hiring for One of the Most Prestigious Multinational Corporations! Job Description Job Title : Data Engineer( Python/SQL/GCP) Required skills and qualifications: Data Engineer( Python/SQL/GCP) Qualification : Any Graduate or Above Relevant Experience : 5 to 15 yrs Location : Chennai Bangalore Hyd Pune Gurgaon CTC Range : 40 to 60 LPA Notice period : Currently serving / 30 days / 60 days/ 90days Mode of Interview : Virtual Mode of Work : In Office Sana F Staffing analyst - IT recruiter Black and White Business solutions PVT Ltd Bangalore, Karnataka, INDIA sana.f@blackwhite.in I www.blackwhite.in +91 8067432416

Posted 3 months ago

Apply

5 - 10 years

9 - 19 Lacs

Chennai

Work from Office

Naukri logo

We have an Urgent Opening For the role of Sr Data Engineer - Snowflake with a leading IT company. Location - Chennai Notice period - 30 days Experience - 5 to 12 years Skills Task Description: Task Description: - Sr Data Engineer with in depth and strong Snowflake experience. - Experienced Data Professional with Strong SQL skills, focus on Data Quality, Performance, Data Modeling and Design. - Ability to write complex SQL logic in Sprocs, be able to performance tune and design for large data volumes. - Experience with Matillion and similar ETL tools - Understanding and hands on usage of version control, CI/CD practices with SQL and ETL tools. - Exposure to Public cloud platforms - ideally on Azure (including other Azure components such as Azure Blob Storage). - working closely with our BU partners as a consultant to transform their requirements (BRS) into a solution (SRS), document it properly, share your knowledge with the more junior members. You will need excellent communication and technical writing skills. - Ability to debug and enhance on existing ETL pipelines - Ability to add ETL or DB logic and functionality with Python. Good to have: Advanced Snow Pro Certification Work Result: Sr Data Engineer Skill Area: DataDatabase Skills, Strong SQL Skills, Strong DB design, data modeling and Performance tuning experience , Data Quality Technology: Snowflake Data Cloud, SQL, Matillion Proficiency - Technology: Advanced Other Skills: Analytical Skills, Python knowledge Note - If interested kindly drop a mail along with updated resume at anil.kumar@bharatjobs.com Please confirm the below details- Total Experience Relevant Experience Current CTC Expected CTC Notice period Current location Regards Anil

Posted 3 months ago

Apply

5 - 10 years

12 - 18 Lacs

Pune, Delhi NCR, Bengaluru

Work from Office

Naukri logo

Experience with other AWS services such as AWS Lambda, S3, and Redshift is a plus. Familiarity with other database migration tools and technologies. Certifications in AWS or other relevant data engineering domains.

Posted 3 months ago

Apply

4 - 8 years

12 - 22 Lacs

Hyderabad

Work from Office

Naukri logo

Role & responsibilities Responsibilities Develop and enhance data-processing, orchestration, monitoring, and more by leveraging popular open-source software, AWS, and GitLab automation. Collaborate with product and technology teams to design and validate the capabilities of the data platform Identify, design, and implement process improvements: automating manual processes, optimizing for usability, re-designing for greater scalability Provide technical support and usage guidance to the users of our platforms services. Drive the creation and refinement of metrics, monitoring, and alerting mechanisms to give us the visibility we need into our production services. Preferred candidate profile Experience building and optimizing data pipelines in a distributed environment Experience supporting and working with cross-functional teams Proficiency working in Linux environment 4+ years of advanced working knowledge of SQL, Python, and PySpark Knowledge on Palantir Experience using tools such as: Git/Bitbucket, Jenkins/CodeBuild, Code Pipeline Experience with platform monitoring and alerts tools Perks and benefits Competitive wage

Posted 3 months ago

Apply

10 - 15 years

12 - 22 Lacs

Pune, Hyderabad

Work from Office

Naukri logo

Dear Candidate, We are having Openings for Data Engineer role@ Tech Mahindra. Location: Hyd , Pune. Exp: 10+ Yrs NP: Immediate Mode of Work: Weekly 4 days need to work from Office Shift Timings: 12- 9 PM IST Job description Skill: Data Engineer JD: Exp:10+ years' experience in Java and 5+ years exp in Spark, Kafka, AWS, ETL and Data pipeline frame works.. Interested ones please share your resumes to sa00961356@TechMahindra.com for faster response. Total Yrs of Exp: Relevant exp in Spark: Exp in Java: Exp in Kafka: Exp in AWS: Exp in ETL: Exp in Data pipeline Frameworks: CTC: ECTC: Offer amount (if holding any offer ) : Notice Period (LWD if serving NP ) Preferred Location: Are you having PF deduction for all companies (If not pls mention for which companies you dont have) Are You Permanent Employee for all Companies (If not Pls mention your Payroll Company Names): Thank you Tech Mahindra Team

Posted 3 months ago

Apply

4 - 8 years

12 - 20 Lacs

Chennai, Bengaluru

Work from Office

Naukri logo

Key Responsibilities GCP Data Engineer Data Pipeline Development: Build and maintain scalable ETL/ELT pipelines using Apache Beam, Dataflow, Cloud Data Fusion, or Composer (Airflow) . Data Warehousing: Design and optimize data models, schemas, and storage solutions in BigQuery . Data Integration: Work with structured and unstructured data from multiple sources using Pub/Sub, Cloud Storage, and Kafka . Data Governance & Security: Implement best practices for data quality, lineage, and access control following industry standards. Automation & Performance Optimization: Use Terraform for IaC, CI/CD pipelines, and monitoring tools like Stackdriver for performance tuning. Collaboration: Work with Data Scientists, Analysts, and DevOps teams to streamline workflows and ensure efficient data accessibility . Must-Have Skills: Google Cloud Services: BigQuery, Dataflow, Cloud Composer (Airflow), Cloud Storage, Cloud Functions, Pub/Sub Programming: Strong proficiency in Python, SQL (advanced queries, stored procedures, indexing, partitioning) ETL & Data Processing: Experience with Apache Beam, Spark, DataProc Infrastructure as Code: Terraform, Cloud Deployment Manager Data Security & Governance: IAM, VPC, encryption, GDPR compliance Nice-to-Have Skills: Experience with Kafka, Snowflake, Databricks Machine Learning Pipelines (AI/ML on GCP) Experience with Streaming Data Processing (Flink, Kinesis, Pub/Sub) DevOps/CI-CD (Jenkins, GitHub Actions, Cloud Build) Qualifications: Bachelor’s or Master’s in Computer Science, Data Engineering, or related field 3-8 years of experience in Data Engineering & GCP ecosystem GCP Certifications (Professional Data Engineer preferred)

Posted 3 months ago

Apply

5 - 10 years

4 - 9 Lacs

Hyderabad

Work from Office

Naukri logo

Be a part of our success story. Launch offers talented and motivated people the opportunity to do the best work of their lives in a dynamic and growing company. Through competitive salaries, outstanding benefits, internal advancement opportunities, and recognized community involvement, you will have the chance to create a career you can be proud of. Your new trajectory starts here at Launch. What we are looking for: Looking for a data engineer with strong experience with data migration/integration with any ERP. Data migration/Intergration into Salesforce would be ideal. Role: Data Engineer Location: Hyderabad Work Mode: WFO/Hybrid Years of experience: 5+ Years of Experience Roles and Responsibilities : Experience delivering streamlined robust, scalable data migrations & acquisitions implementations for LDVs of integrated legacy data with various technologies & tools including but not limited to Salesforce, AWS, Oracle, Microsoft SQL Server, DB2, Informatica Cloud, SSIS, Apex Data Loader, Jitterbit, Mulesoft and more, adhering to recommended best practices Knowledge about Sales force setup menu, Configuration, Administration, Data Migration and Deployment of applications to Force.com platform. Proficient in transforming client business requirements and designing data architectural models, standards, and blueprints to meet client's requirement specifications, using various tools such as Lucidchart, Microsoft Visio, Salesforce Schema Builder. Perform high-level data profiling to identify overall data health concerns and recommend holistic solutions to manage data integrity, and improve overall organizational data quality and governance issues. Direct and manage full project life-cycle utilizing Waterfall and Agile Software Development Life Cycle (SDLC) methodologies via agile scrum in JIRA. Develop and maintain all relevant technical artifacts including but not limited to design document, data mapping workbooks, data deployment & environment strategy, data archival/backup, governance and master data management (MDM) plans. Act as a liaison and facilitate technical meetings between business users, stakeholders, IT and data stewards to gather business requirements. Recommend and manage User Acceptance Testing strategy, Go-Live timelines and Risk Mitigation plans We are Navigators in the Age of Transformation: We use sophisticated technology to transform clients into the digital age, but our top priority is our positive impact on the human experience. We ease anxiety and fear around digital transformation and replace it with opportunity. Launch IT is an equal opportunity employer and considers applicants for all positions without regard to race, color, religion or belief, sex, age, national origin, citizenship status, marital status, military/veteran status, genetic information, sexual orientation, gender identity, physical or mental disability or any other characteristic protected by applicable laws. Launch IT is committed to creating a dynamic work environment that values diversity and inclusion, respect and integrity, customer focus, and innovation. About Company : Launch IT India is wholly owned subsidiary of The Planet Group (http://www.launchcg.com; http://theplanetgroup.com) a US company, offers attractive compensation and work environment for the prospective employees. Launch is entrepreneurial business and technology consultancy. We help businesses and people navigate from current state to future state. Technology, tenacity, and creativity fuel our solutions with offices in Bellevue, Sacramento, Dallas, San Francisco, Hyderabad & Washington D.C. https://www.linkedin.com/company/launch-consulting-group-india

Posted 3 months ago

Apply

12 - 15 years

55 - 65 Lacs

Hyderabad

Work from Office

Naukri logo

JOB DESCRIPTION Position : Director of Engineering - Data/AI Job Location: Hyderabad, India Department: Asia Technology Role Value Proposition We are seeking an experienced and highly skilled Director of Engineering to lead our Data and AI Engineering Team . The successful candidate will be responsible for managing a team of data and AI engineers and data and AI analysts, and will play a critical role in designing, developing, implementing, and maintaining our company's data platforms and AI platforms. This includes designing and building scalable data pipelines, designing and building data hub/data lakes in the cloud, ensuring data quality and integrity, and collaborating with cross-functional teams to deliver business insights and analytics. The ideal candidate will have a strong technical background in software engineering, data engineering, and cloud computing, AI solutions, as well as excellent leadership and communication skills. Key Responsibilities: Lead the design and implementation of scalable and efficient data hubs/lakes in the cloud. Lead the design and implementation of scalable and efficient AI solutions Help design and develop strategy for data ingestion, curation and consumption by the data producers and consumers. Help design the data pipelines and create data assets for the organization. Implement and enforce data governance policies and practices to ensure the security, integrity and quality of our data assets. Drive initiatives to maintain and improve data quality, collaborating with cross-functional teams to establish and monitor data quality metrics. Help design and develop data analytics strategy for the organization. Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that meet business needs. Actively contribute to the development process, providing hands-on technical leadership and mentoring to the data engineering team. Identify skill gaps, provide coaching, and support the professional growth of team members, fostering a culture of continuous learning. Candidate Qualifications: Essential Business Experience and Technical Skills: Bachelor's or advanced degree in Computer Science, Engineering, or a related field. Proven track record of 12-15 years in data engineering, with significant experience in cloud-based data engineering solutions. Hands-on experience with design and development of cloud-based data hubs/lakes and defining the enterprise data strategy. Proficiency in implementing and managing data lakes in the cloud. Hands-on experience with large-scale data processing frameworks (e.g., Spark, Hadoop, Kafka). Proficient in programming languages such as Python or Java; familiarity with SQL and database technologies. Experience architecting scalable data systems on cloud platforms (AWS, GCP, Azure) preferably Azure data hub. Experience in data warehousing. (data modeling, dimensional modeling, ETL etc.) and data analytics frameworks (Azure Synapse). Demonstrated experience in implementing and managing data governance frameworks and ensuring high data quality standards. Strong leadership skills with the ability to lead and inspire a high-performing data engineering team, fostering a collaborative and innovative work environment. Excellent communication skills with the ability to convey complex technical concepts to both technical and non-technical stakeholders Why MetLife? At MetLife, we don't fit into a box, we create our own boxes. Our Global Technology team is helping to transform a customer-first Fortune 50 company - by offering the high-tech digital solutions customers have come to expect, while delivery high-touch customer care during the moments that matter most. Our tech teams enable the business, helping fuel MetLife's purpose: always with you, building a more confident future . It's where you can grow your career, driving digital transformation in an agile, open, and inclusive environment, where every voice carries weight, and no idea is left off the table. Here, innovation is everybodys job. Its not done within one team or in a lab. Whether youre driving continuous improvement with your DevOps team, integrating data science and AI into our decision making, or developing best-in-class digital and cloud solutions that protect customer data and personalize their experience, what you build matters as part of a team where together, we can do more.

Posted 3 months ago

Apply

2 - 7 years

5 - 12 Lacs

Bengaluru, Bangalore Rural

Work from Office

Naukri logo

Role: Data Engineer. Experience:2+ Location: Bangalore Notice Period: 0-10 days Work Mode: WFO Interview Mode: Face to Face Job Description We are seeking an experienced Data engineer to join our Data Engineering team. In this role, you will be part of a team of data engineers, ensuring timely delivery of high-quality, scalable, and maintainable data solutions on cloud platforms. Key Responsibilities: Design, develop, and deploy data engineering projects in collaboration with cross-functional team members. Actively participate in the full data engineering lifecycle, from planning to implementation, maintenance, and support of current and new data applications. Work closely with senior management to improve the design and architecture of existing data systems and explore innovative solutions using cutting-edge technologies. Conduct code and design reviews to enhance the availability, scalability, latency, and efficiency of data applications. Demonstrate expertise in various areas of data engineering and backend functionality. Required Qualifications: 2+ years of relevant data engineering experience on large-scale projects. Extensive experience developing and leading successful projects for data-intensive applications, focusing on cloud-based solutions with stateless horizontal scaling and event-driven architecture Strong understanding of data processing frameworks, ETL pipelines, and big data technologies Proficiency in cloud platforms (e.g., AWS, Azure, or Google Cloud Platform) In-depth knowledge of SQL and NoSQL databases Experience with containerization and orchestration technologies (e.g., Docker, Kubernetes) Experience with data visualization tools and techniques

Posted 3 months ago

Apply

10 - 14 years

30 - 35 Lacs

Bengaluru

Work from Office

Naukri logo

Lead data engineering projects, design scalable data architectures, and collaborate with analytics teams for business insights.

Posted 3 months ago

Apply

7 - 12 years

15 - 17 Lacs

Chennai, Kochi, Mumbai (All Areas)

Hybrid

Naukri logo

Azure DF , Azure synapse,Azure SQL ,Date Warehouse and Web Services,Pyspark Overall 7-10 yrs Exp Min 5 yrs in Data Engineering Location - Chennai,Mumbai,Kochi,Coimbatore Mode-Hybrid **Immediate joiner only **

Posted 3 months ago

Apply

4 - 9 years

5 - 15 Lacs

Pune, Bengaluru, Hyderabad

Work from Office

Naukri logo

Dear Candidate, Hiring for the below requirement with an immediate notice. Required Skills: Bachelors degree in Engineering, Computer Science, Information Technology, or a related field. Strong experience in Snowflake, including designing, implementing, and optimizing Snowflake-based solutions. Hands-on expertise in PLSQL, including writing and optimizing complex queries, stored procedures, and functions. Proven ability to work with large datasets, data warehousing concepts, and cloud-based data management. Proficiency in SQL, data modeling, and database performance tuning. Experience with ETL/ELT processes and integrating data from multiple sources. Familiarity with cloud platforms such as AWS, Azure, or GCP is an added advantage. Snowflake certifications (e.g., SnowPro Core, SnowPro Advanced) are a plus. Strong analytical skills, problem-solving abilities, and attention to detail. Excellent communication skills and ability to work effectively in a collaborative environment. Regards, TAG Team

Posted 3 months ago

Apply

8 - 11 years

15 - 25 Lacs

Pune, Delhi NCR, Bengaluru

Work from Office

Naukri logo

Required Immediate joiners. We are hiring for a leading Financial Services at Delhi/NCR/ Pune/ BAngalore Exp: 8yrs to 11yrs in Data Engineer role with good knowledge in SSIS, Azure Data Factory, Data Warehouse./ ADF Responsibility: -The work includes data extraction, data transformation, data load, data quality management, and data audit process. -Design, develop and implement data integration (ETL) processes to transform structured data, unstructured data, disparate source data into the target data warehouse or other source applications -Work with service & support team to resolve escalated operational issues and able to work independently with customers and drive solutions -Excellent knowledge of data extraction, data transformation, and data load the concepts and technology Should have experience of working on Microsoft Azure tools like Spark, Databrick, Synapse (knowledge of these will be an added advantage). Should be very strong on BI and EDWH concepts. Must have good experience on working on Microsoft technologies. Role demands working on ADF, SSIS, Data Analysis, EDW

Posted 3 months ago

Apply

8 - 13 years

9 - 14 Lacs

Hyderabad

Work from Office

Naukri logo

Python Knowledge with Pyspark, Pandas and Python Objects Knowledge of Google Cloud PlatformGCP Certified Prof. Data Engineer. Google Cloud :GCP cloud storage, Data proc, Big querySQL - Strong SQL & Advanced SQLSpark- writing skills on Pyspark DWH - Data warehousing concepts & dimension modelingGITTeam Leading ExperienceApache SparkScheduling tools/ETL toolsRoles & Responsibilities: Provide Technical Solutions Team Management:Assign the tasks to the team, Help/Guide Team Members for technical Queries Excellent troubleshooting, attention to detail, and communication skills in fast-paced setting.Good Understanding of Technical Requirements and co-ordination with business stakeholdersDesign & Build Enterprise Datawarehouse & DataMarts, deploy in cloud (GCP) Perform Descriptive Analytics & Reporting Perform peer code reviews, design documents & test casesSupport systems currently live and deployed for customers Build knowledge repository & cloud capabilities Good understand writing python codeUnderstanding Agile - User Story creation

Posted 3 months ago

Apply

5 - 10 years

5 - 12 Lacs

Chennai, Bengaluru

Work from Office

Naukri logo

Role & responsibilities Position: Data Engineer Exp: 5 to 10 yrs Notice Period: Immediate to max 30 days Note: This weekend i.e., on 8th March 2025 we are conducting Face to Face Diversity drive at Bangalore & Chennai location anyone interested kindly forward your resume to below mail ID Mail ID: divyashree.s28@wipro.com AWS Data Engineer:- Data Pipeline design and orchestration AWS (S3, EMR, Lambda, Glue, Redshift, Lakeformation, firehose, Neptune, Quicksight) Hadoop Spark/PySpark Scala/Java/Python Azure Data Engineer:- Azure (DataLake, ADB, ADF, ADLS, Functions, Synapse, Integration, Azure Purview) Hadoop Spark/PySpark Scala/Java/Python Preferred candidate profile Perks and benefits

Posted 3 months ago

Apply

7 - 12 years

10 - 20 Lacs

Delhi NCR, Bengaluru, Hyderabad

Hybrid

Naukri logo

Job Description Senior/ Lead level with hands-on experience Proficient in Python Language with knowledge of key libraries and packages Understands and can implement key Python concepts Experienced in using Spark for Big Data Processing; understands and can implement key Spark concepts Basic DevOps knowledge Understanding of Azure Fundamentals Understanding of RDBMS Database Fundamentals

Posted 3 months ago

Apply

6 - 10 years

30 - 40 Lacs

Bengaluru

Work from Office

Naukri logo

Position: Data Engineer Location: Bangalore Work Mode: Hybrid / Client Location Skills & Experience • 6-10 Years of experience • Data Engineer • Snowflake (Mandatory) • ETL • Python • Big Data, SQL • Hive, Hadoop

Posted 3 months ago

Apply

5 - 10 years

27 Lacs

Chennai, Pune

Work from Office

Naukri logo

Candidate must have expertise/experience with below tasks Resource should work for UK shift Candidate must have experience on Linux, git, CICD, Release management, production deployment and support. Good Knowledge of Python is MUST Good Knowledge of Java language is MUST. Strong Knowledge on Kubernetes/Docker is MUST Good Knowledge on Apache Spark is MUST Good Knowledge on SQL is MUST Good to have conceptual knowledge on Apache Airflow, Apache Atlas, Apache Ranger, Postgres, Trino, Superset

Posted 3 months ago

Apply

7 - 12 years

30 - 35 Lacs

Bengaluru

Remote

Naukri logo

Developing end to end ETL/ELT Pipeline working with Data Analysts of business Function. Designing, developing, and implementing scalable, automated processes for data extraction, processing, and analysis in a Data Mesh architecture Mentoring Fother Junior Engineers in the Team Be a go-to expert for data technologies and solutions Ability to provide on the ground troubleshooting and diagnosis to architecture and design challenges Troubleshooting and resolving technical issues as they arise Looking for ways of improving both what and how data pipelines are delivered by the department Deal Making Skills : DBT, Snowflake, SQL Along with reporting tools like power bi or tableau or Looker

Posted 3 months ago

Apply

4 - 9 years

30 - 35 Lacs

Bengaluru

Hybrid

Naukri logo

We are seeking an AWS Data Engineer with 4 + years of experience to design, build, and maintain scalable data pipelines and cloud-based data solutions using AWS services like Glue, Lambda, S3, Redshift, and DynamoDB.

Posted 3 months ago

Apply

3 - 8 years

10 - 13 Lacs

Mumbai

Work from Office

Naukri logo

Manage and optimize data pipelines for medallion architecture (Landing, Bronze, Silver, Gold) using AWS S3 Interested candidates can share their CV at urmi.veera@cygnusad.co.in or call on 85910 61941

Posted 3 months ago

Apply

Exploring Data Engineer Jobs in India

The data engineer job market in India is rapidly growing as organizations across various industries are increasingly relying on data-driven insights to make informed decisions. Data engineers play a crucial role in designing, building, and maintaining data pipelines to ensure that data is accessible, reliable, and secure for analysis.

Top Hiring Locations in India

  1. Bangalore
  2. Mumbai
  3. Delhi/NCR
  4. Hyderabad
  5. Pune

Average Salary Range

The average salary range for data engineer professionals in India varies based on experience and location. Entry-level data engineers can expect to earn anywhere between INR 4-6 lakhs per annum, while experienced professionals with 5+ years of experience can earn upwards of INR 15 lakhs per annum.

Career Path

The typical career progression for a data engineer in India may include roles such as Junior Data Engineer, Data Engineer, Senior Data Engineer, Lead Data Engineer, and eventually Chief Data Engineer. As professionals gain more experience and expertise in handling complex data infrastructure, they may move into management roles such as Data Engineering Manager.

Related Skills

In addition to strong technical skills in data engineering, professionals in this field are often expected to have knowledge of programming languages such as Python, SQL, and Java. Familiarity with cloud platforms like AWS, GCP, or Azure, as well as proficiency in data warehousing technologies, is also beneficial for data engineers.

Interview Questions

  • What is the difference between ETL and ELT? (medium)
  • Explain the CAP theorem and its implications in distributed systems. (advanced)
  • How would you optimize a data pipeline for performance and scalability? (medium)
  • What is your experience with data modeling and schema design? (basic)
  • Describe a time when you had to troubleshoot a data pipeline failure. (medium)
  • How do you ensure data quality and consistency in a data pipeline? (basic)
  • Can you explain the concept of data partitioning in distributed databases? (medium)
  • What are the benefits of using columnar storage for analytical workloads? (medium)
  • How would you handle data security and privacy concerns in a data engineering project? (medium)
  • What tools and technologies have you worked with for data processing and transformation? (basic)
  • Explain the difference between batch processing and stream processing. (basic)
  • How do you stay updated with the latest trends in data engineering and technology? (basic)
  • Describe a challenging data engineering project you worked on and how you overcame obstacles. (medium)
  • What is your experience with data orchestration tools like Apache Airflow or Apache NiFi? (medium)
  • How would you design a data pipeline for real-time analytics? (advanced)
  • What is your approach to optimizing data storage and retrieval for cost efficiency? (medium)
  • Can you explain the concept of data lineage and its importance in data governance? (medium)
  • How do you handle schema evolution in a data warehouse environment? (medium)
  • Describe a time when you had to collaborate with cross-functional teams on a data project. (basic)
  • What are some common challenges you have faced in data engineering projects, and how did you address them? (medium)
  • How would you troubleshoot a slow-performing SQL query in a data warehouse? (medium)
  • What are your thoughts on the future of data engineering and its impact on business operations? (basic)
  • Explain the process of data ingestion and its role in data pipelines. (basic)
  • How do you ensure data integrity and consistency across distributed systems? (medium)
  • Describe a data migration project you worked on and the challenges you encountered. (medium)

Closing Remark

As you explore data engineer jobs in India, remember to showcase your technical skills, problem-solving abilities, and experience in handling large-scale data projects during interviews. Stay updated with the latest trends in data engineering and continuously upskill to stand out in this competitive job market. Prepare thoroughly, apply confidently, and seize the opportunities that come your way!

cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Featured Companies