1569 Data Pipeline Jobs - Page 3

Salary: 35 to 50 LPA Exp: 7 to 12 years Location: Gurgaon/Pune/Bengalore Notice: Immediate to 30 days..!! Job Profile: Experienced Data Engineer with a strong foundation in designing, building, and maintaining scalable data pipelines and architectures. Skilled in transforming raw data into clean, structured formats for analytics and business intelligence. Proficient in modern data tools and technologies such as SQL, T-SQL, Python, Databricks, and cloud platforms (Azure). Adept at data wrangling, modeling, ETL/ELT development, and ensuring data quality, integrity, and security. Collaborative team player with a track record of enabling data-driven decision-making across business units. As a Da...

Role Overview: As part of Tata Communications MSS Engineering Team, the SOAR Engineer plays a critical role in SOAR workflows to improve incident response efficiency and reduce mean time to detect/respond (MTTD/MTTR). The role involves designing, developing and maintaining SOAR Playbooks, integrating security tools and collaborating with SOC and TH to streamline operations and enhance threat response capabilities. key Responsibilities: * Design and implement automated workflows for incident response, TI enrichment and alert triage. * integrate SOAR platform with various security tools (SIEM, EDR, TI Feeds, Ticketing System, etc..) * collaborate with TH and SOC Teams to identify automation op...

MSCI Inc. is looking for Data Engineer to join our team Roles and Responsibility Design, develop, and implement data pipelines and architectures. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain large-scale data systems and databases. Ensure data quality, integrity, and security. Optimize data processing and analysis workflows. Stay updated with industry trends and emerging technologies. Job Requirements Strong understanding of data structures, algorithms, and software design patterns. Experience with big data technologies such as Hadoop, Spark, and NoSQL databases. Proficiency in programming languages like Java, Python, or Scala. ...

NestlNespresso SA is looking for Data Engineering Tech Lead to join our team Roles and Responsibility Design, develop, and implement large-scale data pipelines and architectures. Lead cross-functional teams to deliver high-quality data engineering projects. Collaborate with stakeholders to identify business requirements and develop solutions. Develop and maintain technical documentation for data engineering projects. Ensure compliance with industry standards and best practices. Mentor junior engineers to improve their skills and knowledge. Job Requirements Strong understanding of data engineering principles and technologies. Experience with big data processing frameworks such as Hadoop or Sp...

Blis is looking for Senior Data Engineer to join our team Roles and Responsibility Design, develop, and implement data pipelines and architectures to support business intelligence and analytics. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain large-scale data systems, ensuring scalability, reliability, and performance. Work closely with stakeholders to understand business needs and provide technical solutions. Ensure data quality, integrity, and security by implementing appropriate measures. Stay up-to-date with industry trends and emerging technologies in data engineering. Job Requirements Strong understanding of data modeling, d...

, People Leaders are expected to demonstrate a clear set of leadership behaviours to create an environment for colleagues to thrive and deliver to a consistently excellent standard The four LEAD behaviours are L Listen and be authentic, E Energise and inspire, A Align across the enterprise, D Develop others OR for an individual contributor, they develop technical expertise in work area, acting as an advisor where appropriate Will have an impact on the work of related teams within the area Partner with other functions and business areas Takes responsibility for end results of a teams operational processing and activities Escalate breaches of policies / procedure appropriately Take responsibil...

Role Overview: We are seeking a Senior Data Engineer with strong developer DNA — someone who codes daily in PySpark, SQL, and Python , builds end-to-end data solutions , and leads design of robust, production-grade data platforms on Microsoft Fabric , Azure Databricks , and ADF . This is a hands-on leadership role for engineers who can think architecturally and code efficiently. Key Responsibilities: Design, develop, and optimize complex data pipelines and lakehouse architectures . Lead development of batch and streaming ingestion frameworks using ADF , Databricks , and Event Hubs . Write optimized PySpark/SQL transformations for performance, scalability, and cost efficiency. Build reusable ...

Role Overview: We are seeking a Senior Data Engineer with strong developer DNA — someone who codes daily in PySpark, SQL, and Python , builds end-to-end data solutions , and leads design of robust, production-grade data platforms on Microsoft Fabric , Azure Databricks , and ADF . This is a hands-on leadership role for engineers who can think architecturally and code efficiently. Key Responsibilities: Design, develop, and optimize complex data pipelines and lakehouse architectures . Lead development of batch and streaming ingestion frameworks using ADF , Databricks , and Event Hubs . Write optimized PySpark/SQL transformations for performance, scalability, and cost efficiency. Build reusable ...

We are seeking an experienced Lead Engineer with strong expertise in Spark, Scala, GCP, Python/PySpark, Shell Scripting and SQL to build and optimize large-scale data solutions in a cloud environment. • 8+ years of experience in Big Data and Data Engineering. • Strong hands-on expertise in Apache Spark (batch & streaming). • Proficiency in Scala, Python/PySpark, and Shell scripting. • Solid experience with GCP services (BigQuery, Dataproc, Airflow, etc.). • Advanced knowledge of Spark-SQL and SQL. • Understanding of distributed systems and performance optimization. Roles and Responsibilities • Design and develop scalable data pipelines using Apache Spark and PySpark. • Implement data process...

Join our data engineering team to build scalable data pipelines and infrastructure We're looking for experienced professionals with expertise in distributed systems, cloud platforms, and big data technologies You'll work with cutting-edge tools to process and analyze massive datasets, collaborate with cross-functional teams, and help drive our data strategy forward Experience with Angular 6+ (preferred) as the product is being built with Angular If you know any other framework such as ReactJS, VueJS open to learn/switch to others when needed Benefits include performance-based bonus and stock options

Location : Pune, Onsite(WFO) Department : Engineering / Data & AI Experience : 2-3 years in ML & Gen AI Job Summary We are seeking an Associate Machine Learning Engineer of exposure and experience in developing AI solutions, including Generative AI, classical ML models, and data engineering pipelines. You will play a hands-on role in building and deploying scalable ML and GenAI applications. Key Responsibilities - Generative AI Development - Design and implement applications using large language models (LLMs). - Optimize prompts using techniques such as Chain of Thought, Few-Shot Learning, and RAG. - Build scalable APIs and pipelines for GenAI -powered features. Machine Learning Engineering ...

Job Title:- Senior Data Engineer Location Gurugram | Hyderabad | Noida | Pune Designation Lead | Manager – Data Engineering Job Requirement: 8+ years of experience in data management. Proven hands-on experience with ETL processes Candidate must have extensive hands-on experience with Pyspark/Python and a strong background in ETL jobs / processes. Strong expertise in data governance, data catalog, data quality frameworks, business rules implementation, data profiling, data ingestion, data processing and data integration. Prior experience in the Life Sciences industry is a plus. Strong understanding of data governance principles and best practices. Experience with data profiling, data quality ...

Senior Data Engineer Experience Range: 05 - 10 years Location: Bengaluru, India Responsibilities and Duties of the Role: Build components of large-scale data platform for real-time and batch processing, and own features of big data applications to fit evolving business needs Build next-gen cloud based big data infrastructure for batch and streaming data applications, and continuously improve performance, scalability and availability Contribute to the best engineering practices, including the use of design patterns, CI/CD, code review and automated test Chip in ground-breaking innovation and apply the state-of-the-art technologies As a key member of the team, contribute to all aspects of the ...

SUMMARY W issen Technology is Hiring for Data Engineer About Wissen Technology: At Wissen Technology, we deliver niche, custom-built products that solve complex business challenges across industries worldwide. Founded in 2015, our core philosophy is built around a strong product engineering mindset ensuring every solution is architected and delivered right the first time. Today, Wissen Technology has a global footprint with 2000+ employees across offices in the US, UK, UAE, India, and Australia . Our commitment to excellence translates into delivering 2X impact compared to traditional service providers. How do we achieve this? Through a combination of deep domain knowledge, cutting-edge tech...

Sr Data Engineer Bangalore/Chennai/Hyderabad/Coimbatore 5+Yrs Skills: SQL Advanced, SQL Joints, Python,Pyspark,AWS,Data Pipeline

Sr Data Engineer Bangalore/Chennai/Hyderabad/Coimbatore 5+Yrs Skills: SQL Advanced, SQL Joints, Python,Pyspark,AWS,Data Pipeline

Sr Data Engineer Bangalore/Chennai/Hyderabad/Coimbatore 5+Yrs Skills: SQL Advanced, SQL Joints, Python,Pyspark,AWS,Data Pipeline

Immediate hiring for Senior Data Engineer Loc-Bangalore/Chennai/Hyderabad Exp- 5 to 10yrs Hybrid 4+yrs exp in SQL 4+yrs exp in Python and Pyspark( Should be strong in Coding) Exp in data pipelines and AWS Immediate joiners only

Sr Data Engineer Bangalore/Chennai/Hyderabad/Coimbatore 5+Yrs Skills: SQL Advanced, SQL Joints, Python,Pyspark,AWS,Data Pipeline

Immediate hiring for Senior Data Engineer Loc-Bangalore/Chennai/Hyderabad Exp- 5 to 10yrs Hybrid 4+yrs exp in SQL 4+yrs exp in Python and Pyspark( Should be strong in Coding) Exp in data pipelines and AWS Immediate joiners only

Sr Data Engineer Bangalore/Chennai/Hyderabad/Coimbatore 5+Yrs Skills: SQL Advanced, SQL Joints, Python,Pyspark,AWS,Data Pipeline

Immediate hiring for Senior Data Engineer Loc-Bangalore/Chennai/Hyderabad Exp- 5 to 10yrs Hybrid 4+yrs exp in SQL 4+yrs exp in Python and Pyspark( Should be strong in Coding) Exp in data pipelines and AWS Immediate joiners only

Sr Data Engineer Bangalore/Chennai/Hyderabad/Coimbatore 5+Yrs Skills: SQL Advanced, SQL Joints, Python,Pyspark,AWS,Data Pipeline

Sr Data Engineer Bangalore/Chennai/Hyderabad/Coimbatore 5+Yrs Skills: SQL Advanced, SQL Joints, Python,Pyspark,AWS,Data Pipeline

Immediate hiring for Senior Data Engineer Loc-Bangalore/Chennai/Hyderabad Exp- 5 to 10yrs Hybrid 4+yrs exp in SQL 4+yrs exp in Python and Pyspark( Should be strong in Coding) Exp in data pipelines and AWS Immediate joiners only