14177 Data Engineering Jobs - Page 35

Skill: Hadoop-hive, Pyspark, SQL and Unix 4.5 to 5.5 years experience as Data Engineering side using Big Data, Postgres, Spark skillsAbility to work as an independent developer Good in understand the tables structures and ability to write Complex SQL queries Good understanding on the DHW concepts and Basic knowledge on Unix/Shellscript Good in Written and communication skills Design end-to-end Data pipeline and optimize Data ingestion Pipelines and manage data flow to the upstream for consumption

Objective: Build and maintain data pipelines and infrastructure to support data storage and processing. Key Responsibilities : - Design, develop, and optimize data pipelines using Azure Databricks. - Ensure data reliability, scalability, and quality. - Integrate data sources into a unified platform. - Monitor and troubleshoot data workflows. Skills Required : - Expertise in Azure Databricks, Spark, and big data tools. - Strong programming skills (e.g., Python, Scala, SQL). - Knowledge of ETL processes and cloud technologies. - Familiarity with CI/CD practices for data pipelines. - -Developer / Software Engineer - Four to Six Years,Azure Databricks - Four to Six Years-PSP Defined SCU in Data ...

Education : Bachelors degree in Computer Science, Engineering, or a related field A Masters degree is preferred Experience: Minimum of 4+ years of experience in data engineering or a similar role Strong programming skills in Python programming and advance SQL strong experience in NumPy, Pnadas, Data frames Strong analytical and problem-solving skills Excellent communication and collaboration abilities

Skill- Snowflake Developer with Data Build Tool with ADF with Python Job Descripion: We are looking for a Data Engineer with experience in data warehouse projects, strong expertise in Snowflake , and hands-on knowledge of Azure Data Factory (ADF) and dbt (Data Build Tool). Proficiency in Python scripting will be an added advantage. Key Responsibilities: Design, develop, and optimize data pipelines and ETL processes for data warehousing projects. Work extensively with Snowflake, ensuring efficient data modeling, and query optimization. Develop and manage data workflows using Azure Data Factory (ADF) for seamless data integration. Implement data transformations, testing, and documentation usin...

AI Lead to design, build, and deploy AI-driven healthcare solutions using Generative AI, NLP, LLMs, and RAG. Lead AI architecture, model development, system integrations, and scalable deployment for Sarayu Wellness’ maternal health platform. Required Candidate profile Hands-on AI Lead with a startup mindset, strong in Python, Generative AI, NLP, LLMs, and RAG. Owns end-to-end AI systems, works fast with lean teams, and builds scalable products from scratch.

Salary: 15 to 25 LPA Exp: 4 to 7 years Location: Gurgaon/Pune/Bengalore Notice: Immediate to 30 days..!! Job Profile: Experienced Data Engineer with a strong foundation in designing, building, and maintaining scalable data pipelines and architectures. Skilled in transforming raw data into clean, structured formats for analytics and business intelligence. Proficient in modern data tools and technologies such as SQL, T-SQL, Python, Databricks, and cloud platforms (Azure). Adept at data wrangling, modeling, ETL/ELT development, and ensuring data quality, integrity, and security. Collaborative team player with a track record of enabling data-driven decision-making across business units. As a Dat...

Salary: 35 to 50 LPA Exp: 7 to 12 years Location: Gurgaon/Pune/Bengalore Notice: Immediate to 30 days..!! Job Profile: Experienced Data Engineer with a strong foundation in designing, building, and maintaining scalable data pipelines and architectures. Skilled in transforming raw data into clean, structured formats for analytics and business intelligence. Proficient in modern data tools and technologies such as SQL, T-SQL, Python, Databricks, and cloud platforms (Azure). Adept at data wrangling, modeling, ETL/ELT development, and ensuring data quality, integrity, and security. Collaborative team player with a track record of enabling data-driven decision-making across business units. As a Da...

Salary: 15 to 30 LPA Exp: 3 to 8 years Location : Gurgaon/Bangalore/Pune/Chennai Notice: Immediate to 30 days..!! Key Responsibilities & Skillsets: Common Skillsets : 3+ years of experience in analytics, Pyspark, Python, Spark, SQL and associated data engineering jobs. Must have experience with managing and transforming big data sets using pyspark, spark-scala, Numpy pandas Excellent communication & presentation skills Experience in managing Python codes and collaborating with customer on model evolution Good knowledge of data base management and Hadoop/Spark, SQL, HIVE, Python (expertise). Superior analytical and problem solving skills Should be able to work on a problem independently and p...

Senior Data Engineer AWS Snowflake | PySpark AWS | Face to Face | 20th Dec | Hyd Role: Data Engineer Experience: 6+ Years Interview Mode: Face-to-Face (F2F) Interview Date: 20th December (Saturday) Work Location: Hyderabad Employment Type: FTE- Hybrid Notice Period: 020 Days (Immediate to Short Joiners Preferred) Job Description: We are hiring an experienced Data Engineer with strong expertise in AWS, Snowflake, and PySpark for a Face-to-Face interview drive on Saturday, 20th December in Hyderabad . This is a Full-Time (FTE) hybrid role for professionals available to join within 0–20 days . Key Responsibilities: Design, develop, and optimize scalable data pipelines using PySpark Build and ma...

Job Description & Summary: A career within Data and Analytics services will provide you with the opportunity to help organisations uncover enterprise insights and drive business results using smarter data analytics. We focus on a collection of organisational technology capabilities, including business intelligence, data management, and data assurance that help our clients drive innovation, growth, and change within their organisations to keep up with the changing nature of customers and technology. We make impactful decisions by mixing mind and machine to leverage data, understand and navigate risk, and help our clients gain a competitive edge. Job Position Title: Data Architect Responsibili...

Designation: Data Engineer-Python Location: Pune Experience: 3 to 4 years Technologies / Skills Mandatory: Strong hands-on experience with Python (Pandas, NumPy) and SQL. Experience in ETL/ELT pipeline development, data modeling, and working with large-scale data systems. Familiarity with CI/CD workflows, Git, and version control practices. Responsibilities Collaborate with business stakeholders and technical teams to gather requirements and translate them into scalable data solutions. Design, build, and maintain robust, secure, high-performance data pipelines. Ensure adherence to data quality, governance, and compliance standards. Work with architects and engineering leads to follow best pr...

Role Overview We are looking for an experienced Lead Engineer (8 - 10 Years) with strong expertise in Python, AWS Cloud, Generative AI, and hands-on experience in RAG (Retrieval Augmented Generation), Agentic workflows, and building LLM-powered applications. The ideal candidate will lead design, architecture, and development of scalable AI solutions, mentor the team, and collaborate closely with product and architecture teams. Key Responsibilities 1. Architecture, Design & Technical Leadership a. Lead end-to-end design and development of GenAI-powered applications. b. Ability to understand and translate customer requirement into scalable AI architectures and meaningful design leveraging clou...

We are looking for Senior Lead Data Engineer , you will architect the highly scalable, cloud-native data platforms that power our Real-World Data (RWD) and DRG (Decision Resources Group) analytics solutionscritical tools that help researchers, clinicians, scientists, and business leaders make faster, more confident decisions. Youll help build the data engine behind products used to accelerate drug discovery, evaluate treatment effectiveness, model patient journeys, and bring life-saving innovations to market. This is an opportunity to build data systems that not only drive next-generation AI but also create measurable impact in healthcare and life sciences globally. If youre passionate about...

Responsible for developing and delivering training programs that educate employees on leveraging Artificial Intelligence tools and models to improve business processes, enhance productivity, and drive innovation, ensuring alignment with company objectives and ethical guidelines. Key Responsibilities: Training Program Design: Create comprehensive training materials (modules, simulations, guides) for various AI tools (chatbots, generative AI, analytics). Data Curation & Annotation: Work with data scientists to prepare, clean, label, and organize datasets for model training and fine-tuning. Model Performance Monitoring: Test, evaluate, and provide feedback on AI outputs to correct biases, impro...

Live | What you will do Build, test, and maintain reusable components for ML pipelines and data science use cases in collaboration with senior engineers and data scientists. Develop model tracking, versioning, and deployment workflows using MLflow and Databricks . Support data scientists across teams with infrastructure needs, connector usage, and dataset preparation. Help prototype and deploy internal tools (e.g., Streamlit apps) to visualize model results or enable user interactions. Follow engineering best practices around version control, documentation, and testing in shared repositories. Collaborate with enterprise engineering and data platform teams to ensure compliance with cloud arch...

Minimum 4 years' experience in GCP Data Engineering. Strong data engineering experience using Java or Python programming languages or Spark on Google Cloud. Should have worked on handling big data. Strong communication skills. experience in Agile methodologies ETL, ELT skills, Data movement skills, Data processing skills. Certification on Professional Google Cloud Data engineer will be an added advantage. Proven analytical skills and Problem-solving attitude Ability to effectively function in a cross-teams environment GCP, data engineering Java/ Python/ Spark on GCP, Programming experience in any one language - either Python or Java or PySpark GCS(Cloud Storage), Composer (Airflow) and BigQu...

Role Description: We are seeking a Data Solutions Architect to design, implement, and optimize scalable and high-performance data solutions that support enterprise analytics, AI-driven insights, and digital transformation initiatives. This role will focus on data strategy, architecture, governance, security, and operational efficiency, ensuring seamless data integration across modern cloud platforms. The ideal candidate will work closely with engineering teams, business stakeholders, and leadership to establish a future-ready data ecosystem, balancing performance, cost-efficiency, security, and usability. This position requires expertise in modern cloud-based data architectures, data enginee...

In this senior technical role for ACV Retail, you will architect and deliver robust data pipelines, warehouses, and lakes that enable advanced analytics, machine learning, and business intelligence at scale. You will set technical direction, mentor engineering teams, and ensure best practices for performance, security, and cost-effectiveness in our cloud-based data ecosystem. You will collaborate with cross-functional teams to deliver high-quality, robust, and scalable solutions that empower our customers to manage and analyze their data effectively. You will have deep expertise in designing, building, and optimizing modern, scalable data platforms on AWS, MS SQL Server and MongoDB. You will...

About LeadSquared: LeadSquared is a fast-growing, global SaaS platform powering sales execution and marketing automation for high-velocity businesses. With customers across EdTech, Financial Services, Healthcare, and more, our platform processes billions of customer interactions and transactions each month. We are on a mission to make every sales process intelligent, automated, and outcome-driven and data & AI are central to that mission. Role Overview: We are looking for a strategic and hands-on Senior Director/AVP – Data & AI to lead the vision, design, and execution of LeadSquared’s data platform and AI roadmap. This leader will be responsible for building scalable infrastructure, driving...

The Role Keyrus is seeking a Senior Data Engineer & Data Scientist to design, build, and optimise cloud-native data platforms in Azure You will work across modern data architectures, build scalable data solutions, and collaborate with multidisciplinary teams to drive data excellence and platform innovation Location: Hybrid Pune, India (3 days onsite) Target Start: 26 Compensation: 30,00,000 42,00,000 INR Responsibilities Data Engineering Design, build, and optimise cloud-native ingestion, transformation, and enrichment pipelines using Azure (ADF, Databricks, Synapse) Implement data joins, validation frameworks, profiling, and quality checks to ensure analytics-ready datasets Engineer scalabl...

DATA ENGINEER We are looking for a Data Engineer to be part of our Nestl Nespresso Digital and Tech Team At Nespresso, our Digital & Tech teams are at the heart of our innovation journey, a space where we continue to invest, evolve, and grow Position Snapshot: Location: Bengaluru, Karnataka, India Type of Contract: Permanent Grade: Band 2 Type of work: Hybrid Work Language: Fluent Business English The Role: As a Data Engineer, you will play a pivotal role in designing, building, and maintaining highly scalable data management systems that enable Nespressos data-driven decision-making You will integrate diverse data sources into a unified platform, ensuring data accessibility, reliability, an...

Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : Oracle Procedural Language Extensions to SQL (PLSQL) Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :Seeking a forward-thinking professional with an AI-first mindset to design, develop, and deploy enterprise-grade solutions using Generative and Agentic AI fram...

Project Role : Custom Software Engineer Project Role Description : Develop custom software solutions to design, code, and enhance components across systems or applications. Use modern frameworks and agile practices to deliver scalable, high-performing solutions tailored to specific business needs. Must have skills : AWS Redshift Good to have skills : Data Engineering Minimum 2 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will design, build, and configure applications to meet business process and application requirements. A typical day involves collaborating with team members to understand project needs, d...

Role & responsibilities • A minimum of 5 years of experience in data architecture or a related field. • Work experience as a data architect or in a related field. • Practical AWS (primarily) or other public cloud data engineering experience (Azure, GCP). • Exposure to Data Vault principles. • Application of data governance (data lineage, data quality, cataloguing, etc). • Practical Knowledge of Snowflake(primarily), BigQuery, CosmosDB, databricks, Redshift. • Knowledge of ELT/ETL and data streaming engineering with relevant technologies (i.e. Kafka, dbt). • Evidential experience of data analysis and data modelling. • Extensive practical SQL experience. • Strong knowledge of datawarehouse str...

Project Role : Custom Software Engineer Project Role Description : Utilize modular architectures, next-generation integration techniques and a cloud-first, mobile-first mindset to provide vision to Application Development Teams. Work with an Agile mindset to create value across projects of multiple scopes and scale. Must have skills : Data Engineering Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Custom Software Engineer, you will utilize modular architectures and next-generation integration techniques to provide vision to Application Development Teams. Your typical day will involve collaborating wi...