10148 Data Engineering Jobs - Page 26

Primary Responsibilities: Design, develop, and deploy scalable AI/ML models to solve complex business challenges Lead end-to-end ML workflows, including data preprocessing, model training, hyperparameter tuning, and deployment Apply classical machine learning techniques (e.g., boosting, ensemble methods) and modern deep learning frameworks (e.g., PyTorch, TensorFlow) to deliver innovative solutions Work with large datasets using tools such as PySpark, Databricks, Pandas, and Numpy to enable data-driven decision-making Develop and fine-tune Generative AI and large language models (LLMs) using tools like Hugging Face, LangChain, and similar frameworks Collaborate with cross-functional teams to...

Key Responsibilities: The ideal candidate will have strong expertise in Snowflake, Hadoop ecosystem, PySpark, and SQL, and will play a key role in enabling data-driven decision-making across the organization. Design, develop, and optimize robust data pipelines using PySpark and SQL. • Implement and manage data warehousing solutions using Snowflake. Work with large-scale data processing frameworks within the Hadoop ecosystem. Collaborate with data scientists, analysts, and business stakeholders to understand data requirements. Ensure data quality, integrity, and governance across all data platforms. Monitor and troubleshoot data pipeline performance and reliability. Automate data workflows an...

Job Description Summary Cushman & Wakefield is seeking a motivated Azure Data Engineer to join the Data Engineering & Analytics team. In this early-career role, you will support the design, development, and optimization of data pipelines on Azure to drive key business initiatives. Working under the guidance of senior engineers and architects, youll gain hands-on experience with modern data tools while contributing to high-impact, enterprise-scale projects. This is an excellent opportunity for professionals eager to grow their skills in a collaborative, client-centric environment that values innovation and data-driven decision-making. Job Description About The Role: Design, develop, and manag...

Role: Developer 3/ DevOps Engineer Location: Kolkata & Hyderabad Notice Period: 0-60 days Currently, we are looking for DevOps Engineer to join our team. Preferred Qualifications: Bachelor's degree or equivalent experience Relevant experience must be 5+ years Experience with data structures algorithms and software design Experience with AWS and SaaS Experience with continuous software delivery Significant experience with one or more general purpose programming languages including but not limited to: Java C/C++ C# Objective C Python or JavaScript. Experience working in Windows/Linux development environment working with open source tools/platforms Demonstrated experience with build environment...

What you will do In this vital role We are looking for a creative and technically skilled Sr Software Engineer to help design and build cutting-edge AI-powered solutions for the pharmaceutical industry. In this role, you'll develop intelligent systems that surface the most relevant insights from clinical trials, scientific literature, regulatory documents, and internal knowledge assets. Your work will empower researchers, clinicians, and decision-makers with faster, smarter access to the right information. . Design and implement search algorithms using NLP, machine learning, semantic understanding, and deep learning models Build and fine-tune models for information retrieval, query expansion...

Job Title : Azure Data Engineer Location: Bengaluru Mode :Face 2 Face Experience Range : 5 to 10 years Date- 08 Nov 25 (Saturday) Please apply only if you can attend In Person drive at TCS Office on 08 Nov 25 (Saturday). If interested, Method to confirm: Share your updated CV with the below-required details at the earliest to Pavithra.gopal@tcs.com. After validation will share invite. Subject line as: TCS - Bengaluru - 8th Nov 2025-Confirmation to attend Walkin Name: PAN ID: Email: Skill: Contact: Total Years of exp: Current CTC: Expected CTC: Current Company: Preferred Location: Notice Period: Highest qualification which is full time: Any gaps/breaks in career/Education: If any, please ment...

Job Title : GCP Data Engineer Location: Bengaluru Mode :Face 2 Face Experience Range : 5 to 10 years Date- 08 Nov 25 (Saturday) Please apply only if you can attend In Person drive at TCS Office on 08 Nov 25 (Saturday). If interested, Method to confirm: Share your updated CV with the below-required details at the earliest to Pavithra.gopal@tcs.com. After validation will share invite. Subject line as: TCS - Bengaluru - 8th Nov 2025-Confirmation to attend Walkin Name: PAN ID: Email: Skill: Contact: Total Years of exp: Current CTC: Expected CTC: Current Company: Preferred Location: Notice Period: Highest qualification which is full time: Any gaps/breaks in career/Education: If any, please mentio...

This Position reports to: R&D Team Lead Your role and responsibilities In this role, you will have the opportunity to contribute to ABBs success with technology, software, product, and system development. Each day, you will identify and implement innovative solutions to relevant problems. You will also showcase your expertise by providing ideas and by being able to work both independently and as a part of a Research & Development (R&D) team. The work model for the role is: #LI-Onsite This role is contributing to the Robotics and Discrete Automation business BA Function Technology division in Bangalore, India. You will be mainly accountable for: Will be the technical SPOC/Architect for Data I...

Summary: As a Data Engineer & AI Developer, you will play a key role in transforming complex data into clear, actionable insights. You will be responsible for building robust data pipelines, developing interactive dashboards, and integrating cutting-edge AI techniques to enhance our data processes and insights. This is a unique opportunity to blend expertise in data engineering and visualization with a forward-thinking approach to artificial intelligence. Key Responsibilities: ETL/ELT Development: Design, build, and optimize scalable data pipelines using ETL/ELT processes to ingest, clean, and transform large datasets from various sources. AI-Powered Data Engineering: Implement and manage AI...

Caterpillar Returnship is a 24-week company paid , office -based program designed to enable a soft launch for experienced professionals on a career break. This initiative includes, networking sessions, coaching, trainings and a project / work scope assignment. Eligibility to apply Career break of minimum 6 months. What You Will Do: Job Duties/Responsibilities may include but are not limited to: 1. Ability to create Data pipelines using Snaplogic in implementing complex pipelines along with performance tuning. 2. Follow support processes, with focus on ITSM incident management to resolve P1/P2/P3/P4 tickets and actively communicating business partners on issues, impact, and resolutions on con...

Data Science professional with a proven track record in training Engineering, IT, Diploma, Polytechnic and Technical candidates. With over a 7 yrs of experience in Artificial Intelligence, Machine Learning, Big Data, and Cloud Computing, Specialise in delivering industry-oriented, hands-on training that equips candidates with the technical proficiency required in today's data-driven world.

About ProcDNA ProcDNA is a global consulting firm. We fuse design thinking with cutting-edge tech to create game-changing Commercial Analytics and Technology solutions for our clients. We're a passionate team of 220+ across 7 offices, all growing and learning together since our launch during the pandemic. Here, you won't be stuck in a cubicle - you'll be out in the open water, shaping the future with brilliant minds. At ProcDNA, innovation isn't just encouraged, it's ingrained in our DNA . What are we looking for You'll build and maintain systems for efficient data collection, storage, and processing to ensure data pipelines are robust and scalable for seamless integration and analysis. We a...

Job Summary We are seeking a skilled Cloud Data Architect(IS Specialist) to join our India CoE-Integration & Engg -CAT IT Division We are seeking a visionary Data Architect to lead the design and governance of data architecture specializing in Snowflake architecture, cloud migrations, data engineering and analytics. The incumbent would have proven expertise in designing scalable data architectures, implementing high-performance ETL/ELT pipelines and optimizing cloud data solutions for actionable business insights. Adept at leading cross-functional teams, ensuring data governance, and driving cost-efficient, secure, and compliant environments. Recognized for delivering innovative solutions th...

Qualifications - External To be successful in this role, you should meet the following requirements: 8+ years of hands-on exposure to GCP, Bigquery, Cloud SQL, Dataflow, Cloud Functions, & Pub-sub and DBT Hands-on exposure to SQL. Excellent understanding of Python programming Thorough knowledge of Data Engineering/Transformations, GCP DevOps & CI/CD Pipelines. Should have strong application development experience, coding complex Business Logic. Having Experience of working in a Data Warehouse and Regulatory Reporting project is preferred. Working experience in Banking and Financial Domain. Understanding of Finance technologies with exposure to Basel III is an added advantage.

As a Senior Cloud Data Platform (GCP) Engineer at Incedo, you will be responsible for managing and optimizing the Google Cloud Platform environment, ensuring its performance, scalability, and security You will work closely with data analysts and data scientists to develop data pipelines and run data science experiments You will be skilled in cloud computing platforms such as AWS or Azure and have experience with big data technologies such as Hadoop or Spark You will be responsible for configuring and optimizing the GCP environment, ensuring that data pipelines are efficient and accurate, and troubleshooting any issues that arise You will also work with the security team to ensure that the GC...

Job Description: Primary Skills Data engineer + AI/ML +LLM + Azure devops +Blob Minimum experience: • Minimum of 4 years of experience in data management, analysis, and AI data preparation. Must have hands-on: • Build scalable data pipelines and feature stores for AI/ML use cases • Develop CI/CD pipelines for training, deployment, and monitoring of data and ML models • Manage real-time inference pipelines for GenAI / LLM-based applications • Automate retraining, versioning, and drift monitoring processes • Collaborate with data scientists and AI engineers to productionize models • Ensure data quality, lineage, and model governance across all systems • Maintain infrastructure-as-code using Az...

Job Description: 5+ years of overall IT experience, which includes hands on experience in Big Data technologies. Mandatory - Hands on experience in Python and PySpark. Build pySpark applications using Spark Dataframes in Python . Worked on optimizing spark jobs that processes huge volumes of data. Hands on experience in version control tools like Git . Worked on Amazons Analytics services like Amazon EMR, Amazon Athena, AWS Glue. Worked on Amazons Compute services like Amazon Lambda, Amazon EC2 and Amazon Storage service like S3 and few other services like SNS. Good to have knowledge of data warehousing concepts dimensions, facts, schemas-snowflake, star etc. Have worked with columnar storag...

3+ years of ETL and data pipeline development (Azure Data Factory, Dell Boomi, Databricks) Data engineering programming languages (SQL, Scala) Databases and database objects (SQL Server, SQL DDL) Understanding of connectors and data sources (e.g., flat files, web APIs, SFTP, databases) Source control (Git) Familiarity with cloud frameworks and solutions (Azure Storage, Azure SQL, PaaS) Familiarity with providing data to BI visualization tools (Power BI) Generalist, who can get up-to-speed quickly with new technologies through self-paced learning and online research Analytical thinker with excellent critical thinking and problem-solving skills as well as the ability to adapt to changing prior...

Role & responsibilities AWS data engineer Candidate should have good experience in coding Hand of experience on AWS, pyspark, redshift Lambda, Athena Good communication

Job Description: 5+ years of overall IT experience, which includes hands on experience in Big Data technologies. Mandatory - Hands on experience in Python and PySpark. Build pySpark applications using Spark Dataframes in Python . Worked on optimizing spark jobs that processes huge volumes of data. Hands on experience in version control tools like Git . Worked on Amazons Analytics services like Amazon EMR, Amazon Athena, AWS Glue. Worked on Amazons Compute services like Amazon Lambda, Amazon EC2 and Amazon Storage service like S3 and few other services like SNS. Good to have knowledge of data warehousing concepts dimensions, facts, schemas-snowflake, star etc. Have worked with columnar storag...

8+ years of relevant IT experience in the BI/DW domain with hands-on experience on the Azure modern data platform . Strong knowledge and experience with the Python programming language Experience using version control systems like Git, bitbucket . Experience in data analysis and transformation using PySpark on Azure Databricks or Apache Spark . Good knowledge of Distributed Processing using Databricks or Apache Spark. Experience in creating data structures optimized for storage and various query patterns. Experience of integrating Unity Data Catalog with the Databricks and registering data assets etc. Understanding of CI/CD pipelines. Knowledge of Agile/Scrum methodologies.

Job Title : Senior Azure Data Engineer Location : Hyderabad, TA/ Bangalore, KA/ Noida, UP Skills Required: Digital : Databricks, Azure Data Factory Experience Range in Required Skills: 10 & Above Years (Relevant should be 8 + yrs.) Job Description: Deep Microsoft Azure product knowledge and understanding of product features. Proven track record in designing, developing and implementing data modelling, at a conceptual, logical and physical level. Experience with accountability for E2E Data Architecture and Lifecycle (including non-functional requirements and operations) management. Understands industry recognised data modelling patterns and standards Understands overall IT system design, in p...

Job Description: We are seeking an experienced and hands-on Data Engineer with strong expertise in AWS and Databricks to join our growing data engineering team. The ideal candidate will be passionate about building scalable data pipelines and delivering high-quality data solutions. Responsibilities: Design, develop, and maintain scalable data pipelines and ETL processes using Databricks and AWS services Hands-on development using Python , Scala , and SQL Orchestrate workflows and manage job scheduling Optimize and monitor Databricks jobs for performance and reliability Work with large-scale datasets and implement best practices for data ingestion and processing Collaborate with cross-functio...

Ro We are seeking a highly experienced Data Engineer with over 10+ years of expertise in Data Engineering, Databricks, Azure, SQL, PySpark, and Python. The ideal candidate will collaborate with Business and functional teams and create the data pipelines, apply CICD and DevOps practices, and optimize query performance and data transformations. This role requires a deep understanding of data governance, quality, and access control policies, as well as the ability to support production data pipelines and contribute to architectural decisions. Key Responsibilities : Apply CICD and DevOps practices to automate data workflows and deployments (e.g., with GitHub Actions, Jenkins, Terraform). Optimiz...

Role & responsibilities Offers/ Pipelines Job Description: Required Skills & Experience: Cloud Technologies (AWS) : Strong technical expertise with AWS services, specifically Redshift and Airflow for data engineering and orchestration. Hands-on experience in Redshift for data warehousing and optimization. Familiarity with AWS services like S3 , EC2 , Lambda , and Glue . Data Engineering & ETL/ELT Processes : Solid understanding of ETL (Extract, Transform, Load) and ELT (Extract, Load, Transform) processes. Experience in building scalable and efficient data pipelines to handle large-scale data processing using Airflow for orchestration. Proficiency in SQL for querying and manipulating data in...