1317 Senior Data Engineer Jobs - Page 8

As a Big Data Engineer at the company, you will be responsible for implementing Big Data solutions in Cloud environments. Your technical skill set should include: - 3-5 years of experience in implementing Big Data solutions in Cloud environments - Hands-on experience with Airflow DAG, Spark, Python, Hive, Trino, S3 Bucket, etc - Experience with Cloud Data platforms like SnowFlake and Databricks is a plus - Knowledge of the Financial domain, especially the Credit Card industry, is beneficial Your responsibilities will include: - Creating ELT Data pipelines using Python scripts and Airflow DAG - Optimizing Data pipelines by configuring Spark system resources - Debugging existing Microsoft BI E...

As a Data Engineer at UPS, your role involves participating in the support of batch and real-time data pipelines for Marketing and Finance business units. You will be responsible for integrating data from various sources, performing ETL data conversions, and facilitating data cleansing and enrichment. Your duties will include full systems life cycle management activities, such as analysis, technical requirements, design, coding, testing, and implementation of systems and applications software. Additionally, you will contribute to synthesizing disparate data sources to support reusable and reproducible data assets. **Key Responsibilities:** - Supervising and supporting data engineering projec...

As a Senior Data Engineer at Barclays, you will play a crucial role in building and maintaining the systems that collect, store, process, and analyze data. Your responsibilities will include developing data pipelines, data warehouses, and data lakes to ensure accuracy, accessibility, and security of all data. **Key Responsibilities:** - Hands-on experience working with large-scale data platforms and developing cloud solutions in AWS data platform to drive business success. - Strong understanding of AWS and distributed computing paradigms, designing and developing data ingestion programs using Glue, Lambda, S3, Redshift, Snowflake, and Databricks. - Developing data ingestion programs to proce...

JOB DESCRIPTION Data Engineer Designation – Data Engineer Experience – 5+ Years Location Mumbai (onsite) Job Summary: We are seeking a highly skilled Data Engineer with deep expertise in Apache Kafka integration with Databricks, structured streaming, and large-scale data pipeline design using the Medallion Architecture. The ideal candidate will demonstrate strong hands-on experience in building and optimizing real-time and batch pipelines, and will be expected to solve real coding problems during the interview. Job Description: • Design, develop, and maintain real-time and batch data pipelines in Databricks. • Integrate Apache Kafka with Databricks using Structured Streaming. • Implement rob...

To get the best candidate experience, please consider applying for a maximum of 3 roles within 12 months to ensure you are not duplicating efforts. Job Category Data Job Details About Salesforce Salesforce is the #1 AI CRM, where humans with agents drive customer success together. Here, ambition meets action. Tech meets trust. And innovation isn’t a buzzword — it’s a way of life. The world of work as we know it is changing and we're looking for Trailblazers who are passionate about bettering business and the world through AI, driving innovation, and keeping Salesforce's core values at the heart of it all. Ready to level-up your career at the company leading workforce transformation in the ag...

Job Responsibilities: Develop and maintain data pipelines and ETL/ELT processes using Python Design and implement scalable, high-performance applications Work collaboratively with cross-functional teams to define requirements and deliver solutions Develop and manage near real-time data streaming solutions using Pub, Sub or Beam. Contribute to code reviews, architecture discussions, and continuous improvement initiatives Monitor and troubleshoot production systems to ensure reliability and performance Basic Qualifications: 5+ years of professional software development experience with Python Strong understanding of software engineering best practices (testing, version control, CI/CD) Experienc...

Req ID: 343486 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Senior Data Engineer to join our team in Remote, West Bengal (IN-WB), India (IN). "Job Description Core Responsibilities Lead the development and optimization of ETL/ELT pipelines using Informatica PowerCenter, IICS, or Informatica Cloud. Architect and implement data integration solutions across Azure, Snowflake, and Synapse platforms. Collaborate with data architects, QA analysts, and client stakeholders to ensure data quality, performance, and complianc...

This role is for one of the Weekday's clients Salary range: Rs 2300000 - Rs 2500000 (ie INR 23-25 LPA) Min Experience: 5 years Location: Chennai, Trichy JobType: full-time We are seeking a Senior Data Engineer with a strong foundation in software development, distributed systems, and large-scale data processing. The ideal candidate is passionate about clean, efficient code and thrives in building reliable, scalable data pipelines that empower data-driven decision-making. Requirements Key Responsibilities Design, develop, and maintain scalable data pipelines and distributed systems using tools like Airflow, Spark, Kafka, Kinesis, and BigQuery. Apply advanced programming expertise (in Python o...

Role: Senior Data Engineer - (AWS, Opensearch) Years of Experience: 5-8 Years Location: Ahmedabad, Pune, Indore Notice Period: Immediate to 45 Days Max Job Description: We are seeking a highly motivated and enthusiastic Senior Data Engineer with 5- 8 years of experience to join our dynamic team. The ideal candidate will have a strong background in Data Engineering/Data analytics and a passion for leveraging data to drive business insights and innovation. Qualifications: Bachelor’s degree in Computer Science, Data Science, or a related field. Required Skills and Qualifications: 5-8 years of experience in data engineering, with a proven track record of building and managing data solutions. Des...

This role is for one of the Weekday's clients Salary range: Rs 2300000 - Rs 2500000 (ie INR 23-25 LPA) Min Experience: 5 years Location: Chennai, Trichy JobType: full-time We are seeking a Senior Data Engineer with a strong foundation in software development, distributed systems, and large-scale data processing. The ideal candidate is passionate about clean, efficient code and thrives in building reliable, scalable data pipelines that empower data-driven decision-making. Requirements Key Responsibilities Design, develop, and maintain scalable data pipelines and distributed systems using tools like Airflow, Spark, Kafka, Kinesis, and BigQuery. Apply advanced programming expertise (in Python o...

We’re looking for a Senior Data Engineer to support our team in PAN India. This role offers the opportunity to work on meaningful projects, collaborate with talented colleagues, and contribute to the success of a growing company. If you’re someone who takes initiative, values continuous learning, and thrives in a collaborative setting, we’d love to hear from you. Job Description Overall having experience between 6 to 10 years of experience in IT and minimum 3+ years’ experience in cloud. Hands on in Architecture, Design, Delivery of all aspects of Data Engineering area. Hands on experience in implementing data engineering projects. Strong understanding of Azure environment (PaaS, IaaS) and e...

As a member of the Natural Language Query (NLQ) platform team, you will be responsible for providing Platform-as-a-Service offerings that are easy to consume, scalable, secure, and reliable using open source-based solutions. You will also play a key role in developing and enhancing the NLQ Copilot platform to meet the evolving needs of multi-tenant environments. Your responsibilities will include implementing Context builder algorithms to generate 100% accurate SQL based on customer needs and collaborating with downstream clients to integrate business requirements. Additionally, you will work closely with data scientists, engineers, and product managers to optimize the performance of the NLQ...

Data Engineering and Infrastructure: 6+ years of experience in a Data Engineering role, designing, building, and managing scalable and reliable data systems. Proficient with big data and stream-processing technologies such as Spark and Kafka. Hands-on experience with cloud platforms, particularly AWS services like EC2 and RDS. Skilled in building and orchestrating data pipelines using tools like Airflow. Experience with Databricks for scalable data processing and advanced analytics. Strong knowledge of SQLMesh for modern data workflow management. Extensive experience integrating and working with external data sources via REST APIs, GraphQL endpoints, and SFTP servers. Strong communication sk...

1 Designing and implementing data ingestion pipelines from multiple sources using Azure Databricks 2 Ensure data pipelines run smoothly and efficiently 3 Developing scalable and re-usable frameworks for ingesting of data sets 4 Integrating the end-to-end data pipeline - to take data from source systems to target data repositories ensuring the quality and consistency of data is maintained at all times 5 Working with event based / streaming technologies to ingest and process data 6 Working with other members of the project team to support delivery of additional project components (API interfaces, Search) 7 Evaluating the performance and applicability of multiple tools against customer requirem...

Req ID: 343486 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Senior Data Engineer to join our team in Remote, West Bengal (IN-WB), India (IN). "Job Description Core Responsibilities Lead the development and optimization of ETL/ELT pipelines using Informatica PowerCenter, IICS, or Informatica Cloud. Architect and implement data integration solutions across Azure, Snowflake, and Synapse platforms. Collaborate with data architects, QA analysts, and client stakeholders to ensure data quality, performance, and complianc...

Company Description Company Description NIQ is the world’s leading consumer intelligence company, delivering the most complete understanding of consumer buying behavior and revealing new pathways to growth. In 2023, NIQ combined with GfK, bringing together the two industry leaders with unparalleled global reach. With a holistic retail read and the most comprehensive consumer insights—delivered with advanced analytics through state-of-the-art platforms—NIQ delivers the Full View™. NIQ is an Advent International portfolio company with operations in 100+ markets, covering more than 90% of the world’s population. Job Description Our Connect Technology teams are working on our new Connect platfor...

👇 🚀 We’re Hiring | Data Engineer (4+ Years) | Pune (Hybrid) Enterprise Minds India Pvt. Ltd. is looking for passionate and experienced Data Engineers to join our growing team for our esteemed client Vanderlande . 📍 Location: Pune (Kharadi) – Hybrid 🧠 Experience: 4+ Years 🏢 Company: Enterprise Minds India Pvt. Ltd. About Us: Enterprise Minds India is a solution engineering company headquartered in San Francisco with offices in Bangalore, Hyderabad, and Pune. We specialize in Digital Experience, Data Engineering, DevOps, and AI/ML , working with top product companies across the US and India — including Google, Boeing, Cisco, Thoughtspot, and Open Financial . Role Summary: As a Data Engineer , ...

Experience: 5-8 Years Location: Gurgaon (Hybrid) Responsibilities Develop, implement, and maintain the information data lake and using insight platforms to enable decision support systems for the overall organization. Partner with the business and our customers to understand their data and reporting requirements. Bring data sets together to answer business questions and drive growth. Design ETLs to ingest the data into the data warehouse and data lake, as well as end-user facing reporting applications. Collaborate with business customers and development teams to define requirements and deliver flexible, scalable, end-to-end solutions. Work with new technologies while driving business intelli...

Position: Senior Data Engineer Experience: 5–6 Years Location: Remote (India) Working Hours: 3:30 PM – 12:30 AM IST (EST Time Zone) About the Role We are seeking a skilled Data Engineer to join our dynamic insurance technology team. The ideal candidate will have hands-on experience building scalable and automated data pipelines using GCP services , Airflow , and DBT , while ensuring high data reliability, performance, and availability. You’ll be working on an innovative platform that simplifies how users compare and purchase insurance — empowering smarter, data-driven decisions. Key Responsibilities Design, build, and maintain data pipelines and ETL workflows using Airflow (on Kubernetes) , ...

As a Senior Data Engineer specializing in Data Quality, Ingestion & API Development, your role will involve leading the development of a scalable data ingestion framework with a strong focus on ensuring high data quality and validation. You will also be responsible for designing and implementing robust APIs for seamless data integration. Your expertise in building and managing big data pipelines using modern AWS-based technologies will be crucial for driving quality and efficiency in data processing systems. - **Data Ingestion Framework:** - **Design & Development:** Architect, develop, and maintain an end-to-end data ingestion framework that efficiently extracts, transforms, and loads data ...

As a Database Architect, your role involves designing and architecting robust data pipelines for structured, semi-structured, and unstructured data. You will be responsible for developing and managing databases (RDBMS, NoSQL, data lakes) to ensure data accessibility and integrity. Key Responsibilities: - Implementing efficient ETL processes using tools like PySpark and Hadoop to prepare data for analytics and AI use cases. - Optimizing database performance through query tuning, indexing, and caching strategies using Azure and GCP caching databases. - Monitoring, maintaining, and troubleshooting database infrastructure to ensure high availability and performance. - Building and maintaining CI...

Job Title: Senior Data Engineer Location: Hyderabad and Bangalore Job Summary We are seeking a highly skilled and experienced Senior Data Engineer to join our growing data engineering team. This role will be instrumental in designing, building, and maintaining scalable data pipelines and architectures to support advanced analytics, data science, and business intelligence functions. The ideal candidate will have deep expertise in Python, SQL, NoSQL databases, Kafka, and cloud-based data platforms, particularly Google Cloud Platform (GCP) and BigQuery. You’ll be responsible for end-to-end data processing from ingestion to transformation, and ensuring high data quality, availability, and perfor...

Data Engineer II Important Information Location: Chennai Experience as data architect with hands-on data warehousing and ETL experience Hands on experience with Tableau, Snowflake (the same technologies that is expected for the WRCP Operations Dashboard) Has hands-on experience building dashboards for engineering operations / SDLC Ability to analyze and understand requirements – ability to build quick prototypes / show and tell Good communication skills About Encora Encora is a global company that offers Software and Digital Engineering solutions. Our practices include Cloud Services, Product Engineering & Application Modernization, Data & Analytics, Digital Experience & Design Services, Dev...

We are seeking a Senior Data Engineer to support our strategic data initiatives. As we implement a Medallion Architecture (Bronze/Silver/Gold layers) and replatform several core transactional systems, this role will be critical in ensuring data quality, governance, and scalability. You will focus on operationalizing Silver and Gold data layers, adapting pipelines to new data sources, and ensuring downstream analytics, dashboards, and reporting remain reliable during this transition. Key Responsibilities: Silver/Gold Layer Development Translate raw data from sources (Zuora, CommerceTools, APIs, legacy databases) into curated Silver and Gold tables. Apply business logic, standardization, and d...

Location New Delhi, India Job Category IT Deadline November 03, 2025 Job Title: Senior Data Engineer Modern Cloud Data Engineer to enhance Enterprise Analy cs Pla orm and Digital Products We are offering an a rac ve posi on for a Data Engineer, to support the digital transforma on of Topsoe , towards the strategic company vision of being recognized as a global leader in carbon emission reduc on technologies. As part of this journey, we have built a team of Data Engineers, IoT experts, Data Scien sts, Front End Developers, Business Developers. This team leads the development of digital technologies and creates and op mizes business processes and workflows, culture, and customer experiences in o...