1344 Senior Data Engineer Jobs - Page 48

Job Family Data Science & Analysis (India) Travel Required None Clearance Required None What You Will Do Design, develop, and maintain robust, scalable, and efficient data pipelines and ETL/ELT processes. Lead and execute data engineering projects from inception to completion, ensuring timely delivery and high quality. Build and optimize data architectures for operational and analytical purposes. Collaborate with cross-functional teams to gather and define data requirements. Implement data quality, data governance, and data security practices. Manage and optimize cloud-based data platforms (Azure\AWS). Develop and maintain Python/PySpark libraries for data ingestion, Processing and integrati...

Experience: 5+ Years Role Overview: Responsible for designing, building, and maintaining scalable data pipelines and architectures. This role requires expertise in SQL, ETL frameworks, big data technologies, cloud services, and programming languages to ensure efficient data processing, storage, and integration across systems. Requirements: • Minimum 5+ years of experience as a Data Engineer or similar data-related role. • Strong proficiency in SQL for querying databases and performing data transformations. • Experience with data pipeline frameworks (e.g., Apache Airflow, Luigi, or custom-built solutions). • Proficiency in at least one programming language such as Python, Java, or Scala for d...

Overview Working at Atlassian Atlassians can choose where they work – whether in an office, from home, or a combination of the two. That way, Atlassians have more control over supporting their family, personal goals, and other priorities. We can hire people in any country where we have a legal entity. Interviews and onboarding are conducted virtually, a part of being a distributed-first company. Responsibilities Atlassian is looking for a Senior Data Engineer to join our Data Engineering team which is responsible for building our data lake, maintaining our big data pipelines / services and facilitating the movement of billions of messages each day. We work directly with the business stakehol...

Every day, your work will make an impact that matters, while you thrive in a dynamic culture of inclusion, collaboration, and high performance. As the undisputed leader in professional services, Deloitte is where you will find unrivaled opportunities to succeed and realize your full potential. The Team We are seeking highly skilled Databricks Data Engineers to join our data modernization team. You will play a pivotal role in designing, developing, and maintaining robust data solutions on the Databricks platform. Your experience in data engineering, along with a deep understanding of Databricks, will be instrumental in building solutions to drive data-driven decision-making across a variety o...

About Qualitrol Qualitrol is a leader in providing condition monitoring solutions for the electricity industry, ensuring reliability and efficiency in high-voltage electrical assets. We leverage cutting-edge technology, data analytics, and AI to transform how utilities manage their assets and make data-driven decisions. Role Summary We are looking for a highly skilled Senior Data Engineer to join our team and drive the development of our data engineering capabilities. This role involves designing, developing, and maintaining scalable data pipelines, optimizing data infrastructure, and ensuring high-quality data for analytics and AI-driven solutions. The ideal candidate will have deep experti...

IMEA (India, Middle East, Africa) India LIXIL INDIA PVT LTD Employee Assignment Fully remote possible Full Time 1 May 2025 Title Senior Data Engineer Job Description A Data Engineer is responsible for designing, building, and maintaining large-scale data systems and infrastructure. Their primary goal is to ensure that data is properly collected, stored, processed, and retrieved to support business intelligence, analytics, and data-driven decision-making. Key Responsibilities Design and Develop Data Pipelines: Create data pipelines to extract data from various sources, transform it into a standardized format, and load it into a centralized data repository. Build and Maintain Data Infrastructu...

Job Description EMPLOYMENT TYPE: Full-Time, Permanent LOCATION: Remote (Pan India) SHIFT TIMINGS: 2.00 pm-11:00 pm IST Budget- As per company standards REPORTING: This position will report to our CEO or any other Lead as assigned by Management. The Senior Data Engineer will be responsible for building and extending our data pipeline architecture, as well as optimizing data flow and collection for cross-functional teams. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys working with big data and building systems from the ground up. You will collaborate with our software engineers, database architects, data analysts, and data scientists to ensure our data...

Description About Tripstack - We are travel tech entrepreneurs, changing the way millions of people travel. Our proprietary virtual interlining technology provides access to billions of travel itineraries by combining flights from different airline carriers that don’t traditionally work together. We take our customers from point A to B via C, at the lowest possible price. We are impacting the way people travel and provide higher margin opportunities to our partners that are some of the largest online travel agencies in the world. We pride ourselves on the performance-driven environment we have created for our teams to prosper and excel in. We come to work ready, to challenge and be challenge...

Description Data Engineer Responsibilities : Deliver end-to-end data and analytics capabilities, including data ingest, data transformation, data science, and data visualization in collaboration with Data and Analytics stakeholder groups Design and deploy databases and data pipelines to support analytics projects Develop scalable and fault-tolerant workflows Clearly document issues, solutions, findings and recommendations to be shared internally & externally Learn and apply tools and technologies proficiently, including: Languages: Python, PySpark, ANSI SQL, Python ML libraries Frameworks/Platform: Spark, Snowflake, Airflow, Hadoop , Kafka Cloud Computing: AWS Tools/Products: PyCharm, Jupyte...

Key Responsibilities: Optimize scalable data pipelines for ingestion, transformation, and loading of large datasets from diverse sources. Utilize Azure Data Factory for orchestration and automation of ETL/ELT processes, ensuring efficient data flow. Work extensively with Azure services such as Azure Blob Storage and Azure Data Lake Storage (ADLS Gen2) for efficient data storage and management. Integrate and manage data flows using Azure Logic Apps for event-driven automation and workflow orchestration. Develop and maintain robust SQL queries, stored procedures, and data models to support reporting and analytical requirements. Implement and enforce data governance, quality, and security best ...

About Us BrightEdge is a leading enterprise SEO and content performance platform trusted by over 1,500 global brands including Microsoft, Adobe, and Marriott. What makes BrightEdge special is our innovative technology that transforms complex search data into actionable insights. We're not just another martech company – we literally pioneered the SEO platform category and continue to lead with AI-powered solutions. Working with us means joining a team that's solving fascinating technical and business challenges at scale. You'll be directly impacting how major brands connect with their audiences online. We're looking for a talented Big Data Engineer to join our Professional Services team to he...

Deutsche Telekom Digital Labs is the captive unit of the global telecom giant & we create compelling digital propositions by building scalable and agile platforms to provide the best of digital experience to Deutsche Telekom customers across Europe. We aim to bring all the Deutsche Telekom customers onto our digital products by simplifying the experience. This includes innovative approaches to allow the user to explore compelling propositions, recommend most suitable services based on micro segmentation and so on. Responsibilities: You will be involved in the design of data solutions using Hadoop based technologies along with Hadoop, AWS. Responsibilities includes design and implementation o...

About The Company Veersa is a healthtech company that leverages emerging technology and data science to solve business problems in the US healthcare industry. Veersa has established a niche in serving small and medium entities in the US healthcare space through its tech frameworks, platforms, and tech accelerators. Veersa is known for providing innovative solutions using technology and data science to its client base and is the preferred innovation partner to its clients. Veersas rich technology expertise manifests in the various tech accelerators and frameworks developed in-house to assist in rapid solutions delivery and implementations. Its end-to-end data ingestion, curation, transformati...

Skills: Python, Spark, Data Engineer, Cloudera, Onpremise, Azure, Snlowfow, Kafka, Overview Of The Company Jio Platforms Ltd. is a revolutionary Indian multinational tech company, often referred to as India's biggest startup, headquartered in Mumbai. Launched in 2019, it's the powerhouse behind Jio, India's largest mobile network with over 400 million users. But Jio Platforms is more than just telecom. It's a comprehensive digital ecosystem, developing cutting-edge solutions across media, entertainment, and enterprise services through popular brands like JioMart, JioFiber, and JioSaavn. Join us at Jio Platforms and be part of a fast-paced, dynamic environment at the forefront of India's digi...

Skills: Python, Apache Spark, Snowflake, data engineer, spark, kafka, azure, Overview Of The Company Jio Platforms Ltd. is a revolutionary Indian multinational tech company, often referred to as India's biggest startup, headquartered in Mumbai. Launched in 2019, it's the powerhouse behind Jio, India's largest mobile network with over 400 million users. But Jio Platforms is more than just telecom. It's a comprehensive digital ecosystem, developing cutting-edge solutions across media, entertainment, and enterprise services through popular brands like JioMart, JioFiber, and JioSaavn. Join us at Jio Platforms and be part of a fast-paced, dynamic environment at the forefront of India's digital tr...

Who We Are Motive empowers the people who run physical operations with tools to make their work safer, more productive, and more profitable. For the first time ever, safety, operations and finance teams can manage their drivers, vehicles, equipment, and fleet related spend in a single system. Combined with industry leading AI, the Motive platform gives you complete visibility and control, and significantly reduces manual workloads by automating and simplifying tasks. Motive serves more than 120,000 customers – from Fortune 500 enterprises to small businesses – across a wide range of industries, including transportation and logistics, construction, energy, field service, manufacturing, agricu...

Job Title: Senior Data Engineer Location: Hyderabad, India (Hybrid Model) Experience Required: 8+ Years Contract Duration: 1 Year Work Mode: Onsite (Hybrid Model) Job Description: We are seeking a highly skilled and experienced Senior Data Engineer for a contractual opportunity (C2C) with a duration of 1 year. The ideal candidate will have a strong background in Airflow, Python, AWS, and Big Data technologies (especially Spark) and be capable of building scalable and efficient data engineering solutions in a hybrid onsite role based in Hyderabad. Mandatory Skills: Apache Airflow: Expertise in workflow orchestration, DAG creation, and managing complex data pipelines. Python: Proficient in wri...

The Data Engineer will support the development and implementation of robust data pipelines to enable DQ rule execution, monitoring, and compliance reporting for cybersecurity metrics. The role demands hands-on experience with data engineering tools and platforms (Data bricks, PySpark, SQL), with a focus on supporting BCBS 239-aligned initiatives under DUSE/DMOV frameworks. Key Responsibilities: Build, test, and deploy scalable DQ rule execution pipelines for cyber risk metrics. Design and automate ETL/ELT jobs to integrate BDEs, DDTs, and metadata from various data sources. Develop integration workflows to stitch technical data fields with BDEs for metric lineage and traceability. Support im...

Step into role of a Senior Data Engineer. At Barclays, innovation isn’t encouraged, its expected. As a Senior Data Engineer you will build and maintain the systems that collect, store, process, and analyse data, such as data pipelines, data warehouses and data lakes to ensure that all data is accurate, accessible, and secure. To be a successful Senior Data Engineer, you should have experience with: Hands on experience to work with large scale data platforms & developing cloud solutions in AWS data platform with proven track record in driving business success. Strong understanding of AWS and distributed computing paradigms, ability to design and develop data ingestion programs to process larg...

Company Name: Logicserve Digital Consultancy Services Pvt. Ltd. Location: Surat Experience: 4+ Years Working Days: 6 Days a Week Key Responsibilities: Requirement Gathering: Collaborate with stakeholders to gather and document data requirements. Translate business needs into technical specifications for data solutions. Data Pipeline Development: Design, implement, and maintain data pipelines using Microsoft Fabric. Create and manage ETL processes, ensuring efficient data flow. SSIS Integration: Develop and maintain ETL processes using SQL Server Integration Services (SSIS). Optimize SSIS packages for performance and reliability. CDC Pipelines: Implement Change Data Capture (CDC) pipelines to...

Job Title: Senior Data Engineer Required Experience: 5+ years We are looking for an experienced Senior Data Engineer to join our team. You will be responsible for large-scale data ingestion, cleaning, and standardization from diverse data sources into Microsoft SQL Server. The ideal candidate will have expertise in creating efficient data pipelines, writing complex stored procedures, and managing ETL processes using SSIS, Azure Data Factory, and Python. Experience with .NET C# is a plus. If you have a passion for working with large volumes of data, optimizing data performance, and working in cloud environments, this role is for you! Key Responsibilities Design, implement, and manage mass dat...

Required Skills and Experience: 3+ years of experience building enterprise-scale, cloud-native applications in AWS . Strong hands-on experience with AWS Glue , PySpark , Lambda , S3 , Athena , and RDS (Aurora/Postgres) . Proven experience in building secure REST APIs , including token-based security, API Gateway configuration, and monitoring. Experience working in event-driven and domain-driven architectures . Deep knowledge of SQL Server and experience translating complex stored procedures to AWS Glue. Expertise in designing modular, fault-tolerant Glue workflows using Step Functions . Proficient in Python and developing reusable code libraries for data processing tasks. Strong understandin...

Brief Description The Cloud Data Engineer will play a critical implementation role on the Data Engineering and Data Products team and be responsible for data pipeline solutions design and development, troubleshooting, and optimization tuning on the next generation data and analytics platform being developed with leading edge big data technologies in a highly secure cloud infrastructure. The Cloud Data Engineer will serve as a liaison to platform user groups ensuring successful implementation of capabilities on the new platform. Data Engineer Responsibilities : Deliver end-to-end data and analytics capabilities, including data ingest, data transformation, data science, and data visualization ...

Google BigQuery, Apache Airflow Must Have 3 Cloud Platforms GCP (primary), AWS (optional), GCS/S3 Must Have 4 ETL & Pipelines ETL/ELT concepts, scalable pipeline design, automation, DAG scheduling using Airflow Must Have 5 Programming & Querying Python, Web API Development Must Have 6 Data Integration & Migration Salesforce, MySQL, SQL Server, SFTP, SharePoint, Email integrations Must Have 7 Data Security & Encryption End-to-end encryption, secure data exports/imports Must Have 8 Version Control & CI/CD GitLab, Bitbucket, CI/CD pipelines Good to Have 9 Business Intelligence Tools DOMO, Looker, Tableau Good to Have 10 Object-Oriented & Java Basics Basic OOP concepts, Java familiarity Good to ...

Job Family Data Science & Analysis (India) Travel Required None Clearance Required None What You Will Do Design, develop, and maintain robust, scalable, and efficient data pipelines and ETL/ELT processes. Lead and execute data engineering projects from inception to completion, ensuring timely delivery and high quality. Build and optimize data architectures for operational and analytical purposes. Collaborate with cross-functional teams to gather and define data requirements. Implement data quality, data governance, and data security practices. Manage and optimize cloud-based data platforms ( Azure\AWS). Develop and maintain Python/PySpark libraries for data ingestion, Processing and integrat...