3201 Data Pipelines Jobs - Page 34

Role Overview: You will lead end-to-end technical operations for the Databricks-based data platform in a 24/7 environment. Your responsibilities will include overseeing data ingestion, ETL/ELT processes, data quality, and pipeline orchestration. You will ensure high availability, performance, and security of data platforms and monitor, troubleshoot, and resolve production issues in real-time. Collaborating with cross-functional teams including Cloud Infrastructure, DevOps, Data Engineering, and Analytics will be a key aspect of your role. Additionally, you will optimize Databricks clusters, jobs, and workflows for cost and performance efficiency and implement best practices for CI/CD, versio...

Role Overview: At Aftershoot, you will be part of a passionate and fast-growing team dedicated to building AI tools for photographers worldwide. The focus is on simplifying post-processing tasks so photographers can spend more time capturing moments and telling stories. As a Software Development Engineer (SDE 2/SSE 1), your mission will involve designing and maintaining scalable cloud infrastructure using cloud technologies, particularly GCP. You will work on developing and operating microservices-based applications, along with implementing monitoring and observability solutions. Key Responsibilities: - Design, implement, and maintain cloud infrastructure on public cloud platforms. - Develop...

Location : Pune / Hybrid. Travel : < 20% (USA / Europe). About Entytle Entytle is on a mission to transform the Aftermarket for industrial OEMs using AI-driven Installed Base Intelligence. Our platform helps the worlds leading equipment manufacturers clean, unify, and leverage their Installed Base data to drive growth, improve service performance, and build stronger customer relationships. We are looking for a Solutions Manager Tech Data Lead who is a strong blend of data expertise, customer empathy, and delivery excellence. Youll play a key role in designing and delivering solutions for global OEMs, leading teams, and ensuring our customers success. Why Join Us Work with leading global equi...

You are an experienced Global Coupa Technical/Functional Lead with 6 to 8 years of experience. Your role involves designing, implementing, enhancing, and supporting Coupa solutions integrated with SAP S/4HANA. You will be responsible for Coupa configurations, lifecycle delivery of procurement solutions, integration with SAP and MuleSoft, and driving analytics, reporting, and data-driven improvements across global business operations. The position can be based in Hyderabad, Bangalore, or remote. **Key Responsibilities:** - Strong hands-on experience in Coupa configuration, administration, and module functionalities (procurement, sourcing, invoicing). - Deep understanding of SAP S/4HANA financ...

As an experienced ETL Testing Engineer, your role will involve designing, developing, and executing test cases for data pipelines, ETL processes, and database systems. You will need to have expertise in SQL querying, ETL validation, Python scripting, and test automation to ensure data accuracy, completeness, and optimal performance. **Key Responsibilities:** - Develop and execute ETL test cases to validate data extraction, transformation, and loading processes. - Perform ETL pipeline testing in an ADB (Azure Databricks) environment. - Write complex SQL queries to verify data integrity, consistency, and correctness across source and target systems. - Automate ETL testing workflows using Pytho...

As a Data Engineer-SQL at Barclays, you will play a crucial role in revolutionizing the digital landscape and enhancing customer experiences. Your primary responsibility will be to develop complex/medium/easy datasets using SQL tools, with a strong focus on writing SQL queries in Teradata and Hive/Impala. Additionally, you will be expected to work with scripts (.bteq) in Unix/Linux environments. Attention to detail, analytical skills, and exceptional communication abilities are essential for success in this role. Exposure to AWS/Azure and Snowflake will be advantageous. Key Responsibilities: - Develop complex/medium/easy datasets using SQL tools - Write SQL queries in Teradata and Hive/Impal...

Key Responsibilities: ? Leadership & Strateg y? Lead and grow a team of backend,and FE engineers focused on Search, Ranking, and Product Discovery .? Collaborate with Product, Data Engineering, and UX teams to define the long-term search roadmap .? Drive architecture and design discussions for scalable and intelligent search systems .? Foster a culture of high performance, collaboration, and continuous improvement .? Technical Deliver y? Oversee end-to-end design, development, and optimization of search pipelines (indexing, query processing, ranking) .? Own search KPIs including relevance, latency, clickthrough rate, and conversion metrics .? Implement experimentation frameworks (A/B testing...

Key Skills: Bachelor's/Masters degree in a relevant field (e.g. Computer Science, Software engineering, Data Science, AI/ML). 7+ years of experience Developing, deploying, and monitoring end to end data and analytics solutions with extensive knowledge of evaluation metrics and best practices. 7+ years Data Warehouse/Data Lake Architecture and Development. 5+ years Data Modeling & Architecture with experience in implementing at least one market leading banking and financial services data model i.e. from Oracle, Teradata, IBM Experience on data modelling tools such as Erwin, ER Studio, SQL modeler is preferred Experience in ETL/ELT, data Pipelines, Data Quality, blueprints development. Non-Rel...

About The Role Project Role : Technology Architect Project Role Description : Design and deliver technology architecture for a platform, product, or engagement. Define solutions to meet performance, capability, and scalability needs. Must have skills : Salesforce Technical Architecture Good to have skills : Cloud Data Architecture, Salesforce Data Minimum 12 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Salesforce Data Cloud Architect, you will be responsible for designing and implementing scalable, secure, and high-performance data architectures using Salesforce Data Cloud. You will work closely with cross-functional teams to define...

The Integration Developer will design, build, and support scalable integration solutions using middleware platforms such as Oracle Integration Cloud (OIC) and Boomi. You will play a key role in connecting enterprise systems such as Oracle Fusion Cloud, Salesforce (SFDC), and other third-party platforms to enable seamless end-to-end data flow. This role requires strong expertise in REST and SOAP APIs, JSON/XML data formats, and the ability to translate business requirements into reliable, maintainable integration solutions. Design, develop, and deploy end-to-end integrations using Oracle Integration Cloud (OIC) and Boomi. Implement real-time and batch integrations between Oracle Fusion Cloud,...

Scope Receives work assignments through the ticketing system or from senior leadership. Provides Tier-4 engineering expertise , platform ownership, and technical leadership for all observability capabilities across hybrid cloud, on-premises, and SaaS environments. Leads the design, architecture, and maturity of the enterprise observability ecosystem with a primary focus on the Elastic Observability Platform , ensuring end-to-end visibility for infrastructure, cloud services, networks, and business-critical applications. Drives the enterprise strategy for logging, metrics, traces, synthetics, and alerting-including governance, standardization, and performance optimization. Partners closely wi...

Argus is where smart people belong and where they can grow. We answer the challenge of illuminating markets and shaping new futures. What We're Looking For We are seeking a proactive, detail-oriented, and enthusiastic Lead Prices Data Analyst to lead our Price Data Operations team in India supporting prices global data operations. This managerial role is perfect for someone passionate about data and eager to lead a team to delivering market intelligence to the global energy and commodity markets. You'll collaborate closely with experienced analysts and engineers, supporting data-driven processes that ensure efficient data flow and analytics across the organization. The ideal candidate is a s...

Key Responsibilities Include Designing and implementing scalable and efficient architectures for ELT systems and data pipelines Leading the design of RESTful APIs to facilitate seamless integration and interaction with data systems Recommending tools, frameworks, and platforms (i.e., Snowflake, Redshift, PostgreSQL) to meet current and future business needs Working closely with data engineers, software developers, and stakeholders to translate business requirements into technical designs Creating detailed architectural documentation to guide implementation and maintenance Required Skills And Experience Include Expertise in designing ELT systems and scalable data pipelines Strong understandin...

NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a CJA Developer to join our team in Bangalore, Karntaka (IN-KA), India (IN). Key Responsibilities: AJO Development & Maintenance: Support & maintenance, Design, develop, and implement customer journeys in AJO using best practices and industry standards. Write high-quality, well-documented, and maintainable AJO workflows and integrations. Troubleshoot and debug AJO applications to identify and resolve issues. Perform code reviews and provide constructive feedback to other ...

About The Role Skill required: Delivery - Digital Analytics Designation: I&F Decision Sci Practitioner Specialist Qualifications: Any Graduation Years of Experience: 7 to 11 years Accenture is a global professional services company with leading capabilities in digital, cloud and security.Combining unmatched experience and specialized skills across more than 40 industries, we offer Strategy and Consulting, Technology and Operations services, and Accenture Song— all powered by the world’s largest network of Advanced Technology and Intelligent Operations centers. Our 699,000 people deliver on the promise of technology and human ingenuity every day, serving clients in more than 120 countries. We...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Apache Spark Good to have skills : NA Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time educationBTech or MTech or MCA with IT or CSE or EEE or ECE Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creatin...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Snowflake Data Warehouse Good to have skills : Data Engineering, Databricks Unified Data Analytics Platform Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day wi...

Job Title: AI Data Engineer Exp- 4 to 8 years Location- PAN India Job Description Key Responsibilities: Build and maintain data infrastructure: Design and construct scalable, reliable data pipelines, storage, and processing systems in the cloud. Ensure data quality: Clean, transform, and enrich raw data to create business truth that AI models can use for accurate insights. Enable AI/ML: Make data readily available and optimized for consumption by AI and machine learning models. Manage cloud services: Work with cloud-specific services for storage, compute, and networking to build an efficient and scalable AI data environment. Implement security and governance: Apply security controls to prote...

Job Overview The Senior Software Engineer will do the design, development, and delivery of advanced big data solutions within the Hadoop ecosystem. This role involves architecting and implementing scalable data processing frameworks, ensuring high performance and reliability across distributed systems. The engineer will research and evaluate emerging technologies to optimize data workflows and meet evolving business needs. Additionally, the position requires hands-on expertise in Cloudera distribution and related tools, ensuring seamless orchestration and integration of data pipelines. The Senior Software Engineer will also be responsible for maintaining operational excellence, meeting SLA r...

Key Responsibilities: Data Testing Strategy & Execution: Design, develop, and execute comprehensive test plans and test cases for data-centric applications, ETL processes, data warehouses, data lakes, and reporting solutions SQL-Driven Validation: Utilize advanced SQL queries to perform complex data validation, data reconciliation, data integrity checks, and data quality assurance across various financial data sources ETL Testing: Conduct thorough testing of ETL (Extract, Transform, Load) processes, ensuring data is accurately extracted, transformed according to business rules, and loaded correctly into target systems Data Quality Assurance: Implement and monitor data quality checks, identif...

Role Description : As a Senior Big Data Platform Engineer at Incedo, you will be responsible for designing and implementing big data platforms to support large-scale data integration projects. You will work with data architects and data engineers to define the platform architecture and build the necessary infrastructure. You will be skilled in big data technologies such as Hadoop, Spark, and Kafka and have experience in cloud computing platforms such as AWS or Azure. You will be responsible for ensuring the performance, scalability, and security of the big data platform and troubleshooting any issues that arise. Roles & Responsibilities: Designing, developing and maintaining large-scale big ...

About the Role As a GCP Observability Engineer, you will play a critical role in design and implementation of enterprise-scale applications within the Google Cloud Platform (GCP) environment. Your expertise in GCP observability services will ensure that our systems are reliable, scalable, and efficient, delivering exceptional value to our internal customers. The Team The Observability and Application Services team, part of Digital Technology Services (DTS), is responsible for designing, implementing, and maintaining large-scale data-based systems that power corporate applications, shared services, and information security systems. This is a rare opportunity to join a dynamic and impactful te...

We are looking for a skilled QA Engineer to join our agile development team and take ownership of quality across core components and cloud data warehouse platforms. If you''re passionate about testing, automation, and data reliability , this is a great opportunity to work with modern technologies and complex systems. Experience with cloud data platforms like Snowflake, Redshift, Databricks, or BigQuery will be a strong plus. Youll work closely with data engineers and platform teams to build robust automated test frameworks that help us ensure scalable, reliable, and accurate systems . What Youll Do: Develop and implement test strategies for core services and data pipelines. Build and execute...

We are looking for a skilled QA Engineer to join our agile development team and take ownership of quality across core components and cloud data warehouse platforms. If you''re passionate about testing, automation, and data reliability , this is a great opportunity to work with modern technologies and complex systems. Experience with cloud data platforms like Snowflake, Redshift, Databricks, or BigQuery will be a strong plus. Youll work closely with data engineers and platform teams to build robust automated test frameworks that help us ensure scalable, reliable, and accurate systems . What Youll Do: Develop and implement test strategies for core services and data pipelines. Build and execute...

Title and Summary The Software Engineer II will contribute to the design, development, and maintenance of big data solutions within the Hadoop ecosystem The role involves working with distributed data processing frameworks and supporting the creation of reliable, high-performance data pipelines The engineer will be responsible for hands-on development and troubleshooting using the Cloudera distribution, along with related ecosystem tools such as Apache Ozone, Apache Iceberg, Apache Airflow, and Apache NiFi The position requires hands on experience in Apache Spark to support large-scale, massively parallel data processing tasks The Software Engineer II will collaborate closely with senior tea...