20 Elt Pipelines Jobs

TransUnion's Job Applicant Privacy Notice What We'll Bring At TransUnion, we have a welcoming and energetic environment that encourages collaboration and innovation - we're consistently exploring new technologies and tools to be agile. This environment gives our people the opportunity to hone current skills and build new capabilities, while discovering their genius. Come be a part of our team you'll work with great people, pioneering products and cutting-edge technology As a Technical Platform Product Manager Batch Fulfillment within Global Technology, Data & Analytics, you will define and drive the strategy for scalable, resilient, and efficient batch data processing capabilities. You'll be...

Job Title: Analytics Engineer Language: Excellent English proficiency (both written and verbal) Work Mode: Remote Working Hours: As per international clients requirements Salary: Up to ?12 LPA (depending on experience and skill set) Experience: 3-6 years Job Summary We are seeking a detail-oriented Analytics Engineer with 3-6 years of experience in building and optimizing data models, transforming raw data into actionable insights, and maintaining scalable analytics workflows. The role involves working closely with data engineers and analysts to develop efficient ELT pipelines, maintain data models using dbt , and ensure the reliability and accuracy of analytics in Snowflake or similar cloud...

As a Software Engineer-Full Stack Developer at Barclays in the Operational Support Systems (OSS) Platform Engineering team, your role is vital to the design, build, and maintenance of the underlying OSS infrastructure and toolchain that supports the Barclays Global Network. You will have the opportunity to leverage cutting-edge technology to drive innovation and enhance customer experiences in a dynamic and collaborative environment. **Key Responsibilities:** - Demonstrate expertise in front-end and back-end development with proficiency in Java and the Spring Ecosystem, including Spring MVC, Data JPA, and Security, along with strong SQL and NoSQL integration skills. - Utilize React.js and Ja...

AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best Place to Work awards. WHY JOIN US If you're looking for a place to grow, make an impact, and work with people who care, we'd love to meet you! ABOUT THE ROLE As a Senior Java & Cloud Developer , you'll design and deploy scalable microservices and data pipelines that power ESG and climate data solutions. You'll work across Java, Spring Boot, cloud platforms, and data engineering tools to ensure reliability, automation, an...

AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best Place to Work awards. WHY JOIN US If you're looking for a place to grow, make an impact, and work with people who care, we'd love to meet you! ABOUT THE ROLE As a Senior Java & Cloud Developer , you'll design and deploy scalable microservices and data pipelines that power ESG and climate data solutions. You'll work across Java, Spring Boot, cloud platforms, and data engineering tools to ensure reliability, automation, an...

AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best Place to Work awards. WHY JOIN US If you're looking for a place to grow, make an impact, and work with people who care, we'd love to meet you! ABOUT THE ROLE As a Senior Java & Cloud Developer , you'll design and deploy scalable microservices and data pipelines that power ESG and climate data solutions. You'll work across Java, Spring Boot, cloud platforms, and data engineering tools to ensure reliability, automation, an...

AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best Place to Work awards. WHY JOIN US If you're looking for a place to grow, make an impact, and work with people who care, we'd love to meet you! ABOUT THE ROLE As a Senior Java & Cloud Developer , you'll design and deploy scalable microservices and data pipelines that power ESG and climate data solutions. You'll work across Java, Spring Boot, cloud platforms, and data engineering tools to ensure reliability, automation, an...

As an individual with experience in Azure Synapse Analytics, Azure Data Lake Storage, AI Tools, Avro, and Parquet, and healthcare data management, you will play a crucial role in designing, developing, and maintaining data pipelines for ingestion, transformation, and loading of data into Azure Synapse Analytics. Your expertise will be instrumental in ensuring compliance with data governance policies, implementing security measures, and optimizing performance of data pipelines within Azure Synapse Analytics. - Design, develop, and maintain data pipelines for ingestion, transformation, and loading of data into Azure Synapse Analytics - Work with Azure Synapse Analytics to build and optimize da...

Role Overview: As an individual with experience in Azure Synapse Analytics, Azure Data Lake Storage, AI Tools, Avro, and Parquet, and healthcare data management, you will play a crucial role in designing, developing, and maintaining data pipelines for ingestion, transformation, and loading of data into Azure Synapse Analytics. Your expertise will be instrumental in ensuring compliance with data governance policies, implementing security measures, and optimizing the performance of data pipelines within Azure Synapse Analytics. Key Responsibilities: - Design, develop, and maintain data pipelines for ingestion, transformation, and loading of data into Azure Synapse Analytics. - Work with Azure ...

As a Snowflake Developer, your role will involve designing, building, and maintaining scalable data pipelines using Snowflake and DBT (data build tool). Your deep understanding of Snowflake and DBT will be crucial in optimizing data processes for performance and efficiency. Key Responsibilities: - Design, develop, and optimize Snowflake data models and DBT transformations. - Build and maintain CI/CD pipelines for automated DBT workflows. - Implement best practices for data pipeline performance, scalability, and efficiency in Snowflake. - Contribute to the DBT community or develop internal tools/plugins to enhance the workflow. - Troubleshoot and resolve complex data pipeline issues using DBT...

Role Overview: As a Data Solutions Developer, you will collaborate closely with the Head of Data to create and implement scalable data solutions that facilitate the consolidation of company-wide data into a controlled data warehouse environment. Your primary focus will be on constructing efficient ELT pipelines, APIs, and database architectures to facilitate high-speed ingestion and storage of data from various sources into a unified repository. This repository will act as the foundation for business reporting and operational decision-making processes. Key Responsibilities: - Design and implement scalable database and data warehouse solutions - Establish and manage data ingestion pipelines f...

Role Overview: Embark on a transformative journey as a Software Engineer- Operational Support Systems at Barclays, where you'll spearhead the evolution of the digital landscape, driving innovation and excellence. You'll be part of the Network Assurance & AI Engineering team responsible for the design, build, and run of zero-touch operations, closed-loop auto-remediation, and AIOps capabilities for network assurance and observability of the Barclays Global Network. Your expertise in Java, Spring Ecosystem, CI/CD pipelines, monitoring, and observability will be crucial for success in this role. Key Responsibilities: - Develop and deliver high-quality software solutions using industry-aligned p...

As a Software Engineer-Full Stack Developer at Barclays, you will embark on a transformative journey to spearhead the evolution of the digital landscape, driving innovation and excellence. Your primary responsibility will be to harness cutting-edge technology to revolutionize digital offerings, ensuring unparalleled customer experiences. You will be part of the Operational Support Systems (OSS) Platform Engineering team within the Network OSS & Tools functional unit at Barclays, responsible for designing, building, and running the underlying OSS infrastructure and toolchain across cloud and on-premises environments. To excel in this role, you should possess demonstrable expertise in front-en...

Position: Data Steward and Analyst Experience: 24 Years Location: Mahape, Mumbai, India Email ID for CV sharing: [HIDDEN TEXT] About the Role: We are seeking a proactive and detail-oriented Data Steward and Analyst to drive metadata standardization and data ownership across enterprise systems. This role will be responsible for defining, maintaining, and enriching metadata assets including business glossaries, data dictionaries, and ownership hierarchies. The ideal candidate will collaborate with business and technical stakeholders to enhance data discoverability, trust, and compliance. Hands-on experience to implement, configure, and maintain Data Governance tools is essential, with preferen...

Why We Work at Dun & Bradstreet Dun & Bradstreet unlocks the power of data through analytics, creating a better tomorrow. Each day, we are finding new ways to strengthen our award-winning culture and accelerate creativity, innovation and growth. Our 6,000+ global team members are passionate about what we do. We are dedicated to helping clients turn uncertainty into confidence, risk into opportunity and potential into prosperity. Bold and diverse thinkers are always welcome. Come join us! Learn more at dnb.com/careers . Director Data Engineering (Hyderabad) We are seeking a visionary and hands-on Director of Data Engineering to lead our data engineering function from Hyderabad. This leadershi...

You are a Sr. Data Engineer with a strong background in building ELT pipelines and expertise in modern data engineering practices. You are experienced with Databricks and DBT, proficient in SQL and Python, and have a solid understanding of data warehousing methodologies such as Kimball or Data Vault. You are comfortable working with DevOps tools, particularly within AWS, Databricks, and GitLab. Your role involves collaborating with cross-functional teams to design, develop, and maintain scalable data infrastructure and pipelines using Databricks and DBT. Your responsibilities include designing, building, and maintaining scalable ELT pipelines for processing and transforming large datasets ef...

Key Responsibilities: Data Engineering & Development: Design, build, and maintain ETL/ELT pipelines using Hadoop ecosystem tools Write complex Hive queries for data transformation and analysis Work with HDFS for storage and efficient data access Develop UNIX shell scripts for automation of jobs and workflows Optimize SQL queries for performance and scalability Data Processing & Integration: Process large volumes of structured and semi-structured data Integrate data from various sources into Hadoop-based data lakes Work with cross-functional teams to understand data requirements and deliver solutions Monitoring, Maintenance & Quality: Monitor and troubleshoot production data pipelines Ensure ...

As a Software Engineer- Operational Support Systems at Barclays, you will embark on a transformative journey, spearheading the evolution of the digital landscape and driving innovation and excellence. Your primary responsibility will be the design, build, and maintenance of the underlying OSS infrastructure and toolchains necessary to run the Barclays Global Network, deployed across cloud and On-Prem environments. To excel in this role, you should possess expertise in both front-end and back-end development. Proficiency in Java (Java 17+) and the Spring Ecosystem (Spring MVC, Data JPA, Security, etc.), along with strong SQL and NoSQL integration skills, are essential. Additionally, you shoul...

As a Software Engineer- Operational Support Systems at Barclays, you will lead the evolution of the digital landscape by utilizing cutting-edge technology to enhance the digital offerings and ensure unmatched customer experiences. Your primary responsibility will be the design, construction, and maintenance of the OSS infrastructure and toolchains necessary to operate the Barclays Global Network across cloud and On-Prem environments. To excel in this role, you must demonstrate proficiency in front-end and back-end technologies, including Java (Java 17+), Spring Ecosystem, SQL, NoSQL, React.js, JavaScript, and state management expertise. Additionally, you should have expertise in virtualizati...

Looking for Data Engineers, immediate joiners only, for Hyderabad, Bengaluru and Noida Location. * Must have experience in Python, Kafka Stream, Pyspark, and Azure Databricks.* Role and responsibilities: Lead the design, development, and implementation of real-time data pipelines using Kafka, Python, and Azure Databricks . Architect scalable data streaming and processing solutions to support healthcare data workflows. Develop, optimize, and maintain ETL/ELT pipelines for structured and unstructured healthcare data. Ensure data integrity, security, and compliance with healthcare regulations (HIPAA, HITRUST, etc.). Collaborate with data engineers, analysts, and business stakeholders to underst...