1135 Etl Pipelines Jobs - Page 2

Designation Senior Associate | Lead | Manager – Data Engineering Location – Gurugram | Hyderabad | Noida | Pune Job Requirement: 8+ years of experience in data management. Proven hands-on experience with ETL processes Candidate must have extensive hands-on experience with Pyspark/Python and a strong background in ETL jobs / processes. Strong expertise in data governance, data catalog, data quality frameworks, business rules implementation, data profiling, data ingestion, data processing and data integration. Prior experience in the Life Sciences industry is a plus. Strong understanding of data governance principles and best practices. Experience with data profiling, data quality management, ...

At Capgemini Engineering, the world leader in engineering services, we bring together a global team of engineers, scientists, and architects to help the world's most?innovative companies unleash their potential. From autonomous cars to life-saving robots, our digital and software technology experts think outside the box as they?provide unique R&D and engineering services across all industries. Join us for a career full of opportunities. Where you can make a difference. Where no two days are?the same. Your Role 5+ yrs of total IT experience and 4+ yrs of relevant experience as Azure Data Engineer and having good hands-on experience on Azure Data Factory, Azure Databricks, Python, Azure Synaps...

Join us as a Quality Automation Specialist In this key role, youll be undertaking and enabling automated testing activities in all delivery models Well look to you to support teams to develop quality solutions and enable continuous integration and assurance of defect free deployment of customer value Youll be working closely with feature teams and a variety of stakeholders, giving you great exposure to professional development opportunities We're offering this role at associate vice president level What you'll do Joining us in a highly collaborative role, youll be contributing to the transformation of testing using quality processes, tools, and methodologies, significantly improving control,...

Role & responsibilities : Data Pipeline Development & Management Design and implement robust, scalable ETL/ELT pipelines using Databricks and Apache Spark Process large volumes of structured and unstructured data Develop and maintain data workflows using Databricks workflows, Apache Airflow, or similar orchestration tools Optimize data processing jobs for performance, cost efficiency, and reliability Implement incremental data processing patterns and change data capture (CDC) mechanisms Databricks Platform Engineering Build and maintain Delta Lake tables and implement medallion architecture (bronze, silver, gold layers) Develop streaming data pipelines using Structured Streaming and Delta Li...

As an AI/ML Engineer at Disruptive Tech Solutions, you will play a crucial role in designing and deploying predictive microservices and machine learning pipelines for PropTech analytics. Your responsibilities will include: - Build predictive models for various purposes such as tenant churn and rent optimization, and expose them via REST APIs. - Design ETL pipelines to handle structured and IoT data efficiently, utilizing tools like Databricks and Azure Synapse. - Implement automation for model validation, retraining, and A/B testing following MLOps best practices. - Develop visual analytics dashboards using Angular, Highcharts, and Power BI to provide insights from the generated models. - Co...

In this role at PwC, you will focus on leveraging data and analytics to provide strategic insights and drive informed decision-making for clients. You will develop and implement innovative solutions to optimize business performance and enhance competitive advantage. As part of the Business Intelligence team, your responsibilities will include designing, building, and maintaining scalable ETL pipelines and data solutions. You will analyze complex data sets, collaborate with cross-functional teams, and promote data quality while enhancing your technical capabilities. Key Responsibilities: - 3-5 years experience in marketing analytics, data analysis, or business intelligence, preferably in a ma...

Who We Are Addepar is a global technology and data company that helps investment professionals provide the most informed, precise guidance for their clients. Hundreds of thousands of users have entrusted Addepar to empower smarter investment decisions and better advice over the last decade. With client presence in more than 50 countries, Addepar's platform aggregates portfolio, market and client data for over $8 trillion in assets. Addepar's open platform integrates with more than 100 software, data and services partners to deliver a complete solution for a wide range of firms and use cases. Addepar embraces a global flexible workforce model with offices in New York City, Salt Lake City, Chi...

Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : DevOps Good to have skills : NAMinimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a DevOps Engineer, you will be responsible for solutioning end to end dev-ops architecture and suggesting tool for AWS, build automations, ETL pipelines, code quality & security. A typical day involves utilizing your expertise in continuous in...

As a Data Engineer at IBM, you'll play a vital role in the development, design of application, provide regular support/guidance to project teams on complex coding, issue resolution and execution. Your primary responsibilities include: Lead the design and construction of new solutions using the latest technologies, always looking to add business value and meet user requirements. Strive for continuous improvements by testing the build solution and working under an agile framework. Discover and implement the latest technologies trends to maximize and build creative solutions Required education Bachelor's Degree Preferred education Master's Degree Required technical and professional expertise Ex...

Description Job Summary The Data Scientist, D&T will be part of a multidisciplinary team responsible for designing and developing innovative data-driven analytical solutions. This role will leverage advanced analytics, Machine Learning, NLP, Computer Vision, and Generative AI to address complex business challenges and deliver measurable value. Essential Duties And Responsibilities Partner with stakeholders across functions to uncover and prioritize use cases where ML, statistical modeling, or GenAI/Agentic AI solutions can create business impact. Lead end-to-end model/agent lifecycles: from problem definition, data exploration, feature engineering, and model/agent design to deployment, monit...

Description Roles & Responsibilities : We are looking for a Data Engineering who will be majorly responsible for building and maintaining ETL/ ELT pipelines. You are expected to build and manage Data warehouse solutions, data models, creating ETL processes, implementing data quality checks etc. Support data enablement across applications and build Data Quality enhancements. Responsible for performing EDA (exploratory data analysis), troubleshoot data related issues, integrating various data sets etc. Required Technical Skills Extensive experience in Python, Pyspark, SQL. Strong experience in Data Warehouse, ETL, Data Modelling, ETL Pipelines, Snowflake database. Must be proficient in Databri...

Description Have you ever ordered a product from Amazon and been amazed at how fast it gets to you Every day Amazon engineers are relentlessly working to decrease the time between Click to Deliver for your products. The Amazon Fulfillment Technologies (AFT) team owns all of the software and infrastructure which powers Amazon's world-class fulfillment engine. Our team is building complex, massive data systems to capture data during every step in the automated pipeline and use that data to proactively predict efficiency and cost improvements to deliver the packages fast to our customers. As an Amazon.com Big Data Engineer you will be working in one of the world's largest and most complex data ...

Description Amazon strives to be Earth's most customer-centric company where people can find and discover virtually anything they want to buy online. By giving customers more of what they want - low prices, vast selection, and convenience - Amazon continues to grow and evolve as a world-class e-commerce platform.The competitive pricing team is responsible for ensuring that we earn and keep our customer trust around our low prices. This involves ensuring for all the products that are sold on Amazon marketplaces worldwide, customers get the best price. Data engineering team - a part of pricing Big Data team - is responsible for building and maintaining the data platform that helps Amazon busin...

Your Role 5+ yrs of total IT experience and 4+ yrs of relevant experience as Azure Data Engineer and having good hands-on experience on Azure Data Factory, Azure Databricks, Python, Azure Synapse, Azure Data Lake, PySpark, SQL Server and Power BI. Knowledge in design of Extract, Transform and Load environment using Data bricks, Spark Azure Data Factory (ADF). Setting Up Microsoft Azure with Data bricks, Data bricks Workspace for Business Analytics, Manage Clusters in Data bricks. Hands on experience Data extraction (extract, Schemas, corrupt record handling and parallelized code), transformations and loads (user defined functions, join optimizations) and Production (optimize and automate Ext...

TCS has been a great pioneer in feeding the fire of Young Techies like you. We are a global leader in the technology arena and there's nothing that can stop us from growing together. TCS Hiring for GCP AI/ML Experience Range: 04 To 10 Yrs Job Locations : Chennai, Gandhinagar, Bangalore Job Description: Experience : Associate should have 3+ years of IT experience with good exposure into diagnosis and troubleshooting the complex issues . Technologies : IData Ingestion & ETL Pipelines,Dataflow/Dataproc/Pub/Sub,datasets ,Vertex AI, BigQuery ,Python, CI/CD for ML ,Containerization,Proficiency in T ensorFlow, Understanding of LLMs/Transformer,Prompt Engineering Must Have : Good communication custo...

TCS HIRING!! TCS is hiring for skill Data Solution Architect at TCS PAN INDIA LOCATION Exp Req:10+ yrs JD Design and manage ETL pipelines on cloud platforms (preference for AWS) Utilize tools like Airflow to orchestrate tasks and Cloud Watch to manage notifications Collaborate with cross-functional teams to enhance data-driven decision making, ensuring alignment of machine learning projects with our strategic business goals Develop containerized applications to improve data accuracy, accessibility, and reliability through customized Python solutions Contribute to data governance workflow, improving data quality, standardizing definitions, training, and onboarding data stewards to own their t...

Project description Our client is an EU subsidiary of a Global Financial Bank working in multiple markets and asset classes DWH / ETL developer will work closely with the Development Lead to design, build interfaces and integrate data from a variety from internal and external data sources into the new Enterprise Data Warehouse environment The ETL Developer will be responsible for developing ETL primarily utilizing Microsoft & Azure technologies within industry recognized ETL standards, architecture, and best practices Responsibilities Act as a technical expert in the designing, coding, unit testing, supporting, and debugging of data warehouse software components in all aspects of SDLC Apply ...

Position: ETL Developer Location : Hyderabad Experience : 3-5 years Mail: meenakshi@beanhr.com Are you passionate about building scalable data pipelines and enabling data-driven decision-making? Were looking for a skilled ETL Developer to join our team in Hyderabad. What youll do: Design, develop, and optimize ETL workflows (SSIS, Azure Data Factory) Integrate data from APIs, ERP, CRM, IoT, and cloud sources Transform, cleanse, and enrich raw data for analytics & BI Load data into modern warehouses (Snowflake, Redshift, BigQuery, Synapse) and data lakes Collaborate with analysts & business users to deliver reliable insights What were looking for: 3-5 years of ETL development/data engineering...

About The Role Project Role : Business Architect Project Role Description : Identify opportunities to deliver tangible business value by assessing the current state, capturing high-level requirements, and defining business solutions. Translate business needs into technology-enabled solutions and operating models. Support transformation by developing business cases and guiding implementation of key initiatives. Must have skills : Business Requirements Analysis Good to have skills : NA Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Business Architect, you will identify opportunities to deliver tangible business value by asse...

About The Role Project Role : Web Developer Project Role Description : Design, build and test web-based applications for various site components and edit site content. Document technical designs and specifications. Research and incorporate updated content for websites. Must have skills : Oracle Hyperion Technical Architecture Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary The Oracle Hyperion Technical Architect is responsible for defining and governing the end-to-end technical architecture of Oracle Hyperion EPM environments. This role provides strategic direction, solution design, and technical leadership...

Your role and responsibilities We are seeking a skilled and experienced Cognos TM1 Developer with a strong background in ETL processes and Python development. The ideal candidate will be responsible for designing, developing, and supporting TM1 solutions, integrating data pipelines, and automating processes using Python. This role requires strong problem-solving skills, business acumen, and the ability to work collaboratively with cross-functional teams Required education Bachelor's Degree Preferred education Master's Degree Required technical and professional expertise 8+ years of hands-on experience with IBM Cognos TM1 / Planning Analytics. Strong knowledge of TI processes, rules, dimensio...

Your role and responsibilities We are seeking a skilled and experienced Cognos TM1 Developer with a strong background in ETL processes and Python development. The ideal candidate will be responsible for designing, developing, and supporting TM1 solutions, integrating data pipelines, and automating processes using Python. This role requires strong problem-solving skills, business acumen, and the ability to work collaboratively with cross-functional teams Required education Bachelor's Degree Preferred education Master's Degree Required technical and professional expertise 4+ years of hands-on experience with IBM Cognos TM1 / Planning Analytics. Strong knowledge of TI processes, rules, dimensio...

Position: AI/ML Developer / Data Scientist Location: Hyderabad (On-site, Mandatory) Experience: 3+ years Communication: Strong verbal & written skills required Role Summary We are looking for a skilled professional with a strong mix of AI/ML development and Data Science expertise . The role involves designing and deploying intelligent solutions, building predictive models, and managing large-scale data workflows. Key Responsibilities Develop and deploy AI/ML models for real-world applications Build and optimize ETL pipelines and data workflows Work on Generative AI, Agentic AI (preferred) Perform data analysis, visualization , and model fine-tuning Collaborate with cross-functional teams for...

Supply Chain & Manufacturing Team at ZS The Supply Chain & Manufacturing team at ZS is dedicated to optimizing and transforming supply chain operations for our clients across various industries. Out team offers a comprehensive range of services from stragegy and advanced analytics to planning and technology, aimed at optimizing resource deployment while maintaining high customer service levels. We are committed to driving innvotation and efficiency through cutting-edge solutions that address the complex challenges of supply chain and manufacturing operations. What youll do: Lead the technical team consisting of Developers, Senior Engineers, etc. to solve the business problems and lead end to...

As a Data Engineer at IBM, you'll play a vital role in the development, design of application, provide regular support/guidance to project teams on complex coding, issue resolution and execution. Your primary responsibilities include: Lead the design and construction of new solutions using the latest technologies, always looking to add business value and meet user requirements. Strive for continuous improvements by testing the build solution and working under an agile framework. Discover and implement the latest technologies trends to maximize and build creative solutions Required education Bachelor's Degree Required technical and professional expertise Experience with Apache Spark (PySpark)...