1569 Data Pipeline Jobs - Page 5

About Zywave Zywave is a global leader in building market-leading SaaS products that transform and disrupt the insurance industry. With our innovative solutions, we empower brokers and agencies with cutting-edge tools for client engagement, analytics, and growth. Our culture thrives on innovation, collaboration, and continuous improvement, and we are expanding our Product Development team to drive our next wave of growth. Job Title: Senior Software Engineer – Data Platform Location : Pune, India Work Mode: Hybrid Experience: 5 –10 years Company: Zywave About the Role Zywave is looking for a highly skilled Senior Software Engineer (Data Platform) to join our Data Engineering team. In this rol...

Role Proficiency: This role requires proficiency in data pipeline development including coding and testing data pipelines for ingesting wrangling transforming and joining data from various sources. Must be adept at using ETL tools such as Informatica Glue Databricks and DataProc with coding skills in Python PySpark and SQL. Works independently and demonstrates proficiency in at least one domain related to data with a solid understanding of SCD concepts and data warehousing principles. Outcomes: Collaborate closely with data analysts data scientists and other stakeholders to ensure data accessibility quality and security across various data sources.rnDesign develop and maintain data pipelines...

Job Description & Summary: A career within Data and Analytics services will provide you with the opportunity to help organisations uncover enterprise insights and drive business results using smarter data analytics. We focus on a collection of organisational technology capabilities, including business intelligence, data management, and data assurance that help our clients drive innovation, growth, and change within their organisations to keep up with the changing nature of customers and technology. We make impactful decisions by mixing mind and machine to leverage data, understand and navigate risk, and help our clients gain a competitive edge. Responsibilities: Position: Azure Data Engineer...

Salary: 15 to 25 LPA Exp: 4 to 7 years Location: Gurgaon/Pune/Bengalore Notice: Immediate to 30 days..!! Job Profile: Experienced Data Engineer with a strong foundation in designing, building, and maintaining scalable data pipelines and architectures. Skilled in transforming raw data into clean, structured formats for analytics and business intelligence. Proficient in modern data tools and technologies such as SQL, T-SQL, Python, Databricks, and cloud platforms (Azure). Adept at data wrangling, modeling, ETL/ELT development, and ensuring data quality, integrity, and security. Collaborative team player with a track record of enabling data-driven decision-making across business units. As a Dat...

Salary: 35 to 50 LPA Exp: 7 to 12 years Location: Gurgaon/Pune/Bengalore Notice: Immediate to 30 days..!! Job Profile: Experienced Data Engineer with a strong foundation in designing, building, and maintaining scalable data pipelines and architectures. Skilled in transforming raw data into clean, structured formats for analytics and business intelligence. Proficient in modern data tools and technologies such as SQL, T-SQL, Python, Databricks, and cloud platforms (Azure). Adept at data wrangling, modeling, ETL/ELT development, and ensuring data quality, integrity, and security. Collaborative team player with a track record of enabling data-driven decision-making across business units. As a Da...

Salary: 15 to 30 LPA Exp: 3 to 8 years Location : Gurgaon/Bangalore/Pune/Chennai Notice: Immediate to 30 days..!! Key Responsibilities & Skillsets: Common Skillsets : 3+ years of experience in analytics, Pyspark, Python, Spark, SQL and associated data engineering jobs. Must have experience with managing and transforming big data sets using pyspark, spark-scala, Numpy pandas Excellent communication & presentation skills Experience in managing Python codes and collaborating with customer on model evolution Good knowledge of data base management and Hadoop/Spark, SQL, HIVE, Python (expertise). Superior analytical and problem solving skills Should be able to work on a problem independently and p...

About Payoneer Founded in , Payoneer is the global financial platform that removes friction from doing business across borders, with a mission to connect the worlds underserved businesses to a rising global economy Were a community with over 2,500 colleagues all over the world, working to serve customers, and partners in over 190 countries and territories By taking the complexity out of the financial workflowsincluding everything from global payments and compliance to multi-currency and workforce management, to providing working capital and business intelligencewe give businesses the tools they need to work efficiently worldwide and grow with confidence We are looking for a Treasury Data Ana...

Role & responsibilities Solution Design & Architecture : Design end-to-end data pipelines and architectures on IICS & Databricks. Data Engineering & Development : Develop ETL/ELT processes to ingest, transform, and load data from various sources. Platform Management: Configure and manage Databricks clusters. Ensure compliance with data governance, security, and privacy regulations. Best Practices & Innovation : Stay updated with the latest IICS & Databricks features and industry trends. Required Skills & Qualifications: Technical Skills: Proficiency in IICS & Databricks and associated tools. Strong hands-on exposure with Unity Catalog Strong coding skills in Python, Scala, or SQL. Experience...

NOTE : Looking for the candidate, you started their career as a Data Engineer and currently working as a Delivery Manager Interested candidate please share your updated CVS to: pavanrai@mytechglobal.in Role & responsibilities Must Have Skills : Client Management, Leadership, Data Engineering, Project management, Presales, Strategic Planning, Telecom / Banking, Stakeholder Management, Delivery Management About the Role We are looking for an experienced Delivery Manager from an IT services background who can lead end-to-end delivery for large-scale data engineering programs. The ideal candidate should have strong exposure to the Telecom domain, with additional experience in Banking being an ad...

Provide technical leadership and hands on development across the full software development lifecycle from requirements gathering and solution design through to implementation, testing, deployment, and operations. Apply Lean and Agile principles to develop secure, scalable, and supportable solutions that adhere to organisational standards and engineering best practice. Collaborate with Solution Architects, Business Partners/Technical Domain Leaders, and Business Analysts to translate business needs into robust, integrated technology solutions. Champion best practices for data integration, code development, testing working closely with SRE and security teams. Apply Site Reliability Engineering...

As a candidate for the position at Gramener, you will be part of a dynamic environment that offers an inviting workplace with talented colleagues from diverse backgrounds. You will have the opportunity for career growth and steady prospects for innovation. Gramener aims to create easily configurable data applications focused on storytelling for both public and private use. **Roles and Responsibilities:** - Interested in solving complex business problems with the help of data and insights. - Experience a C-suite-focused business advisory role in data and analytics. - Contribute to transforming the business environment. - Possess excellent relationship-building and organizational skills. - Thr...

Job Summary We are seeking a skilled and innovative Data Processing Engineer to join our team. As a Data Processing Engineer, you will be responsible for the design, development and validation of software for Data Processing Engineering across both cloud and on-premises environments.. You will be responsible for contributing to the design, and development and testing of code. The software applications you build will be used by our internal product teams partners and customers. We are looking for a hands-on lead engineer who is familiar with Python, Spark, Scala and Java. Any cloud experience is an advantage. You should be passionate about learning, be creative and have the ability to work wi...

The role will be responsible for using statistical techniques and mathematical skills to provide actuarial support for product development, projection, product implementation, illustrations, valuation, and financial reporting. Key Responsibilities: • Working on implementing the solutions using appropriate actuarial / analytical tools & techniques • Perform and analyze projections for in-force investment assets • Analyze and provide fixes for the asset data received from various sources • Analyze interest rate scenarios , Investment expenses, Carrying out Gain/Loss analysis • Calculating the funding target, analyzing the funding shortfall and calculating the minimum required contributions to ...

About the Role: The charter of the Data + ML Platform team is to harness all the data that is ingested and cataloged within the Data LakeHouse for exploration, insights, model development, ML Engineering and Insights Activation. This team is situated within the larger Data Platform group, which serves as one of the core pillars of our company. We process data at a truly immense scale. Our processing is composed of various facets including threat events collected via telemetry data, associated metadata, along with IT asset information, contextual information about threat exposure based on additional processing, etc. These facets comprise the overall data platform, which is currently over 200 ...

Hiring Senior Fraud Analyst Location: Noida Package up to 14 LPA Key Accountabilities Manage day-to-day oversight of the portfolio, including team performance, operational efficiency, and achievement of departmental goals. Develop, implement, and maintain policies and procedures aligned with regulatory and compliance requirements. Identify, assess, and mitigate fraud and product risks while ensuring alignment with compliance and risk functions. Manage stakeholder relationships, including internal partners and external third-party service providers. Monitor financial performance of the portfolio, including revenue, profitability, and cost controls. Conduct market research to assess industry t...

We are hiring an AWS + Elasticsearch Data Engineer with strong experience in building scalable data pipelines and transformations. The role involves working on Medallion-style architecture , ETL frameworks , and DBT-based modeling to deliver analytics-ready datasets. You will collaborate with business teams as a technical advisor , so strong communication skills are essential. Key Responsibilities Design and manage data pipelines using AWS services (S3, Lambda, Glue) and orchestration tools. Implement Elasticsearch (ELK stack) for data indexing, query optimization, and cluster management. Develop ETL workflows and automate transformations using DBT . Apply data modeling and governance best p...

Responsibilities: Hands-on MS SQL, ETL , SSIS Hands-on experience on cloud side and migration exp from AWS and GCP Hands -on experience cloud data platform: Snowflake MS SQL Server, SQLServer Performance Tuning, ANSI SQL, SQL Server,Data Modeling, ETL,CI & CD

Description: We are seeking a highly skilled Python Data Engineer to design, build, and maintain scalable data pipelines and analytics solutions. The ideal candidate will have strong proficiency in Python, Pandas, NumPy, and AWS, along with hands-on experience in processing large datasets and optimizing data workflows in cloud environments. Requirements: Required Skills & Qualifications Proficient experience in Python for data engineering and backend processing Strong hands-on experience with Pandas and NumPy for data manipulation and analysis Solid experience with AWS, including services such as: S3 EC2 Lambda Glue Redshift / Athena Experience building and maintaining ETL pipelines Strong u...

Job Summary We are looking for a highly skilled and motivated Data Engineer to join our team. The ideal candidate will be responsible for designing building and maintaining scalable data infrastructure that drives business intelligence advanced analytics and machine learning initiatives. You must be comfortable working autonomously navigating complex challenges and driving projects to successful completion in a dynamic cloud environment. Responsibilities Cloud Platform Expertise (GCP Focus): Extensive hands-on experience working in dynamic cloud environments with a strong preference for Google Cloud Platform (GCP) services specifically: BigQuery: Expert-level skills in data ingestion perform...

Job Summary We are looking for a highly skilled and motivated Data Engineer to join our team. The ideal candidate will be responsible for designing building and maintaining scalable data infrastructure that drives business intelligence advanced analytics and machine learning initiatives. You must be comfortable working autonomously navigating complex challenges and driving projects to successful completion in a dynamic cloud environment. Responsibilities Design and Optimization: Design implement and optimize clean well-structured and performant analytical datasets to support high-volume reporting business analysis and data science model development. Pipeline Development: Architect build and ...

Barclaycard Payments is looking for Data Engineer SQL to join our team Design and implement data pipelines, data warehouses, and data lakes that manage appropriate data volumes and velocity. Develop processing and analysis algorithms fit for the intended data complexity and volumes. Collaborate with data scientists to build and deploy machine learning models. Lead and supervise a team, guiding professional development, allocating work requirements, and coordinating resources. Ensure all data is accurate, accessible, and secure. Perform prescribed activities timely and to a high standard, consistently driving continuous improvement. Job Requirements Hands-on experience in developing complex d...

Barclaycard Payments is looking for ETL Data Integration Designer to join our team Design and develop solutions to complex business problems, collaborating with stakeholders to understand their needs and requirements. Identify and implement technologies and platforms to meet business needs, balancing technology risks against business delivery. Develop standardized solutions where appropriate, feeding into their ongoing evolution if necessary. Collaborate closely with other functions/business divisions to achieve operational effectiveness. Lead a team performing complex tasks, using well-developed professional knowledge and skills to deliver work that impacts the whole business function. Set ...

Lead the transformation of our self-serve analytics platform by introducing new metrics and drill downs to assist with self-serve diagnostics at scale. Utilize technology to address new problem areas with segmentation analysis, recommender systems, and GenAI applications. Build self-serve tooling and dashboarding to enable data-driven decision making across the organization at scale. Collaborate on in-depth analytical projects, uncover insights, and evaluate headroom to drive product enhancements which improve our developer experience. Design, execute, and analyze experiments to evaluate growth levers and regional launches. Surface insights around emerging markets (India and other APAC count...

Overview Our team is responsible for building and maintaining the Fund ESG Ratings platform, a business-critical component that powers MSCI’s ESG offerings at the fund level. We manage the end-to-end lifecycle of fund-level ESG data—from ingestion, transformation, and scoring, to final delivery to internal consumers and external clients. Key responsibilities of the team include: Designing scalable data pipelines using Databricks, PySpark, and BigQuery. Supporting regulatory-compliant ESG scoring and reporting logic. Partnering with ESG Research and Index teams to translate methodology changes into platform features. Ensuring data quality, platform stability, and SLA adherence. Driving automa...

You will play a key role in designing, developing, and maintaining robust and scalable ETL (Extract, Transform, Load) data pipelines. The role involves working with various Azure services, implementing data ingestion and transformation logic, and ensuring data quality and consistency across systems. What we're looking for: 46 years of hands-on experience in Python, SQL for backend or data engineering projects. Strong understanding and working experience with Azure Data services (especially Azure Data Factory, Azure Databricks, and Synapse Analytics ). Solid understanding of data pipeline architecture, data integration, and transformation techniques. Experience in working with version control...