6525 Data Engineering Jobs - Page 27

Role Overview: As a Manager of Pricing Operations & Analytics, you will be responsible for owning and leading the day-to-day global pricing operations to ensure SLA commitments, delivery consistency, and continuous improvement. You will act as a hands-on Data and QA Engineering lead, monitoring and validating pricing data quality, trends, and anomalies. Additionally, you will build and manage QA workflows to ensure end-to-end accuracy of pricing data, models, and tools. Your role will involve leading, mentoring, and coaching team members to develop analytical rigor, data quality accountability, and process maturity. Collaboration with product, engineering, automation, and data science teams ...

Job Description As a Data Analyst/Engineer at SCG in India, you will play a crucial role in transforming raw data into actionable insights that drive business growth, enhance operational efficiency, and increase customer value. Key Responsibilities - Collect, clean, and analyze data from various sources such as sales, supply chain, and operations. - Develop dashboards and reports to facilitate decision-making processes. - Identify patterns, trends, and opportunities for improvement within the data. - Collaborate effectively with cross-functional teams to establish key performance indicators (KPIs) and metrics. - Ensure compliance with data governance standards and maintain proper documentati...

Role Overview: As a Principal Engineer, Software - Accounting Tech, you will play a crucial role in shaping the next-generation financial data architecture within the Accounting & Finance Technology domain. Your focus will be on leveraging Snowflake, dbt, and modern data engineering practices to develop scalable, trusted, and cost-optimized financial data solutions. By partnering closely with Finance and Accounting stakeholders, you will be responsible for transforming complex business requirements into robust financial systems that drive insights, compliance, and long-term growth. Key Responsibilities: - Architect & Lead Snowflake Solutions: Drive the design and implementation of enterprise...

Role Overview: In this role at Kimberly-Clark, you will play a pivotal part in designing and building analytics solutions to facilitate informed decision-making. Your primary responsibility will be to design, develop, and maintain analytics solutions working closely with various R&D and DTS technology teams. By leveraging your professional expertise and talent, you will contribute to delivering better care for billions of people worldwide. Key Responsibilities: - Collaborate with engineering and architecture teams to identify, collect, and harmonize data from various sources. - Design and develop ETL (Extract, Transform, Load) and ELT (Extract, Load, Transform) pipelines using technologies s...

Greetings!!! Role : Senior Data Engineer with GCP, ETL Location- 100 % Remote Exp Range- 4+ Yrs Notice Period- Immediate Joiners only. Duration- 4 months Contract Time: 11 am to 8 pm IST Must have skills: 1. GCP - GCS, PubSub, Dataflow or DataProc, Bigquery, Airflow/Composer, Python(preferred)/Java 2. ETL on GCP Cloud - Build pipelines (Python/Java) + Scripting, Best Practices, Challenges 3. Knowledge of Batch and Streaming data ingestion, build End to Data pipelines on GCP 4. Knowledge of Databases (SQL, NoSQL), On-Premise and On-Cloud, SQL vs No SQL, Types of No-SQL DB (At least 2 databases) 5. Data Warehouse concepts - Beginner to Intermediate level If you are interested , please share yo...

As an experienced Data Engineer, you will be responsible for designing and implementing high-performance data ingestion pipelines using technologies like Databricks. Your key responsibilities will include: - Developing scalable and reusable frameworks for ingesting, processing, and enriching datasets using Databricks. - Integrating end-to-end data pipelines to ensure efficient transportation of data from various source systems to target data stores. - Implementing data ingestion and ETL processes on Databricks, leveraging technologies such as Spark, Delta Lake, and MLflow. - Utilizing expertise in Spark, SQL, Python, and Scala for data processing and analytics on Databricks. - Collaborating ...

Develop Python solutions using OOP, functional programming, and data structure Implement REST APIs and work with SQL, RDBMS, NoSQL, and data lake formats. Deliver agile, API-driven data platforms with strong hands-on development.

Role Overview: You will be a part of the Data and Analytics (D&A) team at EY as a Senior Data Scientist. With a minimum of 3-7 years of experience in Data Science and Machine Learning, you will be involved in developing and implementing AI solutions, particularly focusing on NLP, Generative AI, LLMs, MLOps, Optimization techniques, and AI solution Architecture. Your role will be crucial in leveraging your technical expertise to contribute to cutting-edge AI models and systems. Responsibilities: - Contribute to the design and implementation of state-of-the-art AI solutions. - Assist in the development and implementation of AI models and systems, utilizing techniques such as Language Models (L...

As an Oil and Gas Upstream Consultant at EY, you will be a key player in driving the growth of Business and Technology Consulting services for the Oil & Gas and Renewables sector worldwide. Your expertise in the Energy industry, particularly in Upstream Data Management and/or ESG domains, will be crucial for the success of our initiatives. Here's a breakdown of what will be expected from you: **Role Overview:** You will work closely with global Oil & Gas leaders and internal consulting teams to develop deep knowledge of the market and industry trends. Your responsibilities will include leading and delivering projects, developing capabilities and offerings relevant to client needs, and drivin...

As a Backend Engineer at an AI Startup based in Bangalore, you will be part of a team that is revolutionizing the finance industry with AI-powered solutions. The company is on a mission to create an AI-powered finance team that can perform tasks such as closing books, reconciling cash, forecasting revenue, and preparing board decks in a real-time and auditable manner. The AI agents developed by the company are designed to seamlessly integrate with existing finance systems, delivering accurate outputs without the need for system migrations. Your role as a Backend Engineer will involve: - Contributing to the development of reasoning agents that can work with fragmented data - Orchestrating wor...

Why Choose Decision Point At Decision Point , we are passionate about transforming how global organizations harness data for smarter, faster decision-making. As a fast-growing analytics consulting firm, we combine cutting-edge technologies, robust data engineering practices, and deep industry expertise to deliver impactful solutions. Joining Decision Point means becoming part of a collaborative, forward-thinking environment where youll work with top talent, solve complex problems, and contribute to building scalable, cloud-based data platforms that drive business outcomes. Key Responsibilities Manage end-to-end delivery of data engineering and analytics projects , ensuring alignment with bus...

Introduction to the Role: Are you passionate about building intelligent systems that learn, adapt, and deliver real-world value? Join our high-impact AI & Machine Learning Engineering team and be a key contributor in shaping the next generation of intelligent applications. As an AI/ML Engineer , youll have the unique opportunity to develop, deploy, and scale advanced ML and Generative AI (GenAI) solutions in production environments, leveraging cutting-edge technologies, frameworks, and cloud platforms . In this role, you will collaborate with cross-functional teams including data engineers, product managers, MLOps engineers, and architects to design and implement production-grade AI solution...

Why Choose Decision Point At Decision Point , we empower data-driven transformation by delivering innovative, scalable, and future-ready analytics solutions. With a proven track record in the CPG, Retail, and Manufacturing industries, we combine deep domain expertise with cutting-edge technologies to enable smarter decisions at every level of the enterprise. By joining our team, youll be part of a collaborative culture that values creativity, learning, and continuous improvement. We offer opportunities to work on high-impact projects with global clients, and leverage the latest cloud and data engineering tools to solve real-world business challenges. Key Responsibilities Design, develop, and...

Position Overview We are seeking a highly skilled and motivated Big Data Engineer to join our dynamic team in either Mumbai City or Bangalore . As a Big Data Engineer, you will play a crucial role in designing, developing, and maintaining scalable data processing systems that enable our organization to harness the power of big data. With an annual salary of 26,00,000 , this full-time position offers an exciting opportunity to work with cutting-edge technologies in a collaborative environment. Key Responsibilities Design and implement robust big data solutions using technologies such as Hadoop, Spark, and Apache Spark. Develop and maintain data pipelines to ensure efficient data processing an...

Job Title: DBT Developer - Pune About Us Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 by Avtar & Seramount. With our presence across 32 cities across globe, we support 100+ clients across banking, financial and Energy sectors. We are recognized for our deep transformation execution and delivery. WHY JOIN CAPCO? You will work on engaging projects with the largest international and local banks, insurance companies, payment service providers and other key players in the industry. The projects that will transform the financial service...

Experience in developing modern Data platform, data lake Experience in development of large-scale enterprise data warehouse and data lake solution. Maintain robust data catalogue Manage Azure cloud platform for Data and Analytics Immediate to 15 Days

Requirements: • 4+ Years Microsoft BI Stack (SSIS, SSRS, SSAS) • 4+ Years data engineering experience to include data analysis. • 4+ years programming SQL objects (procedures, triggers, views, functions) in SQL Server. • Experience optimizing SQL queries. • Advanced understanding of T-SQL, indexes, stored procedures, triggers, functions, views, etc. • Experience designing and implementing Data Warehouse. • Working Knowledge of Azure/AWS Architecture, Data Lake • Must be detail oriented. Must work under limited supervision. Must demonstrate good analytical skills as it relates to data identification and mapping and excellent oral communication skills. • Must be flexible and able to multi-task...

Responsibilities: Collaborate with business stakeholders to understand and refine data-related questions and requirements Utilize advanced analytics to uncover hidden insights in large datasets and provide actionable recommendations. Design and implement data models and algorithms to support data-driven decision making. Investigate internal and external data sources to determine availability, quality, and relevance Identify, collect, and analyze relevant data needed to address specific business challenges Propose solutions to close data gaps. Define data structures, formats, and transformation logic needed to support reporting and analytics. Leverage data science techniques to uncover trends...

Job description Develop EL/ELT/ETL pipelines to make data available in BigQuery analytical data store from disparate batch, streaming data sources for the Business Intelligence and Analytics teams. • Hands on experience in Pyspark needed - Data Engineer role. • Work with on-prem data sources (Hadoop, SQL Server), understand the data model, business rules behind the data and build data pipelines (with GCP, Informatica) for one or more business verticals. This data will be landed in GCP Big Query. • Build cloud-native services and APIs to support and expose data-driven solutions. • Partner closely with our data scientists to ensure the right data is made available in a timely manner to deliver...

We have developed API gateway aggregators using frameworks like Hystrix and spring-cloud-gateway for circuit breaking and parallel processing. Our serving microservices handle more than 15K RPS on normal days and during saledays this can go to 30K RPS. Being a consumer app, these systems have SLAs of ~10ms Our distributed scheduler tracks more than 50 million shipments periodically fromdifferent partners and does async processing involving RDBMS. We use an in-house video streaming platform to support a wide variety of devices and networks. What Youll Do Design and implement scalable and fault-tolerant data pipelines (batch and streaming) using frameworks like Apache Spark , Flink , and Kafka...

Leading data domain projects. Managing multiple projects at a time. Managing team of Data Engineering professionals Required education Master's Degree Preferred education Master's Degree Required technical and professional expertise Overall 10-12 years of exp along with end to end Project Delivery experience Should have good communication skill with direct client handling experience Should have knowledge in managing multiple project at a time. Good Exposure of On-Prem to Cloud data migration. Proactive leader with good communication skills Preferred technical and professional experience Experience in insurance or financial services good to have

At Capgemini Invent, we believe difference drives change. As inventive transformation consultants, we blend our strategic, creative and scientific capabilities,collaborating closely with clients to deliver cutting-edge solutions. Join us to drive transformation tailored to our client"s challenges of today and tomorrow.Informed and validated by science and data. Superpowered by creativity and design. All underpinned by technology created with purpose. Your Role Design and develop generative AI-based multi-agent systems that can collaborate, communicate, and coordinate to achieve complex objectives Architect and implement RAG-based chatbot solutions that effectively leverage knowledge bases an...

Role Purpose The purpose of the role is to support process delivery by ensuring daily performance of the Production Specialists, resolve technical escalations and develop technical capability within the Production Specialists. Do Oversee and support process by reviewing daily transactions on performance parameters Review performance dashboard and the scores for the team Support the team in improving performance parameters by providing technical support and process guidance Record, track, and document all queries received, problem-solving steps taken and total successful and unsuccessful resolutions Ensure standard processes and procedures are followed to resolve all client queries Resolve cl...

JD : KAfka: Design and develop Kafka/Kafka connectors data pipelines and integration solutions. Implement and manage Kafka producers, consumers, topics, and partitions. Integrate Kafka with external systems (e.g., databases, APIs, cloud services). Optimize Kafka performance for throughput, latency, and reliability. Collaborate with DevOps, data engineering, and application teams. Monitor and troubleshoot Kafka clusters and streaming applications. Ensure data security, compliance, and governance in Kafka implementations. Maintain documentation for Kafka configurations, schemas, and processes. Mandatory Skills: Kafka Integration. Experience: 5-8 Years.

Role Purpose The purpose of this role is to design, test and maintain software programs for operating systems or applications which needs to be deployed at a client end and ensure its meet 100% quality assurance parameters Do 1. Instrumental in understanding the requirements and design of the product/ software Develop software solutions by studying information needs, studying systems flow, data usage and work processes Investigating problem areas followed by the software development life cycle Facilitate root cause analysis of the system issues and problem statement Identify ideas to improve system performance and impact availability Analyze client requirements and convert requirements to fe...