757 Data Pipelines Jobs - Page 24

You are a Software Engineer (Data SaaS Product) who will be responsible for building robust and scalable systems, with the flexibility to work on UI or scraping tasks when necessary. You should have at least 2 years of experience in either product development or data engineering. ReactJS or UI experience and the ability to build data pipelines from scratch are advantageous but not mandatory. Your willingness to learn and contribute where needed is valued more than having expertise in every area. In this role, you will own and enhance the full stack of data pipelines, from ingestion to processing to delivery. You will design, develop, and manage scalable data infrastructure in a cloud environ...

As a Lead Data Engineer specializing in Databricks, you will play a crucial role in designing, developing, and optimizing our next-generation data platform. Your responsibilities will include leading a team of data engineers, offering technical guidance, mentorship, and ensuring the scalability and high performance of data solutions. You will be expected to lead the design, development, and implementation of scalable and reliable data pipelines using Databricks, Spark, and other relevant technologies. It will also be part of your role to define and enforce data engineering best practices, coding standards, and architectural patterns. Additionally, providing technical guidance and mentorship ...

The team you would be joining focuses on end-to-end development of features for a major Technology company. This project involves collaboration with various teams working on different aspects of the search features development process. In this role, your responsibilities will include extracting data from external websites using Python and other internal applications, and then ingesting this data into the Client's databases. You will also be involved in Data Modelling, Schema Creation/Maintenance, and creating and maintaining data pipelines using internal applications with a focus on Python. Furthermore, you will engage in tasks such as data analysis, data visualization, creating SQL reports,...

Key Responsibilities: Data Analysis & Interpretation : Analyze large datasets to uncover trends, patterns, and insights that support business objectives. Perform statistical analysis and data cleaning to ensure data quality and integrity. Translate complex data findings into clear, actionable insights for business stakeholders. Machine Learning & Predictive Modeling : Build and deploy machine learning models to predict future trends or outcomes. Work with supervised and unsupervised learning techniques to solve complex business problems. Fine-tune models for optimization , and improve model accuracy over time. Data Visualization & Reporting : Develop interactive data visualizations using too...

We are looking for Senior Software Engineer Data Engineer (AI Solutions) , You'll make an impact by Design, build, and maintain data pipelines that serve the needs of multiple stakeholders including software developers, data scientists, analysts, and business teams. Ensure data pipelines are modular, resilient, and optimized for performance and low maintenance. Collaborate with AI/ML teams to support training, inference, and monitoring needs through structured data delivery. Implement ETL/ELT workflows for structured, semi-structured, and unstructured data using cloud-native tools. Work with large-scale data lakes, streaming platforms, and batch processing systems to ingest and transform dat...

At PwC, our team in managed services specializes in providing outsourced solutions and supporting clients across various functions. We help organizations enhance their operations, reduce costs, and boost efficiency by managing key processes and functions on their behalf. Our expertise lies in project management, technology, and process optimization, allowing us to deliver high-quality services to our clients. In managed service management and strategy at PwC, the focus is on transitioning and running services, managing delivery teams, programs, commercials, performance, and delivery risk. Your role will involve continuous improvement and optimization of managed services processes, tools, and...

We are seeking a highly skilled AI/ML Engineer to join our team. As an AI/ML Engineer, you will be responsible for designing, implementing, and optimizing machine learning solutions, encompassing traditional models, deep learning architectures, and generative AI systems. Your role will involve collaborating with data engineers and cross-functional teams to create scalable, ethical, and high-performance AI/ML solutions that contribute to business growth. Your key responsibilities will include developing, implementing, and optimizing AI/ML models using both traditional machine learning and deep learning techniques. You will also design and deploy generative AI models for innovative business ap...

The company Exela, a global leader in business process automation (BPA), is seeking a skilled Python Developer with a strong programming background and a fundamental understanding of AI concepts. The ideal candidate will be responsible for designing, developing, testing, and maintaining Python applications and services. They will also collaborate with data teams on integration and automation tasks. Key Responsibilities: - Design, develop, test, and maintain Python applications and services - Utilize REST APIs, data pipelines, and automation scripts - Work on LLM integration, LangGraph, LangChain, preprocessing, and reporting - Write clean, maintainable, and efficient code - Conduct unit test...

You will be joining our data engineering team as an experienced Python + Databricks Developer. Your role will involve designing, developing, and maintaining scalable data pipelines using Databricks and Apache Spark. You will write efficient Python code for data transformation, cleansing, and analytics. Collaboration with data scientists, analysts, and engineers to understand data needs and deliver high-performance solutions is a key part of this role. Additionally, you will optimize and tune data pipelines for performance and cost efficiency and implement data validation, quality checks, and monitoring. Working with cloud platforms, preferably Azure or AWS, to manage data workflows will also...

Myers-Holum is expanding the NSAW Practice and is actively seeking experienced Enterprise Architects with strong end-to-end data warehousing and business intelligence experience to play a pivotal role leading client engagements on this team. As an Enterprise Architect specializing in Data Integration and Business Intelligence, you will be responsible for leading the strategic design, architecture, and implementation of enterprise data solutions to ensure alignment with clients" long-term business goals. You will have the opportunity to develop and promote architectural visions for data integration, Business Intelligence (BI), and analytics solutions across various business functions and appl...

Ensure data is cleansed, mapped, transformed, and optimized for storage and use based on business and technical requirements Design solutions using Microsoft Azure services and related tools Automate tasks and deploy production-standard code with unit testing, continuous integration, and version control Load transformed data into storage and reporting structures such as data warehouses, high-speed indexes, real-time reporting systems, and analytics platforms Build and manage data pipelines to consolidate and unify data Extract data, troubleshoot issues, and maintain the data warehouse

You should have a Bachelors degree in computer science or data analytics along with at least 2 years of professional software development experience. You should be comfortable working in a collaborative, agile development environment and have proven experience in using data to drive insights and influence business decisions. Strong expertise in Python for solving data analytics-related challenges is essential. Additionally, hands-on experience with data visualization tools such as Matplotlib, Tableau, PowerBI, or similar is required. A solid understanding of data pipelines, analysis workflows, and process automation is also necessary. Strong problem-solving skills and the ability to work in ...

You have a total of 4-6 years of development/design experience with a minimum of 3 years experience in Big Data technologies on-prem and on cloud. You should be proficient in Snowflake and possess strong SQL programming skills. Your role will require strong experience with data modeling and schema design, as well as extensive experience in using Data warehousing tools like Snowflake/BigQuery/RedShift and BI Tools like Tableau/QuickSight/PowerBI (at least one must be a must-have). You must also have experience with orchestration tools like Airflow and transformation tool DBT. Your responsibilities will include implementing ETL/ELT processes and building data pipelines, workflow management, jo...

As a Data Engineering Manager at GoKwik, you will have the exciting opportunity to lead a team of data engineers and collaborate closely with product managers, data scientists, business intelligence teams, and SDEs to design and implement data-driven strategies across the organization. You will be responsible for designing the overall data architecture that drives valuable insights for the company. Your key responsibilities will include leading and guiding the data engineering team in developing optimal data strategies according to business needs, identifying and implementing process improvements to enhance data models, architectures, pipelines, and applications, ensuring data optimization p...

You are hiring for the role of AVP - Databricks with a requirement of minimum 14+ years of experience. The job location can be in Bangalore, Hyderabad, NCR, Kolkata, Mumbai, or Pune. As an AVP - Databricks, your responsibilities will include leading and managing Databricks-based project delivery to ensure that all solutions meet client requirements, best practices, and industry standards. You will serve as a subject matter expert (SME) on Databricks, providing guidance to teams on architecture, implementation, and optimization. Collaboration with architects and engineers to design optimal solutions for data processing, analytics, and machine learning workloads will also be part of your role....

Join us as a Data Engineer, VP with the leading MNC in Banking Domain. You will be the voice of our customers, using data to tell their stories and put them at the heart of all decision-making. We will look to you to drive the build of effortless, digital-first customer experiences. If you are ready for a new challenge and want to make a far-reaching impact through your work, this could be the opportunity you are looking for. As a Data Engineer, you will simplify our organization by developing innovative data-driven solutions through data pipelines, modeling, and ETL design. You will inspire to be commercially successful while keeping our customers and the bank's data safe and secure. Your r...

As an Artificial Intelligence Specialist at Gen AI, you will be responsible for driving customer conversations, understanding customer requirements, creating Gen AI solution architectures, and developing customer proposals and RFP responses. You will guide solution engineers in creating Gen AI POCs and solutions for various industry verticals. Your role will involve staying updated on the latest technology developments, industry best practices, and incorporating them into Gen AI applications. Additionally, you will design and deploy Proof of Concepts (POCs) and Points of View (POVs) across different industry verticals to showcase the potential of Generative AI applications. To qualify for th...

You are a Senior Data Engineer with expertise in constructing scalable data pipelines utilizing Microsoft Fabric. Your primary responsibilities will involve developing and managing data pipelines through Microsoft Fabric Data Factory and OneLake. You will be tasked with designing and creating ingestion and transformation pipelines for both structured and unstructured data. It will be your responsibility to establish frameworks for metadata tagging, version control, and batch tracking to ensure the security, quality, and compliance of data pipelines. Additionally, you will play a crucial role in contributing to CI/CD integration, observability, and documentation. Collaboration with data archi...

As a Data Engineer at Srijan, a Material company, you will play a crucial role in designing and developing scalable data pipelines within Microsoft Fabric. Your primary responsibilities will include optimizing data pipelines, collaborating with cross-functional teams, and ensuring documentation and knowledge sharing. You will work closely with the Data Architecture team to implement scalable and governed data architectures within OneLake and Microsoft Fabric's unified compute and storage platform. Your expertise in Microsoft Fabric will be utilized to build robust pipelines using both batch and real-time processing techniques, integrating with Azure Data Factory for seamless data movement. C...

As an Analyst/Consultant in the Strategy & Consulting Global Network at Accenture's Marketing analytics practice in Gurgaon, you will play a crucial role in helping clients grow their business through data-driven insights and analytics. You will be part of a global team of over 20,000 skilled professionals who excel in statistical tools, methods, and applications, working towards providing analytically informed insights at scale. Your responsibilities will include defining data requirements for Data Driven Merchandizing capability, cleaning, aggregating, analyzing, and interpreting data, as well as conducting data quality analysis. With 3+ years of experience in Data Driven Merchandizing, sp...

As a Senior Backend Engineer with 7 to 10 years of experience, you will be responsible for developing backend systems and APIs using Python programming. You should have a strong understanding of Cloud platforms such as AWS or GCP and be proficient in CI/CD, Docker, and Linux. Your expertise in microservices architecture will be crucial for designing scalable and efficient systems. The ideal candidate will have hands-on experience with Cloud platforms like GCP or AWS and a good command of Python programming. Additionally, familiarity with data pipelines tools such as Airflow or Netflix Conductor would be advantageous. Experience working with Apache Spark/Beam and Kafka will be considered a pl...

At PwC, our team in managed services focuses on providing a variety of outsourced solutions and supporting clients across multiple functions. We help organizations streamline their operations, reduce costs, and enhance efficiency by managing key processes and functions on their behalf. Our team is skilled in project management, technology, and process optimization, ensuring the delivery of high-quality services to our clients. Those in managed service management and strategy at PwC are responsible for transitioning and running services, managing delivery teams, programs, commercials, performance, and delivery risk. Your role will involve continuous improvement and optimization of managed ser...

As a Senior Data Modeller, you will be responsible for leading the design and development of conceptual, logical, and physical data models for enterprise and application-level databases. Your expertise in data modeling, data warehousing, and data governance, particularly in cloud environments, Databricks, and Unity Catalog, will be crucial for the role. You should have a deep understanding of business processes related to master data management in a B2B environment and experience with data governance and data quality concepts. Your key responsibilities will include designing and developing data models, translating business requirements into structured data models, defining and maintaining da...

At EY, you will be part of a globally connected powerhouse of diverse teams that will shape your future with confidence. Your career will have the opportunity to grow in innovative ways as you contribute to cutting-edge projects on the Azure platform. As an Azure ML and Python Developer, you will play a crucial role in designing and implementing data pre-processing, feature engineering, and model training pipelines to ensure model performance and reliability in production environments. Your responsibilities will include developing and deploying machine learning models on the Azure cloud platform using Python programming language and Azure ML services. You will collaborate with data scientist...

Role & responsibilities Develop, test, and deploy robust Dashboards and reports in Power BI using SAP HANA and Snowflake Datasets Basic Qualifications Excellent verbal and written communication skills 5+ years of experience working with Power BI with SAP HANA and Snowflake Datasets 5+ hands-on experience in developing moderate to complex ETL data pipelines is a plus 5+ years of hands-on experience with ability to resolve complex SQL query performance issues. 5+ years of ETL Python development experience; experience parallelizing pipelines a plus Demonstrated ability to troubleshoot complex query, pipeline, and data quality issues Call : - 9584022831 Email: - Mayank@axiomsoftwaresolutions.com