787 Etl Pipelines Jobs - Page 21

As a Data Platform Specialist at Siemens Energy, your primary responsibility will involve setting up and monitoring data acquisition systems to ensure a smooth and reliable flow of data on a daily basis. Your communication skills will be put to use as you interact with customers regarding data export and transmission, fostering strong and lasting relationships. Additionally, you will play a pivotal role in managing and improving the entire data platform, including the development of dashboards and digital services such as Condition Monitoring and Hotline Support. Providing technical support to your colleagues and contributing to the company-wide enhancement of Siemens Energy's data analysis ...

The Tech Consultant - Data & Cloud role involves supporting a leading international client with expertise in data engineering, cloud platforms, and big data technologies. As a skilled professional, you will contribute to large-scale data initiatives, implement cloud-based solutions, and collaborate with stakeholders to drive data-driven innovation. You will design scalable data architectures, optimize ETL processes, and leverage cloud technologies to deliver impactful business solutions. Key Responsibilities Data Engineering & ETL: Develop and optimize data pipelines using Apache Spark, Airflow, Sqoop, and Databricks for seamless data transformation and integration. Cloud & Infrastructure Ma...

As a Python Machine Learning Engineer at our organization, you will be responsible for designing, developing, and deploying scalable recommender systems using various machine learning algorithms. Your primary focus will be on leveraging machine learning techniques to personalize user experiences, enhance engagement, and drive business outcomes. You will collaborate closely with cross-functional teams to understand business requirements and translate them into actionable machine learning solutions. Conducting thorough exploratory data analysis to identify relevant features and patterns in large-scale datasets will be a crucial part of your role. Additionally, you will implement and optimize m...

Line of Service Advisory Industry/Sector Not Applicable Specialism Data, Analytics & AI Management Level Associate Job Description & Summary At PwC, our people in data and analytics focus on leveraging data to drive insights and make informed business decisions. They utilise advanced analytics techniques to help clients optimise their operations and achieve their strategic goals. In data analysis at PwC, you will focus on utilising advanced analytical techniques to extract insights from large datasets and drive data-driven decision-making. You will leverage skills in data manipulation, visualisation, and statistical modelling to support clients in solving complex business problems. Why PWC A...

As a Technical Support Analyst (Data-Focused) at our company, you will play a crucial role in our growing Analytics/tech-support team by utilizing your strong analytical mindset, Python and SQL skills, and experience with data analysis tools. Your primary responsibilities will include investigating and resolving data inconsistencies, writing and debugging Python scripts, running SQL queries for data investigations, troubleshooting technical problems, and collaborating with various teams to ensure data quality and integrity. Additionally, you will be responsible for building internal tools, maintaining documentation of findings, and processes. The ideal candidate for this role should possess ...

As a Data Engineer / Business Intelligence Developer at Eurofins IT Solutions India Pvt Ltd (EITSI), you will play a crucial role in developing data engineering solutions and implementing business intelligence strategies. Your responsibilities will involve designing, developing, and maintaining large-scale data warehouses, ETL pipelines, data models, and BI solutions using tools such as SSIS, Power BI, Power Automate, and Pyramid Analytics. You will collaborate with cross-functional teams to identify and refine data requirements, ensuring high data quality, security, and compliance. Additionally, you will be involved in migrating data and reports between servers and BI platforms, as well as ...

As a Data Engineer / Business Intelligence Developer at Eurofins IT Solutions India Pvt Ltd (EITSI), you will have the opportunity to contribute to both data infrastructure and business decision-making. You will play a crucial role in developing data engineering solutions, implementing business intelligence strategies, and collaborating with cross-functional teams to deliver actionable insights and data-driven solutions. Your responsibilities will include designing, developing, and maintaining large-scale data warehouses and ETL pipelines using tools such as SSIS, Power Automate, and other relevant technologies. You will create and implement data models to enhance data accessibility and cons...

Job Title: Data Engineer (AWS QuickSight, Glue, PySpark) Location: Noida Job Summary: We are seeking a skilled Data Engineer with 4-5 years of experience to design, build, and maintain scalable data pipelines and analytics solutions within the AWS cloud environment. The ideal candidate will leverage AWS Glue, PySpark, and QuickSight to deliver robust data integration, transformation, and visualization capabilities. This role is critical in supporting business intelligence, analytics, and reporting needs across the organization. Key Responsibilities: Design, develop, and maintain data pipelines using AWS Glue, PySpark, and related AWS services to extract, transform, and load (ETL) data from d...

As a Consultant - Data Engineer at AstraZeneca, you will have the opportunity to contribute to the discovery, development, and commercialization of life-changing medicines by enhancing data platforms built on AWS services. Located at Chennai GITC, you will collaborate with experienced engineers to design and implement efficient data products, supporting data platform initiatives with a focus on impacting patients and saving lives. Your key accountabilities as a Data Engineer will include: Technical Expertise: - Designing, developing, and implementing scalable processes to extract, transform, and load data from various sources into data warehouses. - Demonstrating expert understanding of Astr...

You will be joining our team as a Technical Support Analyst (Data-Focused), working remotely to support our growing Analytics/tech-support team. In this hybrid role, you will be responsible for bridging data analysis, technical investigation, and hands-on coding to resolve data issues, maintain script-based tools, and provide technical insights to our internal stakeholders. The ideal candidate should possess a strong analytical mindset, excellent Python and SQL skills, experience with Athena or large-scale datasets, and a keen attention to detail. Your primary responsibilities will include investigating and resolving data inconsistencies or anomalies reported by business or engineering teams...

You should have 6-8 years of hands-on experience with Big Data technologies such as pySpark (Data frame and SparkSQL), Hadoop, and Hive. Additionally, you should possess good hands-on experience with python and Bash Scripts, along with a solid understanding of SQL and data warehouse concepts. Strong analytical, problem-solving, data analysis, and research skills are crucial for this role. It is essential to have a demonstrable ability to think creatively and independently, beyond relying solely on readily available tools. Excellent communication, presentation, and interpersonal skills are a must for effective collaboration within the team. Hands-on experience with Cloud Platform provided Big...

As an ML Engineer, you will play a crucial role in developing and implementing various Machine Learning models that contribute to the growth of the company. Your primary focus will be on creating ML workflows tailored for the legal industry to enhance the efficiencies of in-house teams at Draft n Craft. This position offers you the opportunity to enhance your ML/Data Engineering skills while actively participating in the creation of valuable products. Your responsibilities will include developing data ingestion and preprocessing pipelines to extract actionable insights from legal data, ensuring accurate and consistent data cleaning for ML models, and experimenting with different ML models an...

You will be joining Apexon, a digital-first technology services firm that specializes in accelerating business transformation and delivering human-centric digital experiences. At Apexon, we meet customers at every stage of the digital lifecycle and help them outperform their competition through speed and innovation. With a focus on AI, analytics, app development, cloud, commerce, CX, data, DevOps, IoT, mobile, quality engineering, and UX, we leverage our deep expertise in BFSI, healthcare, and life sciences to help businesses capitalize on the opportunities presented by the digital world. Our reputation is built on a comprehensive suite of engineering services, a commitment to solving our cl...

As an AWS Data Engineer, you should have at least 3 years of experience in AWS Data Engineering. Your main responsibilities will include designing and building ETL pipelines and Data lakes to automate the ingestion of both structured and unstructured data. You will need to be proficient in working with AWS big data technologies such as Redshift, S3, AWS Glue, Kinesis, Athena, DMS, EMR, and Lambda for Serverless ETL processes. Knowledge in SQL and NoSQL programming languages is essential, along with experience in batch and real-time pipelines. Your role will require excellent programming and debugging skills in either Scala or Python, as well as expertise in Spark. You should have a good unde...

You are a Generative AI Software Engineer with over 3 years of experience, possessing strong expertise in Generative AI and Large Language Models (LLMs). Your role involves designing, developing, and implementing GenAI solutions customized to address various business challenges. It is crucial that you excel in Python programming and have hands-on experience in Retrieval-Augmented Generation (RAG) along with familiarity with Vector Databases. Your responsibilities include using Python to design and implement scalable GenAI solutions, leading the design and architecture of AI-driven solutions, working with Large Language Models (LLMs) for building customized solutions, and developing AI models...

As a member of the Providence Cybersecurity (CYBR) team, you will play a crucial role in safeguarding all information pertaining to caregivers, affiliates, and confidential business data. Your responsibilities will include collaborating with Product Management to assess use cases, functional requirements, and technical specifications. You will conduct data discovery and analysis to identify crucial data from source systems for meeting business needs. Additionally, you will be tasked with developing conceptual and logical data models to validate requirements, highlighting essential entities, relationships, and documenting assumptions and risks. Your role will also involve translating logical ...

Golden Eagle IT Technologies Pvt. Ltd. is looking for a skilled Data Engineer with 2 to 4 years of experience to join the team in Indore. The ideal candidate should have a solid background in data engineering, big data technologies, and cloud platforms. As a Data Engineer, you will be responsible for designing, building, and maintaining efficient, scalable, and reliable data pipelines. You will be expected to develop and maintain ETL pipelines using tools like Apache Airflow, Spark, and Hadoop. Additionally, you will design and implement data solutions on AWS, leveraging services such as DynamoDB, Athena, Glue Data Catalog, and SageMaker. Working with messaging systems like Kafka for managin...

About the Role Were building a next-generation Data Analytics Engine that transforms raw market and historical data into actionable intelligence for the electronics supply chain industry. Our platform ingests, processes, and analyzes high-volume data across suppliers, parts, and trends powering real-time insights and ML-driven applications. We are looking for a highly experienced Lead or Staff Data Engineer to help us shape and scale our core data infrastructure. The ideal candidate brings a proven track record of designing and delivering scalable ETL pipelines and real-time data systems in AWS and open-source environments (e.g., Airflow, Spark, Kafka). This role requires deep technical owne...

We are seeking a Business Analyst specialized in Revenue Cycle Management (RCM) analytics, data quality, and business decision support. This role is critical in transforming raw healthcare financial data into clean, consistent, and decision-driving analytics . Key Responsibilities: Data Quality & Dashboard Accuracy Own the accuracy and consistency of operational and financial dashboards (Power BI / Tableau / Excel). Perform root cause analysis of data mismatches, anomalies, and KPI discrepancies . Define, document, and enforce KPI calculation standards across departments and systems. Work closely with technical teams to manage ETL pipelines and data transformations for RCM reporting. Develop...

Manage ETL pipelines, data engineering operations, and cloud infrastructure Experience in configuring data exchange and transfer methods Experience in orchestrating ETL pipelines with multiple tasks, triggers, and dependencies Strong proficiency with Python and Apache Spark; intermediate or better proficiency with SQL; experience with AWS S3 and EC2, Databricks Ability to communicate efficiently and translate ideas with technical stakeholders in IT and Data Science Passionate about designing data infrastructure and eager to contribute ideas to help build robust data platforms

Job Title: Data Engineer Job Type: Full-time Department: Data Engineering / Data Science Reports To: Data Engineering Manager / Chief Data Officer About the Role: We are looking for a talented Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, building, and maintaining robust data pipelines and systems that process and store large volumes of data. You will collaborate closely with data scientists, analysts, and business stakeholders to deliver high-quality, actionable data solutions. This role requires a strong background in data engineering, database technologies, and cloud platforms, along with the ability to work in an Agile environment to drive dat...

As a Data Engineer at our company, you will be responsible for designing and implementing Azure Synapse Analytics solutions for data processing and reporting. Your role will involve optimizing ETL pipelines, SQL pools, and Synapse Spark workloads to ensure efficient data processing. It will also be crucial for you to uphold data quality, security, and governance best practices while collaborating with business stakeholders to develop data-driven solutions. Additionally, part of your responsibilities will include mentoring a team of data engineers. To excel in this role, you should have 6-10 years of experience in Data Engineering, BI, or Cloud Analytics. Your expertise in Azure Synapse, Azur...

En tant que Data Product Owner Senior, vous serez responsable de la prparation, de la coordination et du suivi de la ralisation de projets axs sur la data et l'intelligence artificielle. Votre rle consistera assurer la conception et la livraison de solutions innovantes et axes sur les donnes, en collaboration avec les quipes techniques, les quipes mtier et les clients. Vos principales responsabilits incluront le cadrage des besoins en matire de data et IA, la dfinition des spcifications fonctionnelles, le suivi de la conception et du dveloppement, la gestion de projet agile et l'assurance de la qualit et des performances des solutions livres. Vous serez galement le point de contact privilgi ...

You are a Gen AI Senior Software Engineer with over 5 years of experience, specializing in Generative AI and Large Language Models (LLMs). Your main responsibility is to design, develop, and implement GenAI solutions tailored to address business challenges, utilizing your expertise in Python for AI/ML solutions. Your key technical skills include proficiency in Python programming, hands-on experience in Retrieval-Augmented Generation (RAG) and familiarity with Vector Databases. It would be beneficial if you have experience in React.js and are open to learning new skills and technologies. In this role, you will be responsible for designing and implementing scalable GenAI solutions using Python...

You are an experienced Azure Databricks Engineer who will be responsible for designing, developing, and maintaining scalable data pipelines and supporting data infrastructure in an Azure cloud environment. Your key responsibilities will include designing ETL pipelines using Azure Databricks, building robust data architectures on Azure, collaborating with stakeholders to define data requirements, optimizing data pipelines for performance and reliability, implementing data transformations and cleansing processes, managing Databricks clusters, and leveraging Azure services for data orchestration and storage. You must possess 5-10 years of experience in data engineering or a related field with e...