787 Etl Pipelines Jobs - Page 22

Job Title: Data Engineer Job Type: Full-time Department: Data Engineering / Data Science Reports To: Data Engineering Manager / Chief Data Officer About the Role: We are looking for a talented Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, building, and maintaining robust data pipelines and systems that process and store large volumes of data. You will collaborate closely with data scientists, analysts, and business stakeholders to deliver high-quality, actionable data solutions. This role requires a strong background in data engineering, database technologies, and cloud platforms, along with the ability to work in an Agile environment to drive dat...

Job Title: Data Engineer Job Type: Full-time Department: Data Engineering / Data Science Reports To: Data Engineering Manager / Chief Data Officer About the Role: We are looking for a talented Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, building, and maintaining robust data pipelines and systems that process and store large volumes of data. You will collaborate closely with data scientists, analysts, and business stakeholders to deliver high-quality, actionable data solutions. This role requires a strong background in data engineering, database technologies, and cloud platforms, along with the ability to work in an Agile environment to drive dat...

Job Title: Data Engineer Job Type: Full-time Department: Data Engineering / Data Science Reports To: Data Engineering Manager / Chief Data Officer About the Role: We are looking for a talented Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, building, and maintaining robust data pipelines and systems that process and store large volumes of data. You will collaborate closely with data scientists, analysts, and business stakeholders to deliver high-quality, actionable data solutions. This role requires a strong background in data engineering, database technologies, and cloud platforms, along with the ability to work in an Agile environment to drive dat...

We at Blackstraw.ai. are organizing a Walk-in Interview Drive for Data Engineers with minimum 3 years exp in Data Engineer Data Engineer Mini 3 Years Exp in Python, Spark, PySpark, Hadoop, Hive, Snowflake , AWS , Databricks We are looking for a Data Engineer to join our team. You will use various methods to transform raw data into useful data systems. You'll strive for efficiency by aligning data systems with business goals. To succeed in this position, you should have strong analytical skills and the ability to combine data from different sources. Data engineer skills also include familiarity with several programming languages and an understanding of machine learning methods. If you are det...

Role & responsibilities Key Responsibilities: Lead Data Engineering Projects: Oversee the development and deployment of end-to-end data ingestion pipelines using Azure Databricks, Apache Spark, and related technologies, ensuring scalability, performance, and efficiency. Design & Architecture: Design high-performance, resilient, and scalable data architectures for data ingestion and processing using best practices for Azure Databricks and Spark. Team Leadership: Provide technical guidance and mentorship to a team of data engineers, fostering a culture of collaboration, continuous learning, and innovation. Collaboration: Work closely with data scientists, business analysts, and other stakehold...

Role Purpose: The Senior Data Engineer will support and enable the Data Architecture and the Data Strategy. Supporting solution architecture and engineering for data ingestion and modelling challenges. The role will support the deduplication of enterprise data tools, working with the Lonza Data Governance Board, Digital Council and IT to drive towards a single Data and Information Architecture. This will be a hands-on engineering role with a focus on business and digital transformation. The role will be responsible for managing and maintain the Data Architecture and solutions that deliver the platform at with operational support and troubleshooting. The Senior Data Engineer will also manage ...

As an experienced Data & Analytics Project Manager, you will play a crucial role in leading end-to-end execution of data and analytics projects. Your expertise in data integration, analytics, and cloud platforms such as AWS and Azure will be essential in ensuring seamless delivery. Collaborating with cross-functional teams, driving innovation, and optimizing data-driven decision-making will be key responsibilities in this role. Our projects utilize a variety of technologies including internal custom-built solutions, packaged software, ERP solutions, data warehouses, Software as a Service, cloud-based solutions, and BI tools. You will be responsible for leading project teams from initiation t...

Job title: Senior Software Engineer Experience: 5- 8 years Primary skills: Python, Spark or Pyspark, DWH ETL. Database: SparkSQL or PostgreSQL Secondary skills: Databricks ( Delta Lake, Delta tables, Unity Catalog) Work Model: Hybrid (Weekly Twice) Cab Facility: Yes Work Timings: 10am to 7pm Interview Process: 3 rounds (3rd round F2F Mandatory) Work Location: Karle Town Tech Park Nagawara, Hebbal Bengaluru 560045 About Business Unit: The Architecture Team plays a pivotal role in the end-to-end design, governance, and strategic direction of product development within Epsilon People Cloud (EPC). As a centre of technical excellence, the team ensures that every product feature is engineered to m...

To Apply - Mandatory to submit Details via Google Form - https://forms.gle/cCa1WfCcidgiSTgh8 Position : Senior Data Engineer - Total 8+ years Required Relevant 6+ years in Databricks, AWS, Apache Spark & Informatica (Required Skills) As a Senior data Engineer in our team, youll build and nurture positive working relationships with teams and clients with the intention to exceed client expectations Seeking experienced data Engineer to design, implement, and maintain robust data pipelines and analytics solutions using databricks & AWS services. The ideal candidate will have a strong background in data services, big data technologies, and programming languages. Role & responsibilities Technical ...

The responsibilities of the role involve designing and implementing Azure Synapse Analytics solutions for data processing and reporting. You will be required to optimize ETL pipelines, SQL pools, and Synapse Spark workloads while ensuring data quality, security, and governance best practices are followed. Collaborating with business stakeholders to develop data-driven solutions and mentoring a team of data engineers are key aspects of this position. To excel in this role, you should possess 6-10 years of experience in Data Engineering, BI, or Cloud Analytics. Expertise in Azure Synapse, Azure Data Factory, SQL, and ETL processes is essential. Experience with Fabric is strongly desirable. Str...

As a GCP Data Engineer in Australia, you will be responsible for leveraging your experience in Google Cloud Platform (GCP) to handle various aspects of data engineering. Your role will involve working on data migration projects from legacy systems such as SQL and Oracle. You will also be designing and building ETL pipelines for data lake and data warehouse solutions on GCP. In this position, your expertise in GCP data and analytics services will be crucial. You will work with tools like Cloud Dataflow, Cloud Dataprep, Apache Beam/Cloud composer, Cloud BigQuery, Cloud Fusion, Cloud PubSub, Cloud storage, and Cloud Functions. Additionally, you will utilize Cloud Native GCP CLI/gsutil for opera...

As a Project Manager specializing in Data & Analytics, you will play a crucial role in transforming data into valuable business insights. Your primary responsibility will involve leading impactful data-driven projects spanning various business domains. Your key tasks will include driving project delivery in data engineering, business intelligence (BI), and analytics, ensuring alignment among technical and business teams, managing scope, risks, and milestones in an Agile setting, and translating business objectives into measurable data outcomes. Monitoring key performance indicators (KPIs), return on investment (ROI), and ensuring timely, high-quality project delivery will also be part of you...

As a Data Engineer at IBM, you'll play a vital role in the development, design of application, provide regular support/guidance to project teams on complex coding, issue resolution and execution. Your primary responsibilities include: Lead the design and construction of new solutions using the latest technologies, always looking to add business value and meet user requirements. Strive for continuous improvements by testing the build solution and working under an agile framework. Discover and implement the latest technologies trends to maximize and build creative solutions Required education Bachelor's Degree Preferred education Master's Degree Required technical and professional expertise Ex...

Hiring for Azure Data Engineer for our MNC company Role: Azure date Engineer Exp: 6 - 9 Years Job Location: Bangalore / Hyderabad / Bhubaneshwar Notice period: Immediate - 30 days Work Mode: Work from Office ( 5 days ) Job Description: Azure Data Engineer Technical Stacks: Minimum 5-6 years of hands-on experience in ETL pipeline using Azure Data factory /Azure synapse 3-4 weeks of notice period Average to excellent communication skill and has experience of managing client delivery independently. Essential Skills: Minimum 5-6 years of hands-on experience in ETL pipeline using Azure Data factory /Azure synapse 3-4 weeks of notice period Average to excellent communication skill and has experien...

As a BI Engineer at DoorDash, you will play a crucial role in building and scaling data models, pipelines, and self-service analytics for the Finance, Legal, and Public Relations teams. Your responsibilities will include collaborating with business partners and stakeholders to understand diverse data requirements, working with engineering and product teams to collect necessary data, and designing and implementing large-scale, high-performance data models and pipelines. You will focus on developing ETL pipelines, delivering insightful reports, and building dashboards to meet the evolving business needs of DoorDash. Additionally, you will be responsible for implementing data quality checks, co...

You will be responsible for preparing data, developing models, testing them, and deploying them. This includes designing machine learning systems and self-running artificial intelligence (AI) software to automate predictive models. Your role will involve ensuring that algorithms generate accurate user recommendations. Additionally, you will work on turning unstructured data into useful information by auto-tagging images and converting text to speech. Solving complex problems with multi-layered data sets and optimizing existing machine learning libraries and frameworks will be part of your daily tasks. Your responsibilities will also include developing machine learning algorithms to analyze l...

Role & responsibilities: Design and implement scalable data pipelines for feature extraction, transformation, and loading (ETL) using technologies such as Pyspark, Scala, and relevant big data frameworks. Govern and optimize data pipelines to ensure high reliability, efficiency, and data quality across on-premise and cloud environments. Collaborate closely with data scientists, ML engineers, and business stakeholders to understand data requirements and translate them into technical solutions. Implement best practices for data governance, metadata management, and compliance with regulatory requirements. Lead a team of data engineers, providing technical guidance, mentorship, and fostering a c...

Role & responsibilities Hands on in Python Scripting Data engineering with Python (Experience in Pandas and Numpy) Hands on experience in ETL with Python. Good to have API experience , Framework (Django or Flask) Familiarity with Agile/Scrum methodologies Preferred candidate profile

Job Title: AWS Databricks Developer Experience Required: 6 to 12 Years Location: PAN India (Onsite/Hybrid as per project requirement) Employment Type: Permanent Open Positions: 5 Key Responsibilities: Design, develop, and maintain ETL/ELT pipelines using Databricks (PySpark/Scala) Implement scalable data workflows on AWS (S3, Glue, Lambda, EMR, Redshift) Collaborate with cross-functional teams to build end-to-end data solutions Optimize pipeline performance and ensure data quality and governance Troubleshoot issues across cloud environments and ensure smooth data operations Use CI/CD tools for deployment and manage code via Git Other Details: Interview Drive: This Saturday (July 27th, 2025) ...

Mandatory Skills: Azure Skills Like Azure Databricks Azure Synapse Azure Functions Azure Data Lake Azure Integration Services Azure API Management CI/CD and PowerShell Scripts ADF ETL Pipelines Unity Catalog Azure SQL Database SQL Coding Storage Account, Azure Data Explorer, Spark Structured Streaming, ADF, Netezza SQL queries, Data lineage, Spark jobs. Role & Responsibilities / Job Description: Overall 4 to 8 years of experience with a minimum 4+ years of relevant professional work experience. Design, implement, and maintain data pipelines for data ingestion, processing, and transformation in Azure. Work together with data analysts to understand the needs for data and create effective data ...

As a Microsoft Fabric Professional at YASH Technologies, you will be responsible for leveraging your 12+ years of experience in Microsoft Azure Data Engineering to drive analytical projects. Your expertise will be crucial in designing, developing, and deploying high-volume ETL pipelines using Azure, Microsoft Fabric, and Databricks for complex models. Your hands-on experience with Azure Data Factory, Databricks, Azure Functions, Synapse Analytics, Data Lake, Delta Lake, and Azure SQL Database will be utilized for managing and processing large-scale data integrations. In this role, you will be expected to optimize Databricks clusters and manage workflows to ensure cost-effective and high-perf...

As a Data Modeler at TRST01, a premier Sustainable Tech company in Hyderabad, you will play a crucial role in designing, implementing, and optimizing data models to support carbon accounting, lifecycle analysis, and sustainability reporting. Your expertise in Carbon Footprint and Reduction Data (CFRD) will be instrumental in tracking carbon emissions, energy consumption, and sustainability metrics. Collaborating with cross-functional teams, including data scientists, software engineers, and sustainability experts, you will ensure the integrity, accuracy, and scalability of environmental data models. Your responsibilities will include developing robust data models, establishing reliable and s...

About the Role We are seeking a Senior Python Developer to lead the development of scalable, high-performance backend systems and data-driven applications. You will work on building robust services, APIs, and data workflows that power real-time and batch applications. This role is ideal for a seasoned developer who thrives on solving complex problems, building reliable software, and working across data and engineering teams. Youll play a key role in designing and developing Python-based systems that interface with big data frameworks, cloud platforms, and analytics tools. Key Responsibilities Design and develop robust Python-based backend services and microservices. Build RESTful APIs and in...

Job Title : Mid-Level Data Engineer Healthcare Domain Location: Remote Option Experience: 2 to 3 Years Employment Type: Full-Time About the Role We are seeking a motivated and detail-oriented Mid-Level Data Engineer with 2 to 3 years of experience in designing, developing, and optimizing data pipelines within the healthcare domain. The ideal candidate will have hands-on experience with Databricks , strong SQL skills, and a solid understanding of healthcare data standards (e.g., HL7, EDI X12 837/835, HCC, CPT/ICD codes). Key Responsibilities Design, develop, and maintain scalable ETL/ELT pipelines using Databricks , PySpark , and Delta Lake for large-scale healthcare datasets. Collaborate wit...

Build and Optimize ELT/ETL Pipelines using BigQuery, GCS, Dataflow, PubSub and Orchestration services Composer/Airflow • Hands-On experience in building ETL/ELT Pipelines with developing software code in Python • Experience in working with data warehouses, data warehouse technical architectures, reporting/analytic tools • Develop and implement data quality and governance procedures to ensure the accuracy and reliability of data • Demonstrate extensive skills and success in the implementation of technology projects within a professional environment, with a particular focus on data engineering • Eager to learn and explore new services within GCP to enhance skills and contribution to Projects •...