78 Etlelt Pipelines Jobs

As a Senior Data Engineer at our company, you will play a crucial role in designing, developing, and optimizing scalable data pipelines and applications using Apache Spark and Databricks. Your responsibilities will include: - Designing, developing, and implementing scalable data pipelines and applications with a focus on adhering to industry best practices. - Performing in-depth performance tuning and optimization of Spark applications within the Databricks environment. - Troubleshooting complex issues related to data ingestion, transformation, and pipeline execution. - Collaborating with cross-functional teams to deliver end-to-end data solutions. - Continuously evaluating and adopting new ...

As a highly experienced GCP Data Engineer (AdTech), your role will involve leading the analytics team, building scalable data pipelines, and mentoring analysts. Your responsibilities will include: - Leading and mentoring a team of data analysts to ensure quality delivery and technical upskilling. - Designing, developing, and maintaining scalable ETL/ELT pipelines using GCP tools such as BigQuery, Dataflow, Cloud Composer, Cloud Functions, and Pub/Sub. - Ingesting and processing log-level data from platforms like Google Ad Manager, Google Analytics, DV360, and other advertising and marketing tech sources. - Building and optimizing data pipelines from diverse sources via APIs, cloud connectors...

As an experienced and highly skilled GCP Data Engineer, your role will involve designing, developing, and maintaining robust data pipelines and cloud-based solutions on Google Cloud Platform. You will collaborate closely with data analysts, architects, and stakeholders to build scalable and efficient data systems. Key Responsibilities: - Design, build, and maintain scalable ETL/ELT pipelines using GCP tools such as Cloud Dataflow, BigQuery, Cloud Composer, and Cloud Storage. - Develop and optimize data models for analytics and reporting using BigQuery. - Implement data quality, data governance, and metadata management best practices. - Collaborate with data scientists, analysts, and other en...

As a Senior Data Engineer at our company, your main role is to design, build, and maintain scalable data pipelines and architectures to support the Denials AI workflow. You will work under the guidance of the Team Lead, Data Management to ensure that the data is reliable, compliant with HIPAA, and optimized. **Key Responsibilities:** - Collaborate with the Team Lead and cross-functional teams to gather and refine data requirements for Denials AI solutions. - Design, implement, and optimize ETL/ELT pipelines using Python, Dagster, DBT, and AWS data services (Athena, Glue, SQS). - Develop and maintain data models in PostgreSQL; write efficient SQL for querying and performance tuning. - Monitor...

You will be responsible for gathering, cleaning, and analyzing large datasets from various structured and unstructured sources. Your role will involve performing statistical analysis to identify trends, patterns, and anomalies. You will define, track, and report on key performance indicators (KPIs) and business metrics. Additionally, you will translate business requirements into technical data models and reports and communicate insights clearly through visualizations and presentations to stakeholders. Automation of recurring reports and ad-hoc analysis using SQL, Python, or Excel will also be part of your responsibilities. - Gather, clean, and analyze large datasets from various sources - Pe...

As a Palantir Data Engineer Senior Associate at PwC, your role involves architecting, developing, and optimizing end-to-end data solutions on Palantir platforms, while mentoring junior teammates. You will have a voice in designing, building, and operating the next generation of software and services leveraging the power of Palantir. Your work will focus on transitioning and running services, managing delivery teams, programs, commercials, performance, and delivery risk. Your responsibilities also include continuous improvement and optimization of managed services processes, tools, and services. Key Responsibilities: - Design and maintain Foundry ontologies, datasets, and code workbooks on Pa...

As the Lead PM, you will own the full lifecycle of our data intelligence products from concept to launch and ongoing. You will define the product vision and roadmap for insights derived from geospatial, mobility, behavioral, and commerce data. Your role will involve leading cross-functional teams to design, develop, and scale analytics products that turn raw data into intuitive, decision-ready outputs. Collaboration with data science, engineering, and UX teams will be essential to translate complex data pipelines into clear user experiences and workflows. Additionally, you will partner with clients, commercial teams, and industry stakeholders to identify high-impact use cases and ensure meas...

Your role as a Senior Manager Data Operations will involve overseeing end-to-end data processes. You should have a Bachelor's or Master's degree in Computer Science, Data Science, Engineering, or a related field. With over 6 years of experience in data operations or related roles, you must demonstrate expertise in data warehousing, ETL/ELT pipelines, and BI tools such as Tableau, Power BI, and Looker. Your hands-on experience with SQL, data modeling, and query optimization will be crucial for this role. Key Responsibilities: - Manage end-to-end data processes efficiently - Develop and maintain data warehousing solutions - Build and optimize ETL/ELT pipelines - Utilize BI tools for data visua...

You will be responsible for executing the Data Governance programme named Data Trust within LSEG as a Senior Data Scientist in the Data Governance Execution Team. Your main focus will be to automate the Data Lineage activities using NLP and other techniques to ensure sustainability and adaptability to changing environments and technologies. You will collaborate closely with key internal stakeholders and architects of DBORs and tooling development teams to architect Governance processes and automate them for sustainability. **Key Responsibilities:** - Take ownership of the Data Trust Snowflake data warehouse design, architecture, and optimization. - Design and maintain data models using Solid...

Role Overview: At Techjays, we are on a mission to empower businesses worldwide by building AI solutions that drive industry transformation. We are seeking a skilled Data Analytics Engineer with 3 to 8 years of experience to join our global team in Coimbatore. As a Data Analytics Engineer at Techjays, you will play a crucial role in designing and delivering scalable, data-driven solutions that support real-time decision-making and deep business insights. Your primary focus will be on developing and maintaining ETL/ELT data pipelines, collaborating with various teams, designing interactive dashboards, and ensuring high reliability of data pipelines. If you are passionate about using tools lik...

As a Snowflake Data Architect at 3Pillar, you will be at the forefront of the organization, supporting clients in taking control of their data and extracting value from it by defining a reference architecture. Your role involves close collaboration with business leaders and information management teams to establish and execute a roadmap for data management, business intelligence, or analytics solutions. **Key Responsibilities:** - Lead the architecture and design of scalable, secure, and high-performing data solutions using Snowflake. - Design and implement robust data models (star, snowflake, normalized, and denormalized) for reporting and analytics purposes. - Develop and manage ETL/ELT pi...

As an Analytics Engineer at DoorDash, you will play a key role in building and scaling the data foundations that enable fast, reliable, and actionable insights. You will work closely with partner teams to drive end-to-end analytics initiatives, collaborating with Data Engineers, Data Scientists, Software Engineers, Product Managers, and Operators. Your responsibilities will include: - Collaborating with data scientists, data engineers, and business stakeholders to understand business needs, and translating that scope into data requirements - Identifying key business questions and problems to solve for, and generating insights by developing structured solutions to resolve them - Leading the d...

As a Snowflake + IICS (CAI+CDI) professional at PWC AC, you will play a crucial role in leveraging your expertise to drive data integration and cloud application integration tasks. Your responsibilities will include: - Utilizing your strong hands-on experience with Snowflake Cloud Data Warehouse for tasks such as data modeling, optimization, and query tuning. - Demonstrating expertise in Informatica Intelligent Cloud Services (IICS), specifically Cloud Application Integration (CAI) and Cloud Data Integration (CDI) for data ingestion, transformation, orchestration, and integration activities. - Implementing API integration and middleware solutions using Informatica CAI. - Proficiently using P...

You will be responsible for designing and implementing scalable, secure, and cost-effective data architectures using GCP. This includes leading the design and development of data pipelines with BigQuery, Dataflow, and Cloud Storage. You will also be required to architect and implement data lakes, data warehouses, and real-time data processing solutions on GCP. Ensuring that the data architecture aligns with business goals, governance, and compliance requirements is a key aspect of your role. Collaborating with stakeholders to define data strategy and roadmap will also be part of your responsibilities. Additionally, you will need to design and deploy BigQuery solutions for optimized performan...

Role Overview: As a Snowflake Architect at NTT DATA, your main responsibility will be to lead the design and implementation of enterprise-grade data platforms using Snowflake. You will play a crucial role in defining architectural standards, guiding engineering teams, and collaborating with stakeholders to align data strategies with business goals. Your focus will be on leveraging Snowflake's advanced capabilities to build scalable, secure, and high-performance data solutions that support analytics, reporting, and data science initiatives. Key Responsibilities: - Define and own the end-to-end architecture of data platforms built on Snowflake, including ingestion, transformation, storage, and...

As a Full Remote Senior Azure Data Engineer for an international project in Chennai, your role will involve building data pipelines for enterprise search applications using ADF and Databricks. **Key Responsibilities:** - Design and Develop data pipelines for enterprise search solutions using ADF and Databricks - Document Low Level Design, Unit Testing Plan, and Unit Test case documentation - Design and develop ETL/ELT pipelines in Azure Data Factory to extract data from on-premises, cloud, and third-party sources - Implement data cleansing, enrichment, and aggregation logic - Provide mentorship to team members, ensuring best practices in cloud architecture - Ensure compliance with security s...

Role Overview: As a Lead Data Engineer specializing in Databricks, you will be responsible for designing, developing, and optimizing the next-generation data platform. Your role will involve leading a team of data engineers, providing technical guidance, mentorship, and ensuring scalability and high performance of data solutions. Key Responsibilities: - Lead the design, development, and implementation of scalable and reliable data pipelines using Databricks, Spark, and other relevant technologies. - Define and enforce data engineering best practices, coding standards, and architectural patterns. - Provide technical guidance and mentorship to junior and mid-level data engineers, conduct code ...

Role Overview: You will be joining Sustainability Economics.ai as an Agentic Data Engineer with a focus on designing intelligent, scalable, and adaptive data architectures that support next-generation AI-based systems and applications. The company pioneers the convergence of clean energy and AI to create scalable, intelligent ecosystems driving efficiency, innovation, and long-term impact across industries. Key Responsibilities: - Design, develop, and maintain AI-driven, agentic data pipelines and intelligent end-to-end architectures that support scalable, adaptive systems. - Build and optimize data models and schemas to adapt to evolving business needs, ensuring flexibility across structure...

Role Overview: As an Apache Superset Data Engineer, you will play a crucial role in the design, development, and maintenance of scalable data pipelines and analytics infrastructure. Your primary focus will be on data visualization and dashboarding using Apache Superset, bridging the gap between data engineering and business intelligence. By creating intuitive dashboards and reports, you will empower stakeholders to access accurate and actionable insights efficiently. Key Responsibilities: - Create, customize, and maintain interactive dashboards in Apache Superset to support key performance indicators (KPIs), experimentation, and business insights. - Collaborate with analysts, BI teams, and b...

As a Data Engineer specializing in Snowflake architecture, you will be responsible for designing and implementing scalable data warehouse architectures, including schema modeling and data partitioning. Your role will involve leading or supporting data migration projects to Snowflake from on-premise or legacy cloud platforms. You will be developing ETL/ELT pipelines and integrating data using various tools such as DBT, Fivetran, Informatica, and Airflow. It will be essential to define and implement best practices for data modeling, query optimization, and storage efficiency within Snowflake. Collaboration with cross-functional teams, including data engineers, analysts, BI developers, and stak...

Role Overview: You will have the opportunity to contribute technically to Risk Assurance client engagements and internal projects at EY. Your role will involve assisting fellow Seniors & Managers, identifying risks within engagements, and ensuring high-quality work. Additionally, you will be part of a cross-functional team responsible for the full software development life cycle, aiding in the growth of a new service offering. Key Responsibilities: - Design, architect, and develop solutions using Azure cloud to process and analyze data sets. - Proficiency in Azure Data Factory, Azure Databricks, Azure SQL Database, Azure Synapse Analytics, and Azure Data Lake Storage. - Design and build data...

You will be joining the data engineering team as an experienced Python + Databricks Developer. Your role will involve designing, developing, and maintaining scalable data pipelines using Databricks and Apache Spark. You will write efficient Python code for data transformation, cleansing, and analytics. Collaboration with data scientists, analysts, and engineers to understand data needs and deliver high-performance solutions is a key part of this role. Additionally, you will optimize and tune data pipelines for performance and cost efficiency and implement data validation, quality checks, and monitoring. Working with cloud platforms, preferably Azure or AWS, to manage data workflows will also...

As a highly skilled and experienced Snowflake Architect, your role will involve designing, developing, and deploying enterprise-grade cloud data solutions. You should have a robust background in data architecture, cloud data platforms, and Snowflake implementation. Hands-on experience in end-to-end data pipeline and data warehouse design is essential for this position. **Key Responsibilities:** - Lead the architecture, design, and implementation of scalable Snowflake-based data warehousing solutions - Define data modeling standards, best practices, and governance frameworks - Design and optimize ETL/ELT pipelines using tools such as Snowpipe, Azure Data Factory, Informatica, or DBT - Collabo...

Role Overview: As a Snowflake Architect at NTT DATA, you will lead the design and implementation of enterprise-grade data platforms using Snowflake. Your role will involve defining architectural standards, guiding engineering teams, and collaborating with stakeholders to align data strategies with business goals. You will focus on leveraging Snowflake's advanced capabilities to build scalable, secure, and high-performance data solutions that support analytics, reporting, and data science initiatives. Key Responsibilities: - Define and own the end-to-end architecture of data platforms built on Snowflake, including ingestion, transformation, storage, and consumption layers. - Design and implem...

Role Overview: You will be responsible for leading and managing large-scale data integration initiatives across multiple cloud platforms as a Senior Data Integration Engineer. Your expertise in designing and implementing modern data pipelines, integrating heterogeneous data sources, and enabling scalable data storage solutions will be crucial. This role will involve working with Azure, AWS, GCP, cloud storage systems, and Apache Iceberg. Key Responsibilities: - Design, build, and manage data integration solutions across hybrid and multi-cloud environments. - Develop and optimize data pipelines to ensure scalability, performance, and reliability. - Implement and manage cloud storage solutions...