122 Etlelt Pipelines Jobs - Page 4

You have a great opportunity to join Everest DX, a Digital Platform Services company headquartered in Stamford. Our vision is to enable Digital Transformation for enterprises by delivering seamless customer experience, business efficiency, and actionable insights through an integrated set of futuristic digital technologies. As a Data Engineer with a minimum of 6+ years of experience, you will be responsible for SQL optimization and performance tuning. You should have hands-on development experience in programming languages like Python, PySpark, Scala, etc. Additionally, you should possess at least 6+ years of cloud data engineering experience in Azure. Your role will involve working with Azu...

We are seeking a Senior Data Architect with over 7 years of experience in the field, specifically in data architecture roles. As a Senior Data Architect, your responsibilities will involve designing and implementing scalable, secure, and cost-effective data architectures utilizing Google Cloud Platform (GCP). You will play a key role in leading the design and development of data pipelines using tools such as BigQuery, Dataflow, and Cloud Storage. Additionally, you will be responsible for architecting and implementing data lakes, data warehouses, and real-time data processing solutions on GCP. It will be your duty to ensure that the data architecture is aligned with business objectives, gover...

As a Technical Architect - Analytics at Simpplr, you will be responsible for designing, developing, and optimizing the data and analytics architecture. You will play a crucial role in defining the data strategy, designing scalable data pipelines, and implementing best practices for real-time and batch analytics solutions. Passionate about data engineering and analytics, you will drive data-driven decision-making across the organization. Your key responsibilities will include defining and owning the architecture for data processing, analytics, and reporting systems to ensure scalability, reliability, and performance. You will design and implement highly efficient, scalable, and reliable data ...

You will be responsible for interacting with clients (internal or external) to understand their problems and develop solutions to meet their needs. You will lead projects and collaborate with a team to ensure that requirements are identified, user stories are created, and work is planned effectively to deliver solutions that align with evolving business needs. Managing team activities, strategizing task approaches, setting timelines, and delegating tasks among team members will be part of your role. You will conduct meetings, document findings, and communicate effectively with clients, management, and cross-functional teams. Additionally, you will create ad-hoc reports for internal requests ...

Join an exciting initiative with our customer's Marketing Performance Team, where your engineering expertise will play a key role in building a next-generation Marketing Analytics Platform. This ecosystem will consolidate marketing data across various formats to drive intelligent decision-making and deliver AI-powered insights. We are seeking a seasoned AdTech Engineer with strong data infrastructure experience and a passion for performance-driven marketing technology. Key Responsibilities: - Data Integration & Transformation: Design and build robust ETL/ELT pipelines to unify data across disparate AdTech platforms and marketing tools. - Platform Development: Contribute to building a marketi...

You are a highly skilled and experienced Data Architect with expertise in cloud-based solutions. You will be responsible for designing, implementing, and optimizing data architecture to meet the organization's current and future needs. Your role will involve data modeling, transformation, governance, and hands-on experience with modern cloud platforms and tools such as Snowflake, Spark, Data Lakes, and Data Warehouses. Collaboration with cross-functional teams and stakeholders is crucial, and you will establish and enforce standards and guidelines across data platforms to ensure consistency, scalability, and best practices. You will be accountable for architecting and implementing scalable, ...

About Markovate: At Markovate, you don't just follow trends, we drive them. We transform businesses through innovative AI and digital solutions that turn vision into reality. Our team harnesses breakthrough technologies to craft bespoke strategies that align seamlessly with our clients" ambitions. From AI Consulting And Gen AI Development To Pioneering AI Agents And Agentic AI, We Empower Our Partners To Lead Their Industries With Forward-thinking Precision And Unmatched Overview. We are seeking a highly experienced and innovative Senior Data Engineer with a strong background in hybrid cloud data integration, pipeline orchestration, and AI-driven data modelling. Requirements: - 9+ years of e...

Horizontal Digital is an experience-forward consultancy dedicated to helping organizations meet and exceed customer expectations while delivering exceptional results. By prioritizing customers at the core of all operations, we empower them to build stronger possibilities alongside our clients. Our solutions are crafted with a strategic approach, creativity, and precise execution, leveraging platforms such as Sitecore, Salesforce, and other enterprise technologies. Dive deeper into our expertise by exploring some of our sample case studies. As a Data and Technical Architect specializing in Salesforce Data Cloud at Horizontal Digital, you will be entrusted with a pivotal role as a leader in te...

Forma.ai is a Series B startup that is at the forefront of transforming the way sales compensation is designed, managed, and optimized, handling billions in annual managed commissions for industry leaders such as Edmentum, Stryker, and Autodesk. The company's growth is driven by a strong commitment to revolutionizing how companies leverage sales intelligence to shape business strategies. Forma.ai is seeking equally ambitious individuals who are enthusiastic about contributing to something significant. As the Analytics Manager reporting to the VP of Analytics & Data Science, you will play a crucial role in new customer implementations by translating business requirements into code. Working wi...

As the Head of Data at our Bengaluru (Bellandur) location, you will be responsible for leading the design, development, and optimization of ETL/ELT pipelines to process structured and unstructured data. You will play a key role in maintaining a modern data warehouse/lakehouse architecture, implementing data partitioning, indexing, and performance tuning strategies, and ensuring robust cataloging, data quality rules, validation checks, and monitoring systems are in place. Additionally, you will define appropriate data privacy and security guidelines and take ownership of business metrics from extracting and exploring data to evaluating methods and results rigorously. Collaborating with stakeh...

As a Data Architect with over 6 years of experience, you will be responsible for designing and implementing modern data lakehouse architectures on cloud platforms such as AWS, Azure, or GCP. Your primary focus will be on defining data modeling, schema evolution, partitioning, and governance strategies to ensure high-performance and secure data access. In this role, you will own the technical roadmap for scalable data platform solutions, ensuring they are aligned with enterprise needs and future growth. You will also provide architectural guidance and conduct code/design reviews across data engineering teams to maintain high standards of quality. Your responsibilities will include building an...

As a Data Engineer at Tata Electronics Private Limited (TEPL), you will play a crucial role in architecting and implementing scalable offline data pipelines for manufacturing systems, ensuring the smooth functioning of various components such as AMHS, MES, SCADA, PLCs, vision systems, and sensor data. Your expertise in designing and optimizing ETL/ELT workflows using tools like Python, Spark, SQL, and Airflow will be instrumental in transforming raw data into actionable insights. You will lead database design and performance tuning activities across SQL and NoSQL systems, optimizing schema design, queries, and indexing strategies to enhance the efficiency of manufacturing data processing. Yo...

As a Data Platform Engineer at our company, you will be at the forefront of a significant transformation in our data capabilities. You will collaborate closely with a Staff Data Architect and Engineer to design and establish the next generation lakehouse and analytics platform. This platform will serve as the foundation driving our company's growth and innovation in the upcoming phase. In this role, you will have the unique opportunity to construct an entire modern data stack from scratch by integrating cutting-edge open-source tools and cloud-native infrastructure. Your responsibilities will include defining, designing, prototyping, and delivering a robust lakehouse and analytics platform u...

A career in the Advisory Acceleration Centre at PwC is an opportunity to leverage PwC's global delivery capabilities and provide premium, cost-effective, and high-quality services to support client engagements. As an Azure Senior Developer at PwC - AC, you will collaborate with the Offshore Manager and Onsite Business Analyst to grasp the project requirements and take charge of the complete implementation of Cloud data engineering solutions. Your role will involve utilizing your expertise in Azure cloud services such as Storage services (Blob, ADLS, PaaS SQL), Azure Data Factory, and Azure Synapse. You should excel in planning, organization, and have the ability to lead as a cloud developer ...

As a Senior Data Architect, you will play a crucial role in designing and implementing scalable, secure, and high-performance Big Data architectures using Databricks, Apache Spark, and cloud-native services. Your expertise will be essential in leading the end-to-end data architecture lifecycle, from requirements gathering to deployment and optimization. Additionally, you will design repeatable and reusable data ingestion pipelines for various ERP source systems like SAP, Salesforce, HR, Factory, and Marketing systems. Collaboration with cross-functional teams to integrate SAP data sources into modern data platforms will be a key aspect of your role, along with driving cloud cost optimization...

A career in our Advisory Acceleration Centre is the natural extension of PwC's leading-class global delivery capabilities. We provide premium, cost-effective, high-quality services that support process,

Capgemini is seeking a skilled and motivated Business Analyst to become part of the team dedicated to General Insurance Data Platform Modernization. The client is a prominent global insurance company recognized for its innovation, scale, and dedication to excellence. This position is integral to a strategic data modernization initiative aimed at revolutionizing the enterprise data landscape across various regions. We are in search of an experienced Business Analyst with a strong background in data-driven projects within the financial services sector, particularly in general insurance. The ideal candidate will have a crucial role in connecting business requirements with technical implementati...

As a member of the data engineering team at PepsiCo, you will play a crucial role in developing and overseeing data product build & operations. Your primary responsibility will be to drive a strong vision for how data engineering can proactively create a positive impact on the business. Working alongside a team of data engineers, you will build data pipelines, rest data on the PepsiCo Data Lake, and facilitate exploration and access for analytics, visualization, machine learning, and product development efforts across the company. Your contributions will directly impact the design, architecture, and implementation of PepsiCo's flagship data products in areas such as revenue management, suppl...

At EY, youll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And we're counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all. We are looking for a BI Senior Consultant to join the EY GDS Team. As part of our EY GDS TechOps team, you will be responsible for providing expert-level business intelligence support with a strong focus on Power BI and Databricks. You will work across various regions for our global clients, helping to design, develop, and maintain insightful ...

As an API & Data Integration Engineer at our Advanced Intelligence Work Group, you will be responsible for designing, building, and maintaining backend integrations across internal systems, third-party APIs, and AI copilots. Your role will involve API development, data pipeline engineering, no-code automation, and cloud-based architecture with a primary focus on scalability, security, and compliance. Key Responsibilities: - Building and maintaining RESTful APIs using FastAPI - Integrating third-party services such as CRMs and SaaS tools - Developing and managing ETL/ELT pipelines for real-time and batch data flows - Automating workflows using tools like n8n, Zapier, Make.com - Collaborating ...

The job is based in Hyderabad/Bangalore/Chennai and at Gramener, you will find a welcoming work environment with diverse colleagues, a clear career path, and ample opportunities for growth and innovation. The company aims to develop a range of easily configurable data applications focused on storytelling for both public and private use. As part of your role, you will be involved in various impactful customer technical data platform projects, taking the lead on strategic initiatives that cover the design, development, and deployment of cutting-edge solutions. Collaboration with platform engineering teams will be key in implementing Data Brick services effectively within the company's infrastr...

As an AWS Consultant specializing in Infrastructure, Data & AI, and Databricks, you will play a crucial role in designing, implementing, and optimizing AWS Infrastructure solutions. Your expertise will be utilized to deliver secure and scalable data solutions using various AWS services and platforms. Your responsibilities will also include architecting and implementing ETL/ELT pipelines, data lakes, and distributed compute frameworks. You will be expected to work on automation and infrastructure as code using tools like CloudFormation or Terraform, and manage deployments through AWS CodePipeline, GitHub Actions, or Jenkins. Collaboration with internal teams and clients to gather requirements...

We are looking for a highly skilled Software Engineer with a strong expertise in Python and a solid understanding of data engineering principles to join our team. As a Software Engineer, you will be responsible for developing and optimizing scalable applications and data workflows, integrating diverse data sources, and supporting the development of data-driven products. This role requires hands-on experience in software development, data modeling, ETL/ELT pipelines, APIs, and cloud-based data systems. You will collaborate closely with product, data, and engineering teams to build high-quality, maintainable, and efficient solutions that support analytics, machine learning, and business intell...

As a Technical Lead / Data Architect, you will play a crucial role in our organization by leveraging your expertise in modern data architectures, cloud platforms, and analytics technologies. In this leadership position, you will be responsible for designing robust data solutions, guiding engineering teams, and ensuring successful project execution in collaboration with the project manager. Your key responsibilities will include architecting and designing end-to-end data solutions across multi-cloud environments such as AWS, Azure, and GCP. You will lead and mentor a team of data engineers, BI developers, and analysts to deliver on complex project deliverables. Additionally, you will define a...

As a Data Engineer at GlobalLogic, you will be responsible for architecting, building, and maintaining complex ETL/ELT pipelines for batch and real-time data processing using various tools and programming languages. Your key duties will include optimizing existing data pipelines for performance, cost-effectiveness, and reliability, as well as implementing data quality checks, monitoring, and alerting mechanisms to ensure data integrity. Additionally, you will play a crucial role in ensuring data security, privacy, and compliance with relevant regulations such as GDPR and local data laws. To excel in this role, you should possess a Bachelor's or Master's degree in Computer Science, Engineerin...