790 Etl Pipelines Jobs - Page 15

Role Overview: At WRD, we are redefining the world of IT consulting by merging human expertise with cutting-edge AI technology. Join us to work on the forefront of AI-powered innovation, where your skills drive real impact, creativity meets advanced technology, and each project sets a new standard in IT excellence. Key Responsibilities: - Develop & Maintain data pipelines to support business and analytical needs. - Work with structured and unstructured data to ensure high data quality and availability. - Build scalable and efficient data workflows using SQL, Python, and Java/Scala. - Manage and process large datasets on AWS EMR and other cloud platforms. - Develop and maintain batch and stre...

Greetings!!! Role : Senior Data Engineer with GCP, ETL Location- 100 % Remote Exp Range- 4+ Yrs Notice Period- Immediate Joiners only. Duration- 4 months Contract Time: 11 am to 8 pm IST Must have skills: 1. GCP - GCS, PubSub, Dataflow or DataProc, Bigquery, Airflow/Composer, Python(preferred)/Java 2. ETL on GCP Cloud - Build pipelines (Python/Java) + Scripting, Best Practices, Challenges 3. Knowledge of Batch and Streaming data ingestion, build End to Data pipelines on GCP 4. Knowledge of Databases (SQL, NoSQL), On-Premise and On-Cloud, SQL vs No SQL, Types of No-SQL DB (At least 2 databases) 5. Data Warehouse concepts - Beginner to Intermediate level If you are interested , please share yo...

You will be responsible for testing ETL pipelines with a focus on source to target validation. Your key skills will include: - Proficiency in SSMS (SQL Server Management Studio) - Familiarity with Azure Synapse, including understanding of medallion architecture and PySpark notebooks - Strong understanding of Data Warehousing - Excellent communication skills - Extensive experience working in Agile Qualifications required for this role: - Minimum 5 years of experience as an ETL Test Engineer - Proficiency in SSMS, Azure Synapse, and testing ETL pipelines - Strong understanding of Data Warehousing concepts - Excellent communication skills - Experience working in Agile environments The company o...

Why Choose Decision Point At Decision Point , we empower data-driven transformation by delivering innovative, scalable, and future-ready analytics solutions. With a proven track record in the CPG, Retail, and Manufacturing industries, we combine deep domain expertise with cutting-edge technologies to enable smarter decisions at every level of the enterprise. By joining our team, youll be part of a collaborative culture that values creativity, learning, and continuous improvement. We offer opportunities to work on high-impact projects with global clients, and leverage the latest cloud and data engineering tools to solve real-world business challenges. Key Responsibilities Design, develop, and...

Walk-in Drive | Senior Data Engineer | 310 Years Experience | 16th18th Sep 2025 | 10 AM–5 PM Are you ready to take the next big leap in your data engineering career? We are hiring Senior Data Engineers with 3–10 years of experience for a dynamic team that's shaping the future of data-driven solutions. Walk-in Dates: 16th, 17th, and 18th September 2025 Time: 10:00 AM – 5:00 PM Location: One International Center, Tower 2, 27th Floor, Senapati Bapat Marg, Near Prabhadevi Railway Station, Mumbai - 400013 Role: Senior Data Engineer Must-Have Skills Python (Advanced): Data processing & automation ETL Pipelines: Design, build, maintain using Talend Studio SQL & NoSQL: Complex queries and data handl...

DESCRIPTION We are seeking a highly skilled Data Engineer to join our FinTech ADA team, responsible for building and optimizing scalable data pipelines and platforms that power analytics, automation, and decision-making across Finance and Accounting domains. The ideal candidate will have strong expertise in AWS cloud technologies including Redshift, S3, AWS Glue, EMR, Kinesis, Firehose, Lambda, and IAM, along with hands-on experience designing secure, efficient, and resilient data architectures. You will work with large-scale structured and unstructured datasets, leveraging both relational and non-relational data stores (object storage, key-value/document databases, graph, and column-family ...

Job Purpose This position is open with Bajaj Finance Ltd. Duties and Responsibilities Looking for a Senior SQL Developer with 78 years of deep experience in advanced database architecture, SQL and PL/SQL programming, complex query optimization, and hands-on Azure cloud data solutions. This position will involve leadership in Azure-based data pipelines, integration services, and modern data warehousing. Required Qualifications and Experience Looking for a Senior SQL Developer with 78 years of deep experience in advanced database architecture, SQL and PL/SQL programming, complex query optimization, and hands-on Azure cloud data solutions. This position will involve leadership in Azure-based da...

DESCRIPTION Have you ever wondered how Amazon shipped your order so fast Wondered where it came from or how much it cost us To help describe some of our challenges, we created a short video about Supply Chain Optimization at Amazon - http://bit.ly/amazon-scot We are seeking a Data Engineer to join our team. Amazon has a culture of data-driven decision-making and demands business intelligence that is timely, accurate, and actionable. Your work will have an immediate influence on day-to-day decision making at Amazon.com. As an Amazon Data Engineer you will be working in one of the world's largest and most complex data warehouse environments. We maintain one of the largest data marts in Amazon ...

Job Title: Hadoop Administrator Location: Chennai, India Experience: 5 yrs of experience in IT, with At least 2+ years of experience with cloud and system administration. At least 3 years of experience with and strong understanding of big data technologies in Hadoop ecosystem Hive, HDFS, Map/Reduce, Flume, Pig, Cloudera, HBase Sqoop, Spark etc. Company: Smartavya Analytica Private limited is a niche Data and AI company. Based in Pune, we are pioneers in data-driven innovation, transforming enterprise data into strategic insights. Established in 2017, our team has experience in handling large datasets up to 20 PBs in a single implementation, delivering many successful data and AI projects acr...

Key Responsibilities Design, build, and maintain ETL pipelines using Azure Data Factory (preferably Fabric Data Factory) and SQL. Write and optimize complex SQL logic to ensure performance and scalability across large datasets. Ensure data quality, monitoring, and observability with restartability, idempotency, and debugging principles in mind. Enhance ETL processes with Python scripting where applicable. Collaborate with business unit partners to translate requirements into effective data solutions. Document workflows, standards, and best practices; mentor junior team members. Implement version control (GitHub) and CI/CD practices across SQL and ETL processes. Work with Azure components suc...

Key Responsibilities 1. Lead a team of developers in the design, implementation, and maintenance of data processing applications using apache spark, scala, and python. 2. Collaborate with cross functional teams to gather requirements, analyze data, and develop scalable solutions. 3. Troubleshoot and resolve technical issues related to data processing applications. 4. Implement best practices in coding, testing, and deployment processes. 5. Stay updated on the latest trends and advancements in apache spark, scala, and python technologies. Skill Requirements 1. Proficiency in apache spark, scala, and python programming languages. 2. Strong understanding of data processing concepts and distribu...

Job Description: You will be responsible for leading the configuration, maintenance, and optimization of the organization's network and security infrastructure to ensure high performance and reliability. Your key responsibilities will include: - Architecting and integrating networks across multiple business units and diverse cloud environments, ensuring seamless connectivity and scalability. - Championing the use of Infrastructure as Code processes to automate and maintain infrastructure consistency, scalability, and up-to-date configurations. - Overseeing the configuration, deployment, and management of F5 Local Traffic Managers (LTMs) and Advanced Security Modules (ASMs) to ensure seamless...

We are seeking a Senior Engineer to join our Data Ingestion team, primarily supporting OCI cloud migration activities, system architecture, and technical enablement. This role is pivotal to ensuring seamless migration, maintaining robust architecture, and ensuring the stability and scalability of our data ingestion pipelines. Design, implement, and optimize scalable data ingestion architectures. Provide technical guidance and mentorship within the engineering team. Collaborate with product and strategy teams to align technical execution with business goals. Troubleshoot and resolve complex issues in large-scale distributed systems. Ensure data integrity, availability, and performance across ...

The Company PayPal has been revolutionizing commerce globally for more than 25 years. Creating innovative experiences that make moving money, selling, and shopping simple, personalized, and secure, PayPal empowers consumers and businesses in approximately 200 markets to join and thrive in the global economy. We operate a global, two-sided network at scale that connects hundreds of millions of merchants and consumers. We help merchants and consumers connect, transact, and complete payments, whether they are online or in person. PayPal is more than a connection to third-party payment networks. We provide proprietary payment solutions accepted by merchants that enable the completion of payments...

Job Title: Engineering (IN) - Software Engineer 2 Job Description: What You'll Do The Marketing Engineering organization in Strategy, Planning & Operations is looking for a Data Engineer eager to provide the engineering muscle for core engineering work around data architecture, data pipeline development, and deploying production workflows to continue improving our data & reporting needs for Marketing in an AI future. You will be responsible for: • Working with a technical leader to lead major engineering initiatives to support decision-making by the business • You will help manage production data workflows, ensuring timely updates are made through a standard SDLC process. • You will help des...

Key Responsibilities Lead and mentor a team of data engineers, providing technical guidance, performance feedback, and career development. Architect, develop, and maintain scalable ETL/ELT pipelines using AWS services , PySpark , SQL , and Python . Drive the design and implementation of robust data models and data warehouses/lakes to support analytics and reporting. Ensure data quality, security, and governance across all stages of the data lifecycle. Collaborate with product and engineering teams to integrate data solutions into production environments. Optimize data workflows and performance across large, complex datasets. Manage stakeholder relationships and translate business needs into ...

Interested can directly whatsapp or call me at 6369973379 Job Title: Lead Data Engineer - Data Integrator Experience: 10.1 15 Years Job Description We are seeking a Lead Data Engineer with strong expertise in Informatica, Python, and Kubernetes. The role involves leading data integration initiatives, designing scalable ETL pipelines, and ensuring seamless data orchestration across platforms. Key Responsibilities Lead the design, development, and deployment of data integration solutions using Informatica and Python Manage large-scale ETL pipelines and optimize data workflows Deploy and orchestrate workloads on Kubernetes Collaborate with architects, analysts, and business stakeholders to deli...

Gen AI Full Stack Engineer - We are seeking a Full Stack Engineer with experience in building web applications integrated with Generative AI solutions. The role involves developing scalable front-end and back-end systems, implementing LLM-based features, and deploying AI-powered applications on the cloud. Data Engineer - We are seeking a skilled Data Engineer to design, build, and maintain scalable data pipelines and architectures. The role involves working closely with data scientists, analysts, and business stakeholders to ensure seamless data flow, quality, and availability across systems. Data Architect - We are looking for a Data Architect to design and implement scalable, secure, and h...

Experience- 6 to 11 years Location- Coimbatore- Key Responsibilities: Design and build scalable ELT pipelines in Snowflake using DBT/SQL . Develop efficient, well-tested DBT models (staging, intermediate, and marts layers). Implement data quality, testing, and monitoring frameworks to ensure data reliability and accuracy. Optimize Snowflake queries, storage, and compute resources for performance and cost-efficiency. Collaborate with cross-functional teams to gather data requirements and deliver data solutions. Required Qualifications: 6+ years of experience as a Data Engineer, with at least 5 years working with Snowflake . Proficient with DBT (Data Build Tool) including Jinja templating, mac...

Job Description Role & responsibilities Analyze large, complex datasets to identify patterns and trends Build and deploy predictive models and machine learning algorithms Collaborate with data engineers and business stakeholders to define problem statements and deliver solutions Create clear visualizations and dashboards to present data insights Implement data cleaning, validation, and transformation techniques Support automation of reporting processes and recurring data analysis tasks Stay up to date with latest developments in data science and AI Preferred candidate profile 1 to 3 years of experience in Data Science or related field Proficiency in Python (including libraries such as Pandas...

Job Description Job Description Overview As a leading global aerospace company, Boeing develops, manufactures and services commercial airplanes, defense products and space systems for customers in more than 150 countries. As a top U.S. exporter, the company leverages the talents of a global supplier base to advance economic opportunity, sustainability and community impact. Boeing's team is committed to innovating for the future, leading with sustainability, and cultivating a culture based on the company's core values of safety, quality and integrity. Technology for today and tomorrow The Boeing India Engineering & Technology Center (BIETC) is a 5500+ engineering workforce that contributes to...

As a Python + Gen AI Developer with 3-6 years of experience, your core responsibilities will include developing and maintaining backend services using Python frameworks such as FastAPI and Flask. You will also be responsible for building and integrating RESTful APIs with cloud-native architectures, implementing CI/CD pipelines, and containerized deployments. Additionally, you will transition to designing LLM-powered applications, RAG pipelines, and Agentic AI systems. To be successful in this role, you must have a strong foundation in Python fundamentals with at least 2 years of experience in object-oriented programming, data structures, and clean code practices. Proficiency in at least one ...

Position: Snowflake Data Engineer Work Location: Hyderabad(WFO) Experience : 3+ About the opportunity : We are seeking a highly skilled and experienced Snowflake Developer with a strong background in SQL, Python, and a minimum of 3 years of hands-on experience with Snowflake. The ideal candidate will be a Snowflake Certified with a proven track record in data warehousing, data modelling, and implementing ETL/ELT pipelines using industry-standard tools. Primary Roles & Responsibilities • Design, develop, and optimize data pipelines and ETL/ELT processes in Snowflake. • Develop and optimize complex SQL queries for data extraction, transformation, and reporting. • Write robust Python scripts fo...

Responsibilities: * Design, develop & maintain data pipelines using ETL, SQL, Python & AWS. * Optimize data warehousing solutions for performance & scalability.

Experience: 8+ years of experience in the data field, with a proven track record of success in data engineering, data analysis, and data science. Education: Bachelor's or Master's degree in Computer Science, Engineering, Statistics, or a related field. Technical Skills: Expert proficiency in SQL and at least one programming language such as Python or R. Extensive experience with cloud platforms (e.g., AWS, GCP, Azure). Hands-on experience with big data technologies (e.g., Spark, Hadoop). Strong understanding of database technologies, including both relational (e.g., PostgreSQL, MySQL) and NoSQL (e.g., MongoDB, Cassandra) databases.