779 Etl Pipelines Jobs - Page 16

Job Description Summary As Technical Product Manager for our Data Products, you will join our GridOS Data Fabric product management team who are delivering solutions designed to accelerate decarbonization by managing DERs at scale and proactively manage disruptions from climate change. Specifically, you will be accountable for managing technical product lifecycle activities around our core Data Products in partnership with our own & partner development teams to build trusted data products for our GridOS ADMS applications. Job Description Roles and Responsibilities Technical product management, responsible for delivering Data Products in partnership with both GE Vernova & partner development ...

Responsibilities: * Design, develop & maintain data pipelines using Snowflake, DBT,SQL, ETL tools. * Collaborate with cross-functional teams on project requirements & deliverables. Office cab/shuttle

Responsibilities: * Design, develop & optimize databases using Azure Synapse Analytics, PostgreSQL & ETL pipelines. * Collaborate with cross-functional teams on data warehousing projects. Health insurance Free meal Accidental insurance

As a Database Administrator (DBA) at our company, you will be responsible for designing, managing, and optimizing databases to ensure performance and scalability for our SaaS-based CRM Platform in the Study Abroad & EdTech industry. Your role will be pivotal in maintaining the data backbone of our platform. Your key responsibilities will include designing, implementing, and maintaining SQL and NoSQL databases such as MySQL, PostgreSQL, and MongoDB. You will be optimizing database performance, query efficiency, and data storage while ensuring database security, backup, recovery, and disaster recovery strategies are in place. Collaboration with development teams to enhance database queries and...

As a highly skilled Solution Architect at Quest Global, your primary responsibility will be to drive innovation and deliver impactful, scalable solutions tailored to our customers" needs. In this pivotal role, you will be developing proof of concepts, designing and leading solution implementations that enhance our offerings. Upon successful completion of the POCs, you will also be mentoring and guiding engineers in developing production-ready solutions. Your role will involve building architectures, whether new or rearchitecting existing products, and creating POCs to validate new Enterprise architectures, with a focus on Cloud technologies such as AI, Gen AI, and Data pipe enhancements. You...

As a Data Engineer, you will be responsible for designing and implementing next-generation data pipelines, analytics, and Business Intelligence solutions. You will manage various AWS resources such as RDS, EMR, MWAA, and Lambda. Your primary focus will be on developing high-quality data architecture and pipelines to support business analysts and data scientists. Collaborating with other technology teams, you will extract, transform, and load data from diverse sources. Additionally, you will work towards enhancing reporting and analysis processes by automating self-service support for customers. You should have a solid background with 7-10 years of data engineering experience, including exper...

We are seeking a talented individual to join our IT team at Marsh McLennan. This role will be based in Pune/Noida/GGN/Mumbai. This is a hybrid role that has a requirement of working at least three days a week in the office. As a Data Engineer, you will be responsible for designing and implementing scalable data pipelines using Databricks and the Medallion Architecture. You will handle end-to-end ETL/ELT processes, manage large datasets, and work with tools like Python, PySpark, and AWS S3 to ensure data is transformed and optimized for analytical use. Additionally, knowledge on Informatica, Unix, and Oracle database is also a good to have. We will count on you to: Develop and maintain data p...

The GCP Architect is responsible for designing and implementing scalable, robust, and secure cloud solutions on Google Cloud Platform. You need to have a deep understanding of cloud architecture and services, strong problem-solving skills, and the ability to lead cross-functional teams in delivering complex cloud projects. You should possess excellent leadership, communication, and interpersonal skills. Strong problem-solving abilities, attention to detail, and the capability to work in a fast-paced, dynamic environment while managing multiple priorities are essential. In terms of technical skills, you must have a strong understanding of GCP services such as Compute Engine, App Engine, Kuber...

We help the world run better At SAP, we enable you to bring out your best. Our company culture is focused on collaboration and a shared passion to help the world run better. How We focus every day on building the foundation for tomorrow and creating a workplace that embraces differences, values flexibility, and is aligned to our purpose-driven and future-focused work. We offer a highly collaborative, caring team environment with a strong focus on learning and development, recognition for your individual contributions, and a variety of benefit options for you to choose from. What you'll do: You will take an ownership of designing and building core integration frameworks that enable real-time,...

Role & responsibilities Skill - Data engineer python AWS Exp - 10+ Location - Gurugram NP - only immediate joiners needed Preferred candidate profile We are seeking an experienced Lead Data Engineer with strong expertise in Python, AWS cloud services, ETL pipelines, and system integrations. The ideal candidate will lead the design, development, and optimization of scalable data solutions and ensure seamless API and data integrations across systems. You will collaborate with cross-functional teams to implement robust DataOps and CI/CD pipelines. Key Responsibilities: Responsible for implementation of scalable, secure, and high-performance data pipelines. Design and develop ETL processes using...

About the Tech@Lilly Organization: Tech@Lilly builds and maintains capabilities using cutting edge technologies like most prominent tech companies. What differentiates Tech@Lilly is that we create new possibilities through tech to advance our purpose u2013 creating medicines that make life better for people around the world, like data driven drug discovery and connected clinical trials. We hire the best technology professionals from a variety of backgrounds, so they can bring an assortment of knowledge, skills, and diverse thinking to deliver innovative solutions in every area of the enterprise. About the Business Function: Tech@Lilly Business Units is a global organization strategically pos...

Roles and Responsibilities Design, develop, test, deploy, and maintain large-scale data pipelines using Snowflake as the primary database engine. Collaborate with cross-functional teams to gather requirements and design solutions that meet business needs. Develop complex SQL queries to extract insights from large datasets stored in Snowflake tables. Troubleshoot issues related to data quality, performance tuning, and security compliance. Participate in code reviews to ensure adherence to coding standards and best practices. Desired Candidate Profile 3-7 years of experience working with Snowflake as a Data Engineer or similar role. Strong understanding of SQL programming language with ability...

Databricks Snowflake Data Engineer Design, develop, and maintain scalable ETL pipelines using Databricks to process, transform, and load large datasets into snowflake or other data stores. Collaborate with cross-functional teams, including data architects, analysts, and business stakeholders, to gather data requirements and deliver efficient data solutions. Exposure to Snowflake Warehouse and exposure in SnowSQL. Experience in loading data into snowflake Data model using Pyspark Pipelines. Implementing data validation and cleansing procedures will ensure the quality, integrity, and dependability of the data. Improve the scalability, efficiency, and cost-effectiveness of data pipelines. Monit...

You are a skilled Data Engineer with over 4 years of experience, seeking a role in Trivandrum (Hybrid) for a contract duration of 6+ months in IST shift. Your main responsibility will be to design and develop data warehouse solutions utilizing Azure Synapse Analytics, ADLS, ADF, Databricks, and Power BI. You will be involved in building and optimizing data pipelines, working with large datasets, and implementing automation using DevOps/CI/CD frameworks. Your expertise should lie in Azure, AWS, Terraform, ETL, Python, and data lifecycle management. You will collaborate on architecture frameworks and best practices while working on data warehouse design and implementation. In this role, you wi...

Experience- 6 to 11 years Location- Kolkata, Bhubaneshwar, Nagpur Key Responsibilities: Design and build scalable ELT pipelines in Snowflake using DBT/SQL . Develop efficient, well-tested DBT models (staging, intermediate, and marts layers). Implement data quality, testing, and monitoring frameworks to ensure data reliability and accuracy. Optimize Snowflake queries, storage, and compute resources for performance and cost-efficiency. Collaborate with cross-functional teams to gather data requirements and deliver data solutions. Required Qualifications: 6+ years of experience as a Data Engineer, with at least 5 years working with Snowflake . Proficient with DBT (Data Build Tool) including Jin...

Roles and Responsibilities: Lead end-to-end delivery of data engineering and analytics projects , ensuring timelines, quality, and stakeholder satisfaction. Collaborate with data engineers, data analysts, cloud architects , and business stakeholders to define project scope and objectives. Manage project planning, resource allocation, budgeting, and risk assessment for data-focused initiatives. Translate business requirements into technical specifications for engineering and analytics teams. Coordinate and track progress across cross-functional teams (engineering, analytics, QA, DevOps, etc.). Monitor and report project health, risks, and dependencies using Agile or hybrid methodologies . Ens...

Job Title - Snowflake Data Engineer Key Skills - Snowflake , Snowpipe , Data Warehousing , Advance SQL Job Description: Design, develop, and maintain robust ELT/ETL data pipelines to load structured and semi-structured data into Snowflake. Implement data ingestion workflows using tools like Azure Data Factory, Informatica, DBT, or custom Python/SQL scripts. Write and optimize complex SQL queries, stored procedures, views, and UDFs within Snowflake. Use Snowpipe for continuous data ingestion and manage tasks, streams, and file formats for near real-time processing Optimize query performance using techniques like clustering keys, result caching, materialized views, and pruning strategies. Moni...

Only immediate joiner preferred. Experience: 8-12 years Responsibilities: Design, develop & maintain ETL pipelines using Python, PySpark & SQL on AWS/Azure/GCP. Collaborate with cross-functional teams for data transformation & quality assurance.

Analyzing solutions through the lens of client requirement metrics as well as business domain Conceptual thinking and the ability to find innovative ways to solve analytical problems Engage with leadership and diversified stakeholder groups to understand their analytical needs and recommend Business intelligence solutions. Own the design, development, and maintenance of ongoing performance metrics, reports, analyses, dashboards, etc. to drive key business decisions Work with data engineering, Machine learning and software development teams to enable the appropriate capture and storage of key data points Conduct written and verbal presentations to share insights and recommendations to audienc...

The job involves taking on the role of a Gen AI Developer + Architect with specific responsibilities related to Azure AI services. Your main focus will be on developing and architecting solutions using Azure OpenAI Service and other AI technologies. You should have a deep understanding of Azure AI services, especially Azure OpenAI Service, and be proficient in large language models (LLMs) and their architectures. Additionally, you should possess expertise in Azure Machine Learning and Azure Cognitive Services, along with a strong knowledge of Azure cloud architecture and best practices. In this role, you will be expected to work on prompt engineering and fine-tuning LLMs, while also ensuring...

Job Responsibilities Design, build & maintain scalable data pipelines for ingestion, processing & storage. Collaborate with data scientists, analysts, and product teams to deliver high-quality data solutions. Optimize data systems for performance, reliability, scalability, and cost-efficiency . Implement data quality checks ensuring accuracy, completeness, and consistency. Work with structured & unstructured data from diverse sources. Develop & maintain data models, metadata, and documentation . Automate & monitor workflows using tools like Apache Airflow (or similar). Ensure data governance & security best practices are followed. Required Skills & Qualifications Bachelors/Master’s degree in...

Technical / Behavioral - You must have proven track record of working in collaborative teams to deliver high quality data solutions in a multi-developer agile environment following design & coding best practices. You must be an expert in using SQL queries with UNIX shell /Python scripting skills. You should have experience of using AWS services like EC2, S3, EMR to move data onto cloud platform and experience with Enterprise data lake strategy and use of Snowflake (AWS) is a big plus. You must have knowledge to develop ELT/ETL pipelines to move data to and from Snowflake data store using combination of Python and Snowflake SnowSQL is a big plus. You should have experience in SQL performance ...

Job Title : Senior Data Engineer Work location Pune Let me tell you about the role Data Engineer designs and builds scalable data management systems that support application simplification efforts. They develop and maintain databases and large-scale processing systems to enable efficient data collection, analysis, and integration. Key responsibilities include ensuring data accuracy for modeling and analytics, optimizing data pipelines for scalability, and collaborating with data scientists to drive data-driven decision-making. They play a crucial role in supporting the teams goals by enabling seamless access to reliable data for simplification initiatives. What you will deliver As part of a ...

As a skilled professional in the field of cloud computing and data engineering, you will be responsible for a variety of tasks related to managing data assets, developing ETL pipelines, and exploring machine learning capabilities. Your expertise in technologies such as Git, Kubernetes, Docker, and Helm will be essential in ensuring the smooth functioning of cloud infrastructure on platforms like AWS and Azure. Your role will involve the evaluation and analysis of data using tools like AWS QuickSight, as well as the deployment of machine learning models through AWS MLOps. Proficiency in AWS services such as Glue, QuickSight, SageMaker, Lambda, and Step Functions will be crucial for success in...

As a Lead Data Engineer with over 7 years of experience, you will be responsible for designing, developing, and maintaining data pipelines, ETL processes, and data warehouses. You will be based in Hyderabad and should be able to join immediately. Your primary skills should include proficiency in SQL, Python, PySpark, AWS, Airflow, Snowflake, and DBT. Additionally, you should have a Bachelor's or Master's degree in Computer Science, Information Systems, Engineering, or a related field. In this role, you will need a minimum of 4+ years of hands-on experience in data engineering, ETL, and data warehouse development. You should have expertise in ETL tools such as Informatica Power Center or IDMC...