1586 Data Pipeline Jobs - Page 35

Role Responsibilities : - Design and implement data pipelines using MS Fabric. - Develop data models to support business intelligence and analytics. - Manage and optimize ETL processes for data extraction, transformation, and loading. - Collaborate with cross-functional teams to gather and define data requirements. - Ensure data quality and integrity in all data processes. - Implement best practices for data management, storage, and processing. - Conduct performance tuning for data storage and retrieval for enhanced efficiency. - Generate and maintain documentation for data architecture and data flow. - Participate in troubleshooting data-related issues and implement solutions. - Monitor and...

About the Job : We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. In this pivotal role, you will be instrumental in driving our data engineering initiatives, with a strong emphasis on leveraging Dataiku's capabilities to enhance data processing and analytics. You will be responsible for designing, developing, and optimizing robust data pipelines, ensuring seamless integration of diverse data sources, and maintaining high data quality and accessibility to support our business intelligence and advanced analytics projects. This role requires a unique blend of expertise in traditional data engineering principles, advanced data modeling, and a forward-...

About The Opportunity : A fast-scaling technology company operating in the Enterprise AI / Generative AI sector, building production-grade LLM-driven products and intelligent automation for global clients. We deliver secure, low-latency generative systems that power conversational AI, summarization, code generation, and retrieval-augmented applications across cloud-native environments. We are hiring a Senior Generative AI Engineer (7+ years) to own architecture, model development, and production deployment of advanced generative systems. This is a fully remote role for candidates based in India. Role & Responsibilities : - Lead end-to-end design and delivery of Generative AI/LLM solutionsdat...

Salary: 25 to 40 LPA Exp: 5 to 10 years Location: Gurgaon/Pune/Bengalore Notice: Immediate to 30 days..!! Job Profile: Experienced Data Engineer with a strong foundation in designing, building, and maintaining scalable data pipelines and architectures. Skilled in transforming raw data into clean, structured formats for analytics and business intelligence. Proficient in modern data tools and technologies such as SQL, T-SQL, Python, Databricks, and cloud platforms (Azure). Adept at data wrangling, modeling, ETL/ELT development, and ensuring data quality, integrity, and security. Collaborative team player with a track record of enabling data-driven decision-making across business units. As a Da...

Why Join Decision Point? Work with a top-tier analytics consulting firm known for data-driven innovation. Get exposure to Fortune 500 clients and real-world impact projects. Be part of a collaborative culture that encourages leadership and learning. Solve complex business problems using cutting-edge tech across domains Key Responsibilities Lead and deliver end-to-end data engineering projects in a fast-paced environment Design and implement scalable data pipelines using PySpark , SQL , and orchestration tools Develop robust data models to support analytics and reporting Optimize data storage and processing on AWS (Glue, S3, Redshift, Lambda) and Azure (ADF, Synapse, Blob Storage) Collaborate...

Who We Are At Kyndryl, we design, build, manage and modernize the mission-critical technology systems that the world depends on every day. So why work at Kyndryl? We are always moving forward – always pushing ourselves to go further in our efforts to build a more equitable, inclusive world for our employees, our customers and our communities. The Role Are you ready to dive headfirst into the captivating world of data engineering at Kyndryl? As a Data Engineer, you'll be the visionary behind our data platforms, crafting them into powerful tools for decision-makers. Your role? Ensuring a treasure trove of pristine, harmonized data is at everyone's fingertips. As a Data Engineer at Kyndryl, you...

About the Job : We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. In this pivotal role, you will be instrumental in driving our data engineering initiatives, with a strong emphasis on leveraging Dataiku's capabilities to enhance data processing and analytics. You will be responsible for designing, developing, and optimizing robust data pipelines, ensuring seamless integration of diverse data sources, and maintaining high data quality and accessibility to support our business intelligence and advanced analytics projects. This role requires a unique blend of expertise in traditional data engineering principles, advanced data modeling, and a forward-...

Experience: Minimum 5 yrs. Work Location: Client office in Delhi. Remote working options are not available. We are seeking a skilled Data Engineer with at least 5 years of experience to join our data analytics team, focusing on building robust data pipelines and systems to support the creation of dynamic dashboards. The role involves designing, building, and optimizing data architecture, enabling real-time data flow for visualization and analytics. The Data Engineer will be responsible for managing ETL processes, ensuring data quality, and supporting the scalable integration of various data sources into our analytics platform. The ideal candidate should have extensive experience in working w...

This role is accountable for running day to day operations of Data Platform in Azure / AWS Databricks NCS. Data Engineer is accountable for ongoing Development, Enhancement support and maintenance data availability and data quality, performance enhancement and stability of the system. Designing and implementing data ingestion pipelines from multiple sources using Azure Databricks Ensure data pipelines run smoothly and efficiently Adherence to security, regulatory and audit control guidelines Drive optimization, continuous improvement and efficiency Roles and Responsibilities 1 Designing and implementing data ingestion pipelines from multiple sources using Azure Databricks 2 Ensure data pipel...

Role Responsibilities : - Design and implement data pipelines using MS Fabric. - Develop data models to support business intelligence and analytics. - Manage and optimize ETL processes for data extraction, transformation, and loading. - Collaborate with cross-functional teams to gather and define data requirements. - Ensure data quality and integrity in all data processes. - Implement best practices for data management, storage, and processing. - Conduct performance tuning for data storage and retrieval for enhanced efficiency. - Generate and maintain documentation for data architecture and data flow. - Participate in troubleshooting data-related issues and implement solutions. - Monitor and...

About The Opportunity : A fast-scaling technology company operating in the Enterprise AI / Generative AI sector, building production-grade LLM-driven products and intelligent automation for global clients. We deliver secure, low-latency generative systems that power conversational AI, summarization, code generation, and retrieval-augmented applications across cloud-native environments. We are hiring a Senior Generative AI Engineer (7+ years) to own architecture, model development, and production deployment of advanced generative systems. This is a fully remote role for candidates based in India. Role & Responsibilities : - Lead end-to-end design and delivery of Generative AI/LLM solutionsdat...

About the job : Role : Microsoft Fabric Data Engineer Experience : 6+ years as Azure Data Engineer including at least 1 E2E Implementation in Microsoft Fabric. Responsibilities : - Lead the design and implementation of Microsoft Fabric-centric data platforms and data warehouses. - Develop and optimize ETL/ELT processes within the Microsoft Azure ecosystem, effectively utilizing relevant Fabric solutions. - Ensure data integrity, quality, and governance throughout Microsoft Fabric environment. - Collaborate with stakeholders to translate business needs into actionable data solutions. - Troubleshoot and optimize existing Fabric implementations for enhanced performance. Skills : - Solid foundat...

Role & responsibilities Certifications 1. Minimum: Google Professional Cloud Architect 2. Alternate: Google Professional Data Engineer Big Data Specialty Certification 7+ years direct experience working in Enterprise Data Warehouse technologies 3+ years in a customer facing role working with enterprise clients Experience with implementing and/or maintaining technical solutions in virtualized environments. Experience in design, architecture and implementation of Data warehouses, data pipelines and flows. Experience with developing software code in one or more languages such as Java and Python. Proficient with SQL Experience designing and deploying large scale distributed data processing syste...

As a Tester in an agile team, your role goes beyond testing both Word Add-in & React Web app software. You will be the quality champion empowering teams to build highly performant and secure systems. It is essential to approach testing entrepreneurially by exploring unhappy paths and edge cases to ensure a highly resilient system. Your expertise in automated and manual testing will be crucial in efficiently covering the system's functionality while maintaining high quality standards. Adapting to a dynamic work environment, you are committed to the principle of automating everything. Your responsibilities will include ensuring thorough testing of every feature developed by the team, utilizing...

You will be responsible for leading the design, implementation, and deployment of enterprise-grade IoT solutions across diverse environments. This includes defining architecture and system integration strategy for IoT deployments, managing end-to-end IoT infrastructure, and collaborating with various teams to ensure cohesive and secure implementations. Your role will involve driving standardization of best practices, leading field rollouts and large-scale implementations, as well as developing and maintaining documentation and configuration guides. Additionally, you will provide technical mentorship to junior engineers, conduct code/device reviews, and continuously evaluate and implement new...

Hi, Greetings from HR Central! Job Title: AWS Data Engineer Location: Airoli, Navi Mumbai (Work from Office) Client: A leading global partner in sustainable construction Experience: 4 to 8 years Education: BE / B.Tech Certification: AWS (preferred) Job Description: Strong hands-on experience in Python programming (mandatory) Expertise in Data Engineering with exposure to large-scale projects/accounts Hands-on experience with AWS Big Data platforms Redshift, Glue, Lambda, Data Lakes, Data Warehouses Strong skills in SQL, Spark, PySpark Experience in building data pipelines and data integration workflows Exposure to orchestration tools like Airflow, Luigi, Azkaban Apply Now: Interested candida...

Are you ready to design, build, and scale next-gen data solutions? Do you thrive on turning data into decisions and guiding teams toward success? What Were Looking For: 10+ years in Datawarehousing & ETL Hands-on with Azure, Databricks, ADF, Synapse, PySpark/Python Strong in STTM (Source-to-Target Mapping), design & documentation mentor at heart who can guide junior talent Good to Have: Certifications in Azure/Data Engineering Banking exposure in Risk & Regulatory / Commercial / Credit Cards / Retail What You'll Achieve With Us: Architect & optimize cloud-first data ecosystems Solve real-world enterprise-scale data challenges Be the trusted expert in a high-impact role Grow into leadership a...

Position: Snowflake Data Engineer Work Location: Hyderabad(WFO) Experience : 3+ About the opportunity : We are seeking a highly skilled and experienced Snowflake Developer with a strong background in SQL, Python, and a minimum of 3 years of hands-on experience with Snowflake. The ideal candidate will be a Snowflake Certified with a proven track record in data warehousing, data modelling, and implementing ETL/ELT pipelines using industry-standard tools. Primary Roles & Responsibilities • Design, develop, and optimize data pipelines and ETL/ELT processes in Snowflake. • Develop and optimize complex SQL queries for data extraction, transformation, and reporting. • Write robust Python scripts fo...

Project Planning, Tracking, & Reporting • Contribute into the initial coding estimates. • Support the team in project planning activities and in evaluating risks. • Communicate regularly with the team about development changes, scheduling, and status. Design • Understand assigned detailed (LLD) design and do code development Job Description – Data Engineer As a Data Engineer, you will play a key role in this exciting journey. Your contributions will go beyond coding, as you'll help bring life to ideas, transforming innovative ideas into tangible solutions that directly impact our business and customers. You'll work in an innovative, fast-paced environment, collaborating with bright minds whi...

So, what’s the role all about? Step into the role of a Software Engineer and become an integral part of our team developing the Contact Center Copilot solution. You will work on data integration, leveraging Python and AWS services to enable seamless ingestion of external system data into AWS Bedrock Knowledge Base. You’ll have the opportunity to learn, grow, and contribute to cutting-edge technologies while ensuring high-quality deliverables. How will you make an impact? Build and maintain data pipelines for external system integration. Write efficient Python scripts to automate processes. Develop serverless solutions using AWS Lambda and API Gateway. Collaborate with the team to integrate S...

Responsibilities: * Design, develop & maintain data pipelines using ETL, SQL, Python & AWS. * Optimize data warehousing solutions for performance & scalability.

Job Description Data Scientist/Data Analyst/ Data Engineer About the Role: We are seeking a highly skilled Data Scientist to join our dynamic team. The ideal candidate will have a strong background in SQL, Excel, Power BI, Python, PySpark, and data pipelines. You will be responsible for analyzing complex data sets, creating excel reports and Power BI dashboards, developing predictive models, and providing actionable insights to drive business decisions. Responsibilities: Collect, clean, and analyze data from various sources. Design and maintain data pipelines to ensure data quality and integrity. Develop and maintain reports and dashboards in excel and Power BI. Utilize SQL and Python and Py...

Role Responsibilities : - Design and implement data pipelines using MS Fabric. - Develop data models to support business intelligence and analytics. - Manage and optimize ETL processes for data extraction, transformation, and loading. - Collaborate with cross-functional teams to gather and define data requirements. - Ensure data quality and integrity in all data processes. - Implement best practices for data management, storage, and processing. - Conduct performance tuning for data storage and retrieval for enhanced efficiency. - Generate and maintain documentation for data architecture and data flow. - Participate in troubleshooting data-related issues and implement solutions. - Monitor and...

About the Job : We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. In this pivotal role, you will be instrumental in driving our data engineering initiatives, with a strong emphasis on leveraging Dataiku's capabilities to enhance data processing and analytics. You will be responsible for designing, developing, and optimizing robust data pipelines, ensuring seamless integration of diverse data sources, and maintaining high data quality and accessibility to support our business intelligence and advanced analytics projects. This role requires a unique blend of expertise in traditional data engineering principles, advanced data modeling, and a forward-...

Urgent Hiring: AWS Data Engineer, Senior Data Engineers & Lead Data Engineers Apply Now: Send your resume to heena.ruchwani@gspann.com Location: Bangalore (5+ Years Experience) Company: GSPANN Technologies, Inc. GSPANN Technologies is seeking talented professionals with 5+ years of experience to join our team in Bangalore. We are looking for immediate joiners who are passionate about data engineering and eager to take on exciting challenges. Key Skills & Experience: 5+ years of hands-on experience with AWS Data Services (Glue, Redshift, S3, Lambda, EMR, Athena, etc.) Strong expertise in Big Data Technologies (Spark, Hadoop, Kafka) Proficiency in SQL, Python, and Scala Hands-on experience wit...