1019 Data Lake Jobs - Page 40

#Employment Type: Contract Skills Azure Data Factory SQL Azure Blob Azure Logic Apps

locationsIN - Bangaloreposted onPosted Today time left to applyEnd DateMay 22, 2025 (5 days left to apply) job requisition idR140300 Company Overview A.P. Moller - Maersk is an integrated container logistics company and member of the A.P. Moller Group. Connecting and simplifying trade to help our customers grow and thrive . With a dedicated team of over 95,000 employees, operating in 130 countries; we go all the way to enable global trade for a growing world . From the farm to your refrigerator, or the factory to your wardrobe, A.P. Moller - Maersk is developing solutions that meet customer needs from one end of the supply chain to the other. About the Team At Maersk, the Global Ocean Manife...

Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by inclusion, talented peers, comprehensive benefits and career development opportunities. Come make an impact on the communities we serve as you help us advance health optimization on a global scale. Join us to start Caring. Connecting. Growing together. As part of our strategic initiative to build a centralized capability around data and cloud engineering, we are est...

Project Role : Software Development Engineer Project Role Description : Analyze, design, code and test multiple components of application code across one or more clients. Perform maintenance, enhancements and/or development work. Must have skills : BlueYonder Order Management Good to have skills : NAMinimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :Role Overview:We are looking for an experienced Integration Architect to lead the design and execution of integration strategies for Blue Yonder (BY) implementations across cloud-native environments. The ideal candidate will possess strong expertise in integrating supply chain platforms w...

As an Data Engineer at IBM you will harness the power of data to unveil captivating stories and intricate patterns. You'll contribute to data gathering, storage, and both batch and real-time processing. Collaborating closely with diverse teams, you'll play an important role in deciding the most suitable data management systems and identifying the crucial data required for insightful analysis. As a Data Engineer, you'll tackle obstacles related to database integration and untangle complex, unstructured data sets. In this role, your responsibilities may include Implementing and validating predictive models as well as creating and maintain statistical models with a focus on big data, incorporat...

Job Title : Data Modelling SME Lead About the role: As the Data Modelling Senior SME you will collaborate with business partners across Digital Operational Excellence, Technology, and Castrols PUs, HUBs, functions, and Markets to model and sustain curated datasets within the Castrol Data ecosystem. The role ensures agile, continuous improvement of curated datasets aligned with the Data Modelling Framework and supports analytics, data science, operational MI, and the broader Digital Business Strategy. On top of the Data lake we now have enabled the MLOPS environment (PySpark Pro) and Gurobi with direct connections to run the advance analytics and data science queries and algorithms written in...

Job Description Summary Are you ready to see your career take flight? At GE Aerospace, we believe the world works better when it flies. We are a world-leading provider of jet engines, components, and integrated systems for commercial and military aircraft. We have a relentless dedication to the future of safe and more sustainable flight and believe in our talented people to make it happen. The Flight Safety and Reliability Data Scientist will play a pivotal role within GE Aerospaces Flight Safety Organization (FSO), driving initiatives that enhance Flight Safety and GE Aerospaces Safety Management System (SMS). This position focuses on designing and developing innovative digital tools to sup...

Role & responsibilities Key Responsibilities • Design end-to-end data lakehouse architecture on AWS • Create data ingestion, transformation, and modeling strategies • Guide metadata-driven framework development • Ensure scalability, performance tuning, and security design • Collaborate with Security, Infra, and QA teams for architecture compliance Required Skills & Tech Stack • AWS S3, Glue, Glue Catalog, DMS, Redshift, Lambda, DynamoDB • Lakehouse architecture patterns • Data governance & lineage (DataZone, Glue Crawlers) • Python, PySpark, Terraform (preferred) Certifications & Other Requirements • AWS Certified Solutions Architect (Professional preferred) • 10+ years in data engineering/a...

About the Role We are seeking a highly skilled Snowflake Developer to join our team in Bangalore. The ideal candidate will have extensive experience in designing, implementing, and managing Snowflake-based data solutions. This role involves developing data architectures and ensuring the effective use of Snowflake to drive business insights and innovation. Key Responsibilities: Design and implement scalable, efficient, and secure Snowflake solutions to meet business requirements. Develop data architecture frameworks, standards, and principles, including modeling, metadata, security, and reference data. Implement Snowflake-based data warehouses, data lakes, and data integration solutions. Mana...

Key Responsibilities Design, develop, and maintain scalable ETL pipelines using Azure Data Factory , Azure Databricks , and other Azure services. Implement data ingestion, transformation, and integration workflows from multiple structured/unstructured sources. Work with Azure Data Lake Storage , Azure SQL Database , and Azure Synapse Analytics for data warehousing and analytics. Perform data modeling (star/snowflake schemas), database management, and query optimization. Ensure data security and compliance within Azure environments. Collaborate with cross-functional teams to align data solutions with business needs. Participate in DevOps practices for CI/CD deployment of data engineering solu...

Position summary: A Specialist shall work with the development team and responsible for development task as individual contribution. He/she should be able to mentor team and able to help in resolving issues. He/she should be technical sound and able to communicate with client perfectly. Key duties & responsibilities Work as Lead Developer Data engineering project for E2E Analytics. Ensure Project delivery on time. Mentor other team mates and guide them. Will take the requirement from client and communicate as well. Ensure Timely documents creation for knowledge base, user guides, and other various communications systems. Ensures delivery against Business needs, team goals and objectives, i.e...

Snowflake, Azure, Python/Pyspark are Mandatory Skills Building and orchestrating ETL pipe lines using Databricks Workflows or Apache Airflow Understanding of Delta Lake for ACID transactions and scalable Experience with Azure, or Google Cloud Platform CI/CD DevOps, Version control (Git), automated testing, and deployment pipelines Experience with AI/ML integration and development. Experience with Delta Lakehouse architecture, Star Schema, Data Lake etc. Monitor integration flows using Data pipelines. Debug and resolve integration issues and performance bottlenecks Strong communication and collaboration skills Mandatory Skills: Data Engineering Full Stack.Experience: 5-8 Years.

Position summary: A user shall work with the development team and responsible for development task as individual contribution .He/she should be technical sound and able to communicate with client perfectly . Key duties & responsibilities: Work as Specialist Data engineering project for E2E Analytics. Ensure Project delivery on time. Mentor other team mates and guide them. Will take the requirement from client and communicate as well. Ensure Timely documents creation for knowledge base, user guides, and other various communications systems. Ensures delivery against Business needs, team goals and objectives, i.e., meeting commitments and coordinating overall schedule. Works with large datasets...

Job Title: DBA Architect Azure ADF, Databricks – 15+ Years – Noida – Immediate Joiners Payroll: Venpa Staffing Services (Preferred) | PERMANENT also acceptable Work Location: Noida (Onsite) Shift: EST Shift Notice Period: Immediate Joiners Only CTC: As per market standards. Job Summary: BrickRed Systems, through Venpa Staffing Services, is urgently hiring a DBA Architect with deep expertise in Azure Data Factory (ADF) , Azure Databricks , and Data Fabric technologies . This is a high-impact onsite role for experienced architects with 15+ years of end-to-end data platform expertise and leadership experience. Key Responsibilities: Architect and implement scalable, secure, and enterprise-grade ...

Data Consultant: Ability to clearly identify and communicate potential data and analytics problems with business stakeholders and end users Translate business problems into analytical solutions leveraging Data management / Business Intelligence / Analytics techniques Anticipate, identify, structure, and suggest functional solutions for data and analytical problems Identify and provide suggestions in extracting, integrating, and analyzing data Analyze large datasets using SQL and/or Visualization tools Conduct quantitative analysis and interpret results Identify and design key performance metrics and indicators Data Profiling in data lake, files or in any sources. Build data mapping documents...

12+ years of related experience with a Bachelors degree; or 10 years and a Master’s degree; or a PhD with 8 years applied industry experience; or equivalent experience. 10+ years of experience in data and advanced analytics At least 8 years of experience working on data technologies in Azure/AWS Experience building modern products and infrastructure Experience working with .Net/Java and Microservice Architecture Expertise in SQL and Python Expertise in SQL Server, Azure Data Services, and other Microsoft data technologies. Expertise in Databricks, Microsoft Fabric Strong understanding of data modeling, data warehousing, data lakes, data mesh and data products.

Role & responsibilities As a senior manager, you will Lead and inspire engineering across a range of exciting, new front and backend projects that are a combination of web applications, integrated architecture, data processing / analytics platform using Python, Django, PostgreSQL, Kafka and MongoDB. Assist in hiring, managing, training and mentoring an engineering team of backend, frontend and database developers. Ensure the skills and experience of the current team are consistent with current organizational requirements Get into the trenches (hands-on development) with a collaborative team to guide architecture and deliver innovative solutions Have the ability to work with large data sets a...

Data Modeling Developing conceptual, logical and physical data models that meet the business requirements. Database design - To optimize data storage, retrieval and performance in relational data databases, NoSql databases, Data warehouses, Data lakes (or Lakehouse). Data integration Integrating data from various sources such as internal databases, external APIs, third-party services. Data Migration - Must have experience of SQL Server to Azure migration and SSIS to ADF migration Data governance Implementing data governance policies, standards and procedures to ensure data catalog, data quality, data security (encryption and data masking if required), compliance and privacy. Data architectur...

Job Title : Data Engineer Experience : 6+ Years Location : Pune Work Mode : Work From Office (WFO) Employment Type : Full-Time Job Profile : We are looking for an experienced and proactive Data Engineer to lead and manage critical data infrastructure that powers our products and analytics. The selected candidate will be responsible for designing and scaling high-performance data pipelines and models across both our Data Lake and Data Warehouse environments. This role focuses on improving the reliability , scalability , and automation of our data systems to ensure high-quality, trustworthy data delivery across the organization. Skill Set Required : ETL Orchestration and workflows (Airflow) Pr...

About the role We are seeking a highly skilled and experienced Data Architect to join our team. The ideal candidate will have at least 1 2 years of experience in s oftware & data engineering and a nalytics and a proven track record of designing and implementing complex data solutions. Y ou will be expected to design, create, deploy, and manage Blackbauds data architecture. This role has considerable technical influence within the Data Platform, Data Engineering teams, and the Data Intelligence Center of Excellence at?Blackbaud. This?individual acts as an evangelist for proper data strategy with other teams at Blackbaud and assists with the technical direction, specifically with data, of othe...

About the Role We are seeking a highly skilled and experienced Data Architect to join our team. The ideal candidate will have at least 18 years of experience in Data engineering and Analytics and a proven track record of designing and implementing complex data solutions. As a senior principal data architect, you will be expected to design, create, deploy, and manage Blackbaud’s data architecture. This role has considerable technical influence within the Data Platform, Data Engineering teams, and the Data Intelligence Center of Excellence at Blackbaud. This individual acts as an evangelist for proper data strategy with other teams at Blackbaud and assists with the technical direction, specifi...

About the role We are seeking a highly skilled and experienced Data Architect to join our team. The ideal candidate will have at least 1 2 years of experience in s oftware & data engineering and a nalytics and a proven track record of designing and implementing complex data solutions. Y ou will be expected to design, create, deploy, and manage Blackbauds data architecture. This role has considerable technical influence within the Data Platform, Data Engineering teams, and the Data Intelligence Center of Excellence atBlackbaud. Thisindividual acts as an evangelist for proper data strategy with other teams at Blackbaud and assists with the technical direction, specifically with data, of other ...

As an Data Engineer at IBM you will harness the power of data to unveil captivating stories and intricate patterns. You'll contribute to data gathering, storage, and both batch and real-time processing. Collaborating closely with diverse teams, you'll play an important role in deciding the most suitable data management systems and identifying the crucial data required for insightful analysis. As a Data Engineer, you'll tackle obstacles related to database integration and untangle complex, unstructured data sets. In this role, your responsibilities may include: Implementing and validating predictive models as well as creating and maintain statistical models with a focus on big data, incorpora...

As an Data Engineer at IBM you will harness the power of data to unveil captivating stories and intricate patterns. You'll contribute to data gathering, storage, and both batch and real-time processing. Collaborating closely with diverse teams, you'll play an important role in deciding the most suitable data management systems and identifying the crucial data required for insightful analysis. As a Data Engineer, you'll tackle obstacles related to database integration and untangle complex, unstructured data sets. In this role, your responsibilities may include: Implementing and validating predictive models as well as creating and maintain statistical models with a focus on big data, incorpora...

As an Data Engineer at IBM you will harness the power of data to unveil captivating stories and intricate patterns. You'll contribute to data gathering, storage, and both batch and real-time processing. Collaborating closely with diverse teams, you'll play an important role in deciding the most suitable data management systems and identifying the crucial data required for insightful analysis. As a Data Engineer, you'll tackle obstacles related to database integration and untangle complex, unstructured data sets. In this role, your responsibilities may include: Implementing and validating predictive models as well as creating and maintain statistical models with a focus on big data, incorpora...