1507 Data Lake Jobs - Page 3

Role Overview: You will be responsible for designing and implementing scalable and secure cloud architecture on cloud platforms like AWS, Azure, and GCP. Your expertise in building enterprise-grade data platforms using technologies such as Databricks, Snowflake, Spark, and Data Lake/Warehouse solutions will be crucial in supporting advanced analytics and AI/ML integrations. Additionally, you will conduct research and development for custom architecture PoCs, including AI/ML model deployment, security enhancements, and scalable data workflows to meet evolving business needs. Key Responsibilities: - Design and deploy data pipelines with technologies like AWS (S3, Lambda, Glue, Data Pipeline), ...

Title and Summary Manager, Finance Modernization The Manager of the Finance Modernization Project will support the transformation of our finance operations, driving the implementation of advanced analytics, AI capabilities, and cloud migration strategies in support of the overall Controllership function. This 12-month project role will be pivotal in enhancing Financial and Statutory reporting capabilities, improving operational efficiency, and enabling business growth through innovative financial solutions. Role: Support the Finance Modernization initiative for the Controllership organization, ensuring alignment with strategic goals and objectives Drive the analysis of COA and CDE data dimen...

Roles and Responsibilities A Databricks Platform Administrator is a crucial role responsible for the effective design, implementation, maintenance, and optimization of the Databricks Lakehouse Platform within an organization. This individual ensures the platform is scalable, performant, secure, and aligned with business objectives, providing essential support to data engineers, data scientists, and analysts. Key Responsibilities: 1. Provision and configure Databricks workspaces, clusters, pools, and jobs across environments. 2. Create catalogs, schemas, access controls, and lineage configurations. 3. Implement identity and access management using account groups, workspace-level permissions, ...

What can you expect in a VP, Data Engineering & Architecture role with TaskUs: We are seeking a hands-on Vice President of Data Engineering and Architecture to lead the strategy, design, and implementation of our enterprise data ecosystem. This person will define how data is structured, stored, and leveraged to drive analytics, automation, and AI initiatives across the organization. The ideal candidate will have deep expertise in architecting large-scale data warehouses and data lakes , with a strong command of OLAP and OLTP concepts. Key Responsibilities Data Architecture Leadership:Design and implement scalable, high-performance data architectures including data warehouses (AWS Redshift, S...

Design and implement data pipelines for data ingestion, transformation, and loading using Microsoft Fabric tools. Develop and maintain data warehouses and data lakes within the Fabric environment. Create and manage data models for efficient data storage and retrieval. Build and deploy data science models using Fabrics machine learning capabilities. Develop real-time analytics solutions for streaming data processing. Create and maintain Power BI reports and dashboards for data visualization and analysis. Collaborate with cross-functional teams to understand data requirements and provide data solutions. Monitor and optimize the performance of data solutions. Ensure data security and compliance...

The Microsoft Fabric role involves designing, implementing, and managing data solutions using Microsoft Fabric This includes data integration, data warehousing, data science, real-time analytics, and business intelligence The role requires a strong understanding of data engineering principles, cloud computing, and the Microsoft Fabric platform Responsibilities:Design and implement data pipelines for data ingestion, transformation, and loading using Microsoft Fabric tools Develop and maintain data warehouses and data lakes within the Fabric environment Create and manage data models for efficient data storage and retrieval Build and deploy data science models using Fabrics machine learning cap...

Role Design, Build & Optimize Scalable Data Solutions and End-to-End Pipelines Responsibilities Develop, and deploy end-to-end data pipelines and solutions on Databricks, integrating with various data sources and systems. Collaborate with cross-functional teams to understand data, and deliver effective BI solutions. Implement data ingestion, transformation, and processing workflows using Spark (PySpark/Scala), SQL, and Databricks notebooks. Develop and maintain data models, ETL/ELT processes ensuring high performance, reliability, scalability and data quality. Build and maintain APIs and data services to support analytics, reporting, and application integration. Ensure data quality, integrit...

Your role and responsibilities As an Data Engineer at IBM you will harness the power of data to unveil captivating stories and intricate patterns. You'll contribute to data gathering, storage, and both batch and real-time processing. Collaborating closely with diverse teams, you'll play an important role in deciding the most suitable data management systems and identifying the crucial data required for insightful analysis. As a Data Engineer, you'll tackle obstacles related to database integration and untangle complex, unstructured data sets. In this role, your responsibilities may include: Implementing and validating predictive models as well as creating and maintain statistical models with...

Job Overview: Database engineer with experience in Database management, Data analytics, good knowledge in writing queries to extract the data, automate the report generation through reporting tools. Key Responsibilities: Plan and define the overall data analytics architecture Establish data governance to ensure data quality & security Design end-to-end analytics solutions including Data ingestion, Data storage, Analytics layer Understand the data requirements from various departments Extract data from database by writing queries and sharing the reports with the stakeholders Automate the frequently used data reports using the Reporting tool (MS Power BI) and provide secured access to stakehol...

About The Role Project Role : Application Support Engineer Project Role Description : Act as software detectives, provide a dynamic service identifying and solving issues within multiple components of critical business systems. Must have skills : EPIC Systems Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Support Engineer, you will act as software detectives, providing a dynamic service that identifies and resolves issues within various components of critical business systems. Your typical day will involve collaborating with different teams, analyzing system performance, and ensuring tha...

About The Role Project Role : Business and Integration Practitioner Project Role Description : Assists in documenting the integration strategy endpoints and data flows. Is familiar with the entire project life-cycle, including requirements analysis, coding, testing, deployment, and operations to ensure successful integration. Under the guidance of the Architect, ensure the integration strategy meets business goals. Must have skills : Personal Insurance Good to have skills : NA Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Business and Integration Practitioner, you will play a crucial role in assisting with the documentati...

About The Role Project Role : Business and Integration Practitioner Project Role Description : Assists in documenting the integration strategy endpoints and data flows. Is familiar with the entire project life-cycle, including requirements analysis, coding, testing, deployment, and operations to ensure successful integration. Under the guidance of the Architect, ensure the integration strategy meets business goals. Must have skills : Personal Insurance Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Business and Integration Practitioner, you will assist in documenting the integration strategy endpoint...

Job Overview: Database engineer with experience in Database management, Data analytics, good knowledge in writing queries to extract the data, automate the report generation through reporting tools. Key Responsibilities: Plan and define the overall data analytics architecture Establish data governance to ensure data quality & security Design end-to-end analytics solutions including Data ingestion, Data storage, Analytics layer Understand the data requirements from various departments Extract data from database by writing queries and sharing the reports with the stakeholders Automate the frequently used data reports using the Reporting tool (MS Power BI) and provide secured access to stakehol...

Role & responsibilities Hands-on experience with Microsoft Azure and Databricks. Proven experience delivering at least one end-to-end Data Lakehouse solution on Azure Databricks using the Medallion Architecture. Strong working knowledge of the Databricks ecosystem, including: PySpark, Notebooks, Structured Streaming, Unity Catalog, Delta Live Tables, Workflows, and SQL Warehouse. Advanced programming, unit testing, and debugging skills in Python and SQL. Hands-on experience with Azure-native services such as: Azure Data Factory, ADLS Gen2, Azure SQL Database, and Event Hub. Solid understanding of data modeling techniques, including both Dimensional and Third Normal Form (3NF) models. Exposur...

Summary: As a Data Engineer & AI Developer, you will play a key role in transforming complex data into clear, actionable insights. You will be responsible for building robust data pipelines, developing interactive dashboards, and integrating cutting-edge AI techniques to enhance our data processes and insights. This is a unique opportunity to blend expertise in data engineering and visualization with a forward-thinking approach to artificial intelligence. Key Responsibilities: ETL/ELT Development: Design, build, and optimize scalable data pipelines using ETL/ELT processes to ingest, clean, and transform large datasets from various sources. AI-Powered Data Engineering: Implement and manage AI...

Skill: Data Engineer Experience: 6+ Years Location: Bangalore & Pune Shift Timings: 4:00 PM to 1:00 AM IST Mode: Hybrid Notice Period: Immediate - 15 Days Must-Have Skills: Minimum of 6 years of Data Engineering Experience Must be an expert in SQL, Data lake, Azure, ETL Must be an expert in data modeling Incorta experience is a plus Excellent oral and written communication skills Self-starter with analytical, organizational, and problem-solving skills Must be highly flexible and adaptable to change Power BI Strong programming skills in languages such as SQL, Python Experience with data modelling, data warehousing, and dimensional modelling concept Familiarity with data governance, data secur...

Dear , Greetings from Tekskills India Pvt Ltd (CMMI Level3 Company) !!! Pleasure mailing you ! We have an immediate job requirement. Below are the job details, Please go through below job description.If you are suitable and interested, please send your updated word resume inline to the JD & share the below submission details. Please Share the Below Details: Passport Size Photo : Offer letter/ Relieving letter screenshot/ LWD email screenshot: Total Experience: Relevant Experience: Current Location: Preferred Location: Current CTC: Expected CTC: Notice Period: DOB: Offers/ Pipelines: Job title: - Data Engineer Location: Bengaluru & Pune (Relocation is considered) Shift Timings: 4:00 PM to 1:0...

Job Summary: The Principal Digital Architect will provide strategic leadership for the overall architecture of the Manufacturing and Supply Digital Platform by designing platform capabilities that anticipate evolving business requirements and use cases. The role will collaborate with peer architects and Enterprise Capability Owners to deliver diverse use cases thru applications, analytics, agents, and business intelligence. The position holds accountability for developing an enterprise-wide data architecture, creating reusable data components that can be assembled into datasets for business applications, analytics, business intelligence, agents, and digital twin solutions. Additionally, the ...

Job Summary: The Principal Digital Architect will provide strategic leadership for the overall architecture of the Manufacturing and Supply Digital Platform by designing platform capabilities that anticipate evolving business requirements and use cases. The role will collaborate with peer architects and Enterprise Capability Owners to deliver diverse use cases thru applications, analytics, agents, and business intelligence. The position holds accountability for developing an enterprise-wide data architecture, creating reusable data components that can be assembled into datasets for business applications, analytics, business intelligence, agents, and digital twin solutions. Additionally, the ...

Role & responsibilities 6+ years of experience in software development, data engineering, ETL, and analytics reporting development Experience in building and maintaining data and system integrations using dimensional data modelling and optimized ETL pipelines. Proven track record of designing and implementing complex data solutions Demonstrated understanding and experience using: Python & PySpark: Ability to write efficient scripts for data transformation, and pipeline orchestration, knowledge of Spark or any distributing frameworks Knowledge of data modelling and data architecture principles Familiarity with event-driven architectures , API -based data sources , data quality validation, arc...

Hiring: Data Engineer | Java + Azure Cloud | Bangalore (Hybrid) Were looking for a Data Engineer with strong Java and Azure Cloud experience to join our growing engineering team. If youre passionate about building scalable cloud data solutions and working with cutting-edge technologies, we’d love to connect! Key Skills & Experience: Strong programming in Java (Python or SQL a plus) Hands-on experience with Azure Cloud (Data Lake, Synapse, Fabric) Expertise in Data Engineering – ingestion, transformation, and ETL pipelines Experience with data streaming technologies – Kafka , Flink , or Confluent Exposure to Power BI (PBI) for dashboards and reporting Solid understanding of cloud architecture...

Overview Job Summary: We are looking for a skilled GCP Data Engineer with 3 to 6 years of experience to join our dynamic team. The ideal candidate will have a strong background in data engineering, cloud technologies, and experience with Google Cloud Platform (GCP) services. You will be responsible for designing, building, and maintaining scalable data pipelines and frameworks that support our data analytics and machine learning initiatives. Key Responsibilities: Design and implement data pipelines using GCP services such as BigQuery, Dataflow, and Pub/Sub. Collaborate with data scientists and analysts to understand data needs and deliver appropriate solutions. Optimize data storage and proc...

Role Description : As a Data Engineer, you will play a crucial role in designing and implementing data pipelines to support business intelligence and analytics initiatives. You will work closely with data analysts, data scientists, and business stakeholders to understand data requirements and create efficient data models. Key Responsibilities : - Design and implement data pipelines to extract, transform, and load data from various sources into a centralized data warehouse or data lake - Collaborate with data analysts and business stakeholders to understand data requirements and create efficient data models - Optimize data pipelines for performance, scalability, and reliability using tools li...

The Principal Digital Architect will provide strategic leadership for the overall architecture of the Manufacturing and Supply Digital Platform by designing platform capabilities that anticipate evolving business requirements and use cases. The role will collaborate with peer architects and Enterprise Capability Owners to deliver diverse use cases thru applications, analytics, agents, and business intelligence. The position holds accountability for developing an enterprise-wide data architecture, creating reusable data components that can be assembled into datasets for business applications, analytics, business intelligence, agents, and digital twin solutions. Additionally, the role will lev...

Job Title: Solution Architect - Technology Job Description: We are seeking a skilled Solution Architect to join our dynamic team. The ideal candidate will be responsible for designing, and implementing, Data warehouse and Data Lake processes to support our digital platforms analytics needs. The Solution Architect will collaborate closely with analysts, database administrators, and business users to understand requirements and deliver efficient solutions. Responsibilities: Design, develop, and maintain data management processes using industry best practices and tools like AWS and Microsoft Fabric Lakehouses, Amazon Redshift, Amazon Quicksight, AWS Glue, Kafka, Data Factory, Synapse, PowerBI. ...