1507 Data Lake Jobs

Lead the data engineering team by driving the design, build, test, and launch of new data pipelines and models on the production data platform Define and implement the processes needed to achieve operational excellence in all areas, including agile development, and data solutions Oversee the design, development and maintenance of data infrastructure, including data warehouses, data lakes, data integration components supporting optimal extraction, transformation, and loading of data Leading the communication with vendors, clients, the leadership team, and other stakeholders to facilitate effective project management and provide ongoing support Collaborate with business owners for roadmap plan...

1.Relevant accredited certifications for Azure, AWS, Cloud Engineering, and/or Databricks Data Engineering expertise in Big Data Management using Cloudera, Python, Hive, Scala, Data Warehouse, Data Lake, AWS, Azure 1 Designing and implementing data ingestion pipelines from multiple sources using Azure Databricks 2 Ensure data pipelines run smoothly and efficiently 3 Developing scalable and re-usable frameworks for ingesting of data sets 4 Integrating the end-to-end data pipeline - to take data from source systems to target data repositories ensuring the quality and consistency of data is maintained at all times 5 Working with event based / streaming technologies to ingest and process data 6 ...

Design and implement data architecture and pipelines using PySpark, Python, and AWS services (Glue, EMR, S3, Redshift, Athena). Modernize legacy systems by converting Java-based migration or ETL scripts into Spark-based solutions. Build and manage data lakes and data warehouses optimized for analytics and AI/ML workflows. Collaborate with data scientists and analysts to enable model training, deployment, and continuous data delivery. Define and document HLD (High-Level Design) and LLD (Low-Level Design) for scalable data systems. Implement standards for data quality, governance, performance optimization, and security. Lead troubleshooting, performance tuning, and architecture reviews for dat...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Python (Programming Language) Good to have skills : NA Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will engage in the design, construction, and configuration of applications tailored to fulfill specific business processes and application requirements. You should have Data Engineering Lead with extensive experience in Python, AWS, and large-scale data platform design. This role requires strategic thinki...

About The Role Project Role : Application Support Engineer Project Role Description : Act as software detectives, provide a dynamic service identifying and solving issues within multiple components of critical business systems. Must have skills : EPIC Systems Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Support Engineer, you will act as software detectives, providing a dynamic service that identifies and resolves issues within various components of critical business systems. Your typical day will involve collaborating with different teams, analyzing system performance, and ensuring tha...

PURPOSE OF THE ROLE Provide Analysis & Design model (High Level Design) / Architecture and a direction for a projectOwn Analysis & Design model (HLD) or architecture of a projectEnsure quality of technical deliverables of a project KEY RESPONSIBILITIES AND ACCOUNTABILITIES 1. Interact with business and technical stakeholders to understand requirements, challenges and expectations2. Understand the customer and end user requirement (both explicit and implicit)3. Ensure quality of deliverables to the satisfaction of the customer and end user expectation4. Support functional requirements gathering.5. Ensure all the non-functional requirement is captured 1. Understanding requirements of the proje...

Responsible for defining and implementing data governance policies, ensuring data security, quality, and compliance across the organization Share your CV: talent@hireindians.com OR Call/Whatsapp: 8882212459

Data engineering with a focus on data migration ,Azure Data Factory Exp in Python/PySpark for data manipulation and automation. Experience with Azure DevOps for CI/CD Skills ADB, ADF, Deltalake/Datalake and Pyspark, Data Modelling Unity Catalog

Role & responsibilities Total Experience of 4-8years Hands on experience in python coding is must . Experience in data engineering which includes laudatory account Hands-on experience in Big Data cloud platforms like AWS(redshift, Glue, Lambda), Data Lakes, and Data Warehouses, Data Integration, data pipeline. Experience in SQL, writing code in spark engine using python,pyspark.. Experience in data pipeline and workflow management tools ( such as Azkaban, Luigi, Airflow etc.) Key Personal Attributes Business focused, Customer & Service minded Strong Consultative and Management skills Good Communication and Interpersonal skills Preferred candidate profile Interested Candidate Share your CV on...

Skill: Azure Data Engineer Experience : 4-8 years Note: Looking for Immediate Joiners Only (0-15 days) Job Location: Hyderabad - Full Time Work Mode: In Office Interview Date and Time: 7th Nov'25 (Friday) & 10:00 AM IST to 4:00 PM IST Interview Mode: Face to Face Interview (In-Person) Job Description: Experience in Azure cloud platforms like Advanced Python Programming, Databricks, Azure SQL , Data factory (ADF), Data Lake, Data storage, SSIS. Create and deploy scalable ETL/ELT pipelines with Azure Databricks by utilizing PySpark and SQL. Create Delta Lake tables with ACID transactions and schema evolution to support real-time and batch processing. Experience in Unity Catalog for centralized...

Job description Hiring for Azure Databrick Engineer Mandatory Skills: Databrick, Data lake, Azure Responsibilities A day in the life of an Infoscion As part of the Infosys consulting team, your primary role would be to actively aid the consulting team in different phases of the project including problem definition, effort estimation, diagnosis, solution generation and design and deployment You will explore the alternatives to the recommended solutions based on research that includes literature surveys, information available in public domains, vendor evaluation information, etc. and build POCs You will create requirement specifications from the business needs, define the to-be-processes and d...

Role: Solutions Architect - AWS Data and Analytics GTM Experience: 8+ Years, Minimum 5 years on AWS Work location: Mumbai/Bangalore/ Trivandrum (Hybrid) Responsibilities Be a trusted technical advisor to customers and solutions for complex Cloud & Data related technical challenges. Be a thought leader in architecture design and development of cloud data analytics solutions. Liaison with internal and external stakeholders to design optimized data analytics solutions on AWS cloud Partner with SMEs and Solutions Architects from leading cloud providers to present solutions to customers Support Quantiphi Sales and GTM teams from a technical perspective in building proposals and SOWs Lead discover...

Strong proficiency with Microsoft Fabric. Proficient in T-SQL, DAX, and Python or Spark for data transformations. Solid understanding of data modeling (star/snowflake schemas), ELT/ETL processes, and cloud data storage principles. Annual bonus Health insurance

Strong proficiency with Microsoft Fabric. Proficient in T-SQL, DAX, and Python or Spark for data transformations. Solid understanding of data modeling (star/snowflake schemas), ELT/ETL processes, and cloud data storage principles. Annual bonus Health insurance

The Data Warehouse Architect is responsible for designing and building the companys enterprise data platforms—including data lakes, warehouses, and marts—to enable advanced analytics, reporting, and AI initiatives. This role combines deep technical expertise in modern data architectures, cloud technologies, and data modeling with strong business acumen to translate organizational needs into scalable data solutions. The architect ensures data quality, governance, and performance optimization while supporting data-driven decision-making across functions such as finance, operations, HR, sales, and supply chain. This position plays a key role in modernizing the company’s data ecosystem and drivi...

About The Role Project Role : Technology Architect Project Role Description : Design and deliver technology architecture for a platform, product, or engagement. Define solutions to meet performance, capability, and scalability needs. Must have skills : Salesforce Technical Architecture Good to have skills : Cloud Data Architecture, Salesforce Data Minimum 12 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Salesforce Data Cloud Architect, you will be responsible for designing and implementing scalable, secure, and high-performance data architectures using Salesforce Data Cloud. You will work closely with cross-functional teams to define...

Role & responsibilities azure databricks data lake SQL Pyspark

About The Role Project Role : Data Architect Project Role Description : Define the data requirements and structure for the application. Model and design the application data structure, storage and integration. Must have skills : Data Architecture Principles Good to have skills : NA Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :We are looking for a highly experienced and technically proficient Generative AI Data Architect (AWS) with deep expertise in data architecture principles, data modeling techniques and methodologies, and enterprise-scale AI/ML systems. The ideal candidate should have 10-13 years of experience in designing...

About The Role Project Role : Software Development Lead Project Role Description : Develop and configure software systems either end-to-end or for a specific stage of product lifecycle. Apply knowledge of technologies, applications, methodologies, processes and tools to support a client, project or entity. Must have skills : Microsoft Fabric Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Software Development Lead, you will develop and configure software systems, either end-to-end or for specific stages of the product lifecycle. Your typical day will involve collaborating with various teams to ensure ...

About The Role Project Role : Software Development Lead Project Role Description : Develop and configure software systems either end-to-end or for a specific stage of product lifecycle. Apply knowledge of technologies, applications, methodologies, processes and tools to support a client, project or entity. Must have skills : PTC Windchill Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Software Development Lead, you will be responsible for developing and configuring software systems, either end-to-end or for specific stages of the product lifecycle. Your typical day will involve collaborating with var...

About The Role Project Role : Software Development Lead Project Role Description : Develop and configure software systems either end-to-end or for a specific stage of product lifecycle. Apply knowledge of technologies, applications, methodologies, processes and tools to support a client, project or entity. Must have skills : PTC Windchill Good to have skills : NA Minimum 12 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Software Development Lead, you will be responsible for developing and configuring software systems, either end-to-end or for specific stages of the product lifecycle. Your typical day will involve collaborating with va...

We are currently considering only candidates based in Bangalore who can attend in-person interviews after CV shortlisting. We're open to considering candidates with 3 to 12 years of experience, provided you are a hands-on coder with strong technical skills. The Modern Data Engineer is responsible for designing, implementing, and maintaining scalable data architectures using cloud technologies, primarily on AWS, to support the next evolutionary stage of the Investment Process. They build robust data pipelines, optimize data storage, and access patterns, and ensure data quality while collaborating across engineering teams to deliver high-value data products Key Responsibilities • Implement and...

Design, develop new features for a large-scale cloud data platform using Databricks, snowflake and Fabric, Deeply understand legacy data platforms, and drive their modernization, Provide production support Design data pipelines and data warehouse. Required Candidate profile 5 years in developing and scaling data platforms using Snowflake, databricks, Fabric, Strong Python and SQL Intermediate C# Understanding of modern data architectures such as Data Mesh, Lakehouse

Job Description: Data Engineer with deep experience in Microsoft Fabric, including OneLake, Data Warehouse, Dataflows, and Data Factory capabilities. The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines, integrating diverse data sources, and enabling analytics and reporting using the Microsoft Fabric ecosystem. Key Responsibilities: Design and implement end-to-end data solutions using Microsoft Fabric's unified analytics platform. Develop and maintain data pipelines leveraging OneLake, Dataflows Gen2, and Data Factory pipelines. Build and manage enterprise-grade data warehouse models within Microsoft Fabric. Optimize performance and stora...

Looking for Business Analyst working in Regulated sector by RBI - Bank, Lending NBFC or consulting Firms - Working on Banking data. Having experience in Business credit risk. Predominant Skills - Data Quality; Remediation Processes (Databases, SQL and Python) Data Visualisation Skills (Dashboard, Tableau Power, BI) Informatica Data Quality Basic understanding of Data Lakes and Cloud environment Machine Learning Job Purpose HDFC Bank has huge volume of data, both structured and unstructured, and we are focused on creating assets out of data and deriving best value from the data for the Bank. The Data Remediation and DaaS specialist will be responsible for improving customer data quality throu...