2117 Data Lake Jobs - Page 2

The Role Keyrus is seeking a Senior Data Engineer & Data Scientist to design, build, and optimise cloud-native data platforms in Azure You will work across modern data architectures, build scalable data solutions, and collaborate with multidisciplinary teams to drive data excellence and platform innovation Location: Hybrid Pune, India (3 days onsite) Target Start: 26 Compensation: 30,00,000 42,00,000 INR Responsibilities Data Engineering Design, build, and optimise cloud-native ingestion, transformation, and enrichment pipelines using Azure (ADF, Databricks, Synapse) Implement data joins, validation frameworks, profiling, and quality checks to ensure analytics-ready datasets Engineer scalabl...

Project Role : Quality Engineering Lead (Test Lead) Project Role Description : Leads a team of quality engineers through multi-disciplinary team planning and ecosystem integration to accelerate delivery and drive quality across the application lifecycle. Applies business and functional knowledge to develop end-to-end testing strategies through the use of quality processes and methodologies. Applies testing methodologies, principles and processes to define and implement key metrics to manage and assess the testing process including test execution and defect resolution. Must have skills : Microsoft Azure Data Services Good to have skills : NA Minimum 5 year(s) of experience is required Educati...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Data Architecture Principles Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will design, build, and configure applications to meet business process and application requirements. Your typical day will involve collaborating with various teams to understand their needs, developing innovative solutions, and ensuring that applications are aligned with business objectives. You will also e...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Data Architecture Principles Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will design, build, and configure applications to meet business process and application requirements. Your typical day will involve collaborating with various teams to understand their needs, developing innovative solutions, and ensuring that applications are aligned with business objectives. You will also e...

Key Responsibilities: Spark Engineering & Performance Optimization (Core) Architect, build, and optimize large-scale Spark pipelines using PySpark or Scala Lead Spark performance tuning initiatives , including: Executor and memory tuning Partitioning and shuffle optimization Broadcast joins, caching, and skew mitigation Analyze and resolve Spark job failures, bottlenecks, and cost inefficiencies Establish Spark coding standards and optimization best practices across teams Data Architecture & Engineering Design and build end-to-end data pipelines (batch and streaming) ingesting data into Snowflake and AWS-based Data Lakes Architect and optimize cloud-native data lake and data warehouse soluti...

We are looking for a Data Engineer responsible for gathering, processing, and analyzing data to solve complex business problems. The role includes building scalable data pipelines, performing data modelling and transformations, and applying ML/AI technologies to deliver high-value insights and drive business outcomes. Key Responsibilities Functional Responsibilities Gather and process raw data at scale (scripts, web scraping, API integrations, SQL queries, etc.). Design, implement, and maintain high-performance data pipelines for structured and unstructured business requirements. Build web services / API-based interfaces to modularize capabilities across lending products. Develop prototypes ...

What you will do As a Specialist Software Engineer at Amgen, you will be responsible for developing and maintaining software applications to meet business requirements. You will collaborate with a team of software engineers, participate in software design and development, conduct code reviews, and ensure the delivery of high-quality software solutions. Your strong programming skills, knowledge of software development best practices, and attention to detail will contribute to the successful delivery of reliable and efficient software applications. Design, develop, and implement IS solutions to enable end to end digitization of lab experimentation, simulations and electronic recipe management ...

Role - Snowflake Developer Exp - 8 to 10 Yrs Location - Bangalore JD Experience in developing and proficient in SQL and knowledge on cloud computing environments Knowledge on Data warehousing concepts and metadata management Experience with data modeling, Data lakes, multi-dimensional models and data dictionaries Hands-on experience with Snowflake features like Time Travel and Zero-Copy Cloning.Experience in query performance tuning and cost optimization in a cloud data platform Knowledge in Snowflake warehousing, architecture, processing and administration Good to have knowledge on procedures and functions using SQL or javascript language .

Job Title: SAP BW4HANA Job Grade (refer to JE) Manager 1 / Manager 2 Function: IT Sub-function: IT Manager’s Job Label: G9A Location: Sun House, Mumbai No. of Direct Reports (if any) - Business Unit: IT Job Summary We are searching for skilled SAP BW / BW4HANA Developer and Data engineer to join our dynamic team. The role involves working closely with business stakeholders to understand business requirement and translating them into technical specifications and ensure successful deployment. Areas Of Responsibility BW4HANA information model development. Major experience in end to end implementation of SAP data warehouse platform Hands-on experience in BW application area like SD, MM , PP, VC ...

ALM Services with Data warehouse skills The Mastercard Account Level Management platform empowers real-time card level decisioning As consumers progress along their life stages as card holders, with increasing disposable income and more refined preferences, ALM provides services to issuers so they can effectively offer more relevant benefits and rewards at each stage, to drive loyalty and spend Role o Develop high quality, secure and scalable data pipelines using spark, Scala/Python/Java on Hadoop or object storage like MinIO o Leverage technologies and solutions to innovate with increasingly large data sets o Drive automation and efficiency in Data ingestion, data movement and data access w...

Seeking Microsoft Fabric Data Engineer (4–5 yrs exp) to design, build & optimize pipelines with Fabric, Azure, Power BI. Strong SQL, Python, PySpark skills; ensure data quality, governance & collaborate on analytics solutions Required Candidate profile 4–5 yrs in data engineering/BI, expert in Microsoft Fabric (Data Factory, Synapse, Data Lake, Power BI), strong SQL/Python/PySpark, Azure cloud, ETL, data warehousing, Agile

Overview: The Azure Data Engineer / Data Architect will be responsible for designing, developing, and managing scalable data solutions on Microsoft Azure. You will ensure that data is accessible, optimized for performance, and compliant with organizational and security standards. You will have hands-on expertise with Azure services, strong ETL development skills, and the ability to architect modern data platforms that support business intelligence, analytics, and advanced data science initiatives. You will operate in a Scrum/Agile environment, collaborating closely with cross-functional teams to deliver value iteratively. Core Responsibilities: •Design, build, and maintain scalable and relia...

**Role Overview:** As a senior specialist in Supply Chain Data & Analytics domain at Novartis, your primary responsibility will be to lead the design and development of Global Supply Chain Analytics applications while providing support for applications from other domains using supply chain data. You will play a crucial role in driving the deliverables for important digital initiatives that contribute towards strategic priorities. By leading multiple projects and digital products with team members comprising both internals and externals, you will interact with global Business and IT stakeholders to ensure successful solution delivery with standard designs in line with industry best practices....

You will play a key role as a Principal Data Engineer at Brillio, a rapidly growing digital technology service provider known for its innovative digital adoption solutions. Your responsibilities will include: - Leveraging your expertise in Data Modeling tools such as ER Studio/ER Win - Collaborating closely with clients to deliver and drive Physical and logical model solutions - Demonstrating in-depth understanding of Data Lake/ODS, ETL concept, and modeling structure principles - Applying your experience in Data warehousing to work on Dimensions, Facts, and Data modeling projects - Utilizing your communication skills to effectively lead teams and ensure successful project delivery - Having ...

Job description Hiring for Azure Databrick Engineer Mandatory Skills: Databrick, Data lake, Azure Responsibilities A day in the life of an Infoscion As part of the Infosys consulting team, your primary role would be to actively aid the consulting team in different phases of the project including problem definition, effort estimation, diagnosis, solution generation and design and deployment You will explore the alternatives to the recommended solutions based on research that includes literature surveys, information available in public domains, vendor evaluation information, etc. and build POCs You will create requirement specifications from the business needs, define the to-be-processes and d...

Educational Requirements Bachelor of Engineering, BTech, BCA, MTech, MCA ,B.Sc, M.SC Job description Full Stack Data Engineer- AWS Mandatory Skills: AWS,GAWS Glue ETL,Python/SQL Responsibilities A day in the life of an InfoscionAs part of the Infosys delivery team, your primary role would be to interface with the client for quality assurance, issue resolution and ensuring high customer satisfaction. You will understand requirements, create and review designs, validate the architecture and ensure high levels of service offerings to clients in the technology domain. You will participate in project estimation, provide inputs for solution delivery, conduct technical risk planning, perform code r...

Position Summary Highly skilled GenAI Application Leader with 15+ years of total experience who can drive the design, development, testing, and deployment of Generative AIbased applications focused on Data and Analytics in Life Sciences domain . The ideal candidate will have a strong background in Python, RAG, knowledge graphs, Gen AI/LLM frameworks (LangChain, LangGraph), AWS/Azure cloud services with hands-on experience integrating and fine-tuning GPT, Anthropic Claude, Mistral, or Snowflake Cortex for real-world business use cases. Strong client problem-solving skills across life sciences data and analytics is a plus. This role bridges AI engineering, data analytics, and full-stack develo...

We are seeking a highly skilled and experienced Spark Cluster Admin to join our dynamic team. This role is critical for building, optimizing, and supporting our cutting-edge data platform, leveraging Apache Spark , Apache Iceberg , and a robust DevOps approach within an OpenShift environment. The ideal candidate will be adept at both developing high-performance data solutions and ensuring their stability and reliability in a production setting. Key Responsibilities Design, develop, and optimize scalable and resilient data processing applications using Apache Spark (batch, streaming, and real-time). Implement and manage data pipelines, ensuring data quality, consistency, and performance. Perf...

Intuit Management consultancy is looking for Senior Staff Software Engineer to join our team Design and develop scalable, modular, and secure services using React and JavaScript. Gather functional requirements, develop technical specifications, and solutions. Develop web, software, mobile apps, prototypes, or proofs of concepts (POCs). Resolve defects/bugs during QA testing, pre-production, production, and post-release patches. Contribute to the design and architecture of the project. Work cross-functionally with various Intuit teams to drive forward results. Mentor junior engineers and apply technical expertise to challenging programming and design problems. Experience with Agile Developmen...

Kaeyrus Private Limited is looking for Senior Data Engineer (Azure & Python) to join our team Architect, develop, and optimize cloud-native data pipelines and big data ecosystems using Azure technologies. Design and implement robust data ingestion, transformation, and enrichment workflows, ensuring high data quality, reliability, and consistency. Embed key non-functional requirements such as security, performance, scalability, disaster recovery, and compliance into solution designs. Evaluate and prototype modern data technologies and lead proofs of concept (POCs) to drive continuous platform improvement. Collaborate with Data Governance teams to maintain high-quality metadata, lineage tracki...

Barclaycard Payments is looking for Data Engineer SQL to join our team Design and implement data pipelines, data warehouses, and data lakes that manage appropriate data volumes and velocity. Develop processing and analysis algorithms fit for the intended data complexity and volumes. Collaborate with data scientists to build and deploy machine learning models. Lead and supervise a team, guiding professional development, allocating work requirements, and coordinating resources. Ensure all data is accurate, accessible, and secure. Perform prescribed activities timely and to a high standard, consistently driving continuous improvement. Job Requirements Hands-on experience in developing complex d...

Support the advancement of digital and process solutions across all aspects of in-market distribution, warehousing, and transportation. Design and develop SAP solutions for in-market logistics operations, aligning with business objectives and technical requirements. Analyze current in-market logistics processes and identify opportunities for improvement, automation, and efficiency. Provide SAP technical expertise, training, and guidance to Global Distribution Services (GDS) In-Market Logistics Team and other stakeholders. Collaborate closely with other functions on major strategic initiatives. Author Training Materials/Work Instructions/Job Aids and serve as the key point of contact for assi...

Job Overview Develop and Manage data tables, manage data flows that integrate information from various sources into a common data lake platform through an ETL Tool/Equivalent tool Build data at Day, week, month and quarter frequency Develop, Manage and Schedule Pipelines Maintain Database schema in S3 and Redshift Platforms Triage, debug and fix technical issues related to Data table and Data Manage Pipeline and fix on failures What your background should look like: 3+ Years of Experience working on AWS Cloud/Platforms 3+ Years of Experience with AWS Data services like S3, Glue, EMR, RDS, DMS and Redshift 3+ Years of Experience working on ETL tools preferably on AWS platform and technologies...

What you will do In this vital role you will design, build and maintain data lake solutions for scientific data that drive business decisions for Research. You will build scalable and high-performance data engineering solutions for large scientific datasets and collaborate with Research stakeholders. The ideal candidate possesses experience in the pharmaceutical or biotech industry, demonstrates strong technical skills, has experience with big data technologies, and understands data architecture and ETL processes Design, develop, and implement data pipelines, ETL/ELT processes, and data integration solutions Contribute to data pipeline projects from inception to deployment, manage scope, tim...

Role Description: In this vital role you will partner with the EPD (External Planning & Delivery) and External Supply Business Team s to advance and automate day-to-day planning and procurement to accelerate strategy and growth. You will also help build long-term roadmaps for the Ariba Supply Chain Collaboration (SCC) and Sub-Con tracting modules to onboard Direct Suppliers and Contract Manufact ur ers ( CMOs ) . Support designing and maintaining a vision for how technology can be leveraged to tackle critical business problems, understand the impact of technical solutions on business outcomes and ensure growing the value of investments made. You will collaborate and engage with various partn...