999 Data Lake Jobs - Page 10

Primary Responsibilities: Ingest data from multiple on-prem and cloud data sources using various tools & capabilities in Azure Design and develop Azure Databricks processes using PySpark/Spark-SQL Design and develop orchestration jobs using ADF, Databricks Workflow Analyzing data engineering processes being developed and act as an SME to troubleshoot performance issues and suggest solutions to improve Building test framework for the Databricks notebook jobs for automated testing before code deployment Design and build POCs to validate new ideas, tools, and architectures in Azure Continuously explore new Azure services and capabilities; assess their applicability to business needs Prepare cas...

Experience Level: 10+ years Required Skills and Expertise: Experience: 10+ years of experience in data engineering, data architecture, data science and reporting. Data Architecture: Proven expertise in designing and managing scalable data architecture, including data lakes, warehouses, and pipelines. Data Science: Strong understanding of machine learning, statistical modeling, and data analytics. Power BI: Understanding the dashboard, reports and underline semantic layer and queries Mongo: Understanding and usage of mongo for troubleshooting, development perspective Kubernetes/Dockers: Current env is in containers based so it is nice to have Python Expertise: Hands-on and advanced proficienc...

This is a senior level development position responsible for establishing and implementing new or revised application systems and programs in coordination with the Technology Team. The overall objective of this role is to building robust, high-performance, large-scale applications. Hands-on experience in Web technologies (HTML, CSS, React JS), REST-APIs, and Backend using Java/J2EE technologies. Big Data / Data Lake system architecture is a plus Experience with Agile software development processes with a strong emphasis on test driven development Strong knowledge of CI/CD pipelines and experience in tools such as JIRA, BlackDuck, SONAR etc. Ability to evaluate design trade-offs and document c...

ETL Data Engineer with Python Work Schedule: 5 Days Onsite Required Skills: Strong programming experience in Python. Proficiency in Pandas, NumPy, and working with SQL queries. Experience in working with Data Lake and processing large volumes of data. Ability to parse and consolidate data from Excel, CSV, and plain text formats. Hands-on experience in writing unit tests, performing regression testing, and implementing error/exception handling. Key Responsibilities: Develop effective Python scripts for data extraction, transformation, and loading (ETL). Perform data manipulation and analysis using Pandas, NumPy, and SQL. Work with structured and unstructured data sources (Excel, CSV, text fil...

Required Skills: Strong programming experience in Python. Proficiency in Pandas, NumPy, and working with SQL queries. Experience in working with Data Lake and processing large volumes of data. Ability to parse and consolidate data from Excel, CSV, and plain text formats. Hands-on experience in writing unit tests, performing regression testing, and implementing error/exception handling. Key Responsibilities: Write effective Python code for data extraction, transformation, and loading (ETL). Perform data manipulation and analysis using Pandas, NumPy, and SQL. Work with structured and unstructured data sources (Excel, CSV, text files) from a Data Lake environment. Implement robust error handlin...

Job Title: Python Developer with heavy ETL, Pandas, NumPy, SQL) Job Type: Full-Time / Contract Onsite/Hybrid : 5 Days Onsite Experience: 8+ years total. Data Lake is desirable Required Skills Strong programming experience in Python. Proficiency in Pandas, NumPy, and working with SQL queries. Experience working with Data Lake and processing large volumes of data. Ability to parse and consolidate data from Excel, CSV, and plain text formats. Hands-on experience in writing unit tests, performing regression testing, and implementing error/exception handling. Key Responsibilities Write effective Python code for data extraction, transformation, and loading (ETL). Perform data manipulation and anal...

Data Operations Lead We are looking for a passionate and experienced Operations Lead to join our team. You will play a key role in leading and managing our Data operations and managed services support engagement, ensuring efficient and effective delivery of services. Responsibilities: Lead and manage team of ETL and BI experts, fostering a collaborative and productive work environment. Build strong relationships with clients and serve as their primary point of contact for day-to-day data operations and managed services engagement. Facilitate clear and effective communication between internal and external stakeholders, ensuring everyone is aligned and informed. Oversee daily operational activ...

Were seeking a skilled Python Engineer to support the migration of legacy ETL pipelines built in Pentaho Data Integration (PDISpoon) to modern cloudbased solutions such as Azure Data Factory (ADF). This role involves translating transformation logic, validating data integrity, and collaborating with crossfunctional teams to ensure a smooth transition. Key Responsibilities Analyze and document existing Pentaho ETL jobs, transformations, and data flows. Translate Pentaho logic into Python scripts andor ADF pipeline components. Develop and maintain scalable Pythonbased data processing solutions. Validate data accuracy postmigration using automated testing and SQL queries. Collaborate with data ...

Overall, 12+ years of experience on data domain with at least 3-5 years of experience on Snowflake Lead effort to design, build and configure applications, acting as primary POC Snowflake Architecture Experience in designing and architecting Snowflake projects Clear understanding of Snowflakes advanced concepts like data sharing, data clean rooms, virtual warehouses, query performance using micro partitions and pruning, zero copy clone, time travel, resource monitors and security control methods including network, data, role based etc. In depth understanding of Snowflake Architecture including Snow SQL, Performance tuning, Compute and Storage Extensive experience writing and tuning SQL queri...

Python backend developer with experience in creating web applications. Good at fast API framework, async processing with redis cache, unit test the code, production log code, docker, micro-services, mongo DB, blob storage

8 -10 years of hands-on relational, dimensional, and/or analytic experience (using RDBMS, dimensional, NoSQL data platform technologies, and ETL and data ingestion protocols) Experience with data warehouse, data lake, and enterprise big data platforms in multi-data-center contexts required Good knowledge of metadata management, data modeling, and related tools (Erwin or ER Studio or others) required Experience of 2 to 3 years doing data analysis and data testing Good working knowledge of SQL Good data analysis skills to query, map and document source to target mappings, understand data schemas and modeling Good communication and documentation skills

Seeking an experienced Full Stack Architect (15+ years) with strong expertise in Microsoft .NET technologies and modern web frameworks. Key responsibilities include designing, developing, and enhancing complex applications, guiding technical teams, and maintaining high architectural standards. Proven leadership and strategic skills are essential. Requirements: 15+ years' experience in software architecture and development Proficiency in high/low-level design, domain-driven design Expertise in Cloud computing, cloud architectures, and patterns Advanced knowledge of Microsoft .NET (C#, .NET Core/Framework), ASP.NET, Web API, Entity Framework Strong React.js skills (Redux, Hooks, etc.) Experien...

As a member of KPMG in India, you will be part of a professional services firm affiliated with KPMG International Limited. Established in India in August 1993, KPMG professionals leverage a global network of firms while being well-versed in local laws, regulations, markets, and competition. With offices across various Indian cities, including Ahmedabad, Bengaluru, Chandigarh, Chennai, Gurugram, Hyderabad, Jaipur, Kochi, Kolkata, Mumbai, Noida, Pune, Vadodara, and Vijayawada, we offer services to national and international clients across diverse sectors. Your role involves collaborating with business stakeholders and cross-functional subject matter experts to gain a deep understanding of the ...

At EY, you are part of a team dedicated to shaping your future with confidence. You will thrive in a globally connected environment, collaborating with diverse teams to steer your career in any direction you desire. Join EY in our mission to contribute to building a better working world. At EY Technology, we recognize the pivotal role of technology in unlocking our clients" potential and driving lasting value through innovation. We are committed to enhancing the working world by equipping EY and our clients with the necessary products, services, support, and insights to excel in the market. We focus on creating value by assisting clients in resolving intricate business challenges through inn...

Who we are: Irdeto is the world leader in digital platform cybersecurity, empowering businesses to innovate for a secure, connected future ?Building on over 50 years of expertise in security,?Irdetos services and solutions protect revenue, enable growth and fight cybercrime in video entertainment, video games, and connected industries including transport, health and infrastructure Irdeto is the security partner dedicated to?empowering?a?secure?world where people can connect with confidence, With teams and offices around the world, Irdetos greatest asset is its people our diversity is celebrated through an inclusive workplace, where everyone has an equal opportunity to drive innovation and co...

Work Experience: 0 to 2 years Work Timings: US Shift Location: Currently remote; will be onsite in Bangalore from December 2025 Spektra Systems is looking for high-performing Account Executives to own the complete sales cycle for our suite of products In this role you will drive strategic conversations, manage deal cycles from discovery to close, and serve as a trusted advisor to prospects, Youll be assigned to one of our product lines and empowered to work directly with inbound leads and marketing-qualified accounts Youll collaborate cross-functionally with Product, Pre-Sales, and Customer Success teams to close high-impact deals and contribute to our growth story, Key Responsibilities: Own...

Project Role : Application Designer Project Role Description : Assist in defining requirements and designing applications to meet business process and application requirements. Must have skills : SAP BW/4HANA Data Modeling & Development Good to have skills : NAMinimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Designer, you will assist in defining requirements and designing applications to meet business process and application requirements. A typical day involves collaborating with cross-functional teams to gather insights, analyzing user needs, and translating them into functional specifications. You will engage in...

Apex Fund Services LLP is looking for BI Developer III to join our dynamic team and embark on a rewarding career journey A BI (Business Intelligence) Developer is a professional who designs and develops data analytics and reporting solutions to help organizations make data-driven decisions Job Duties:Designing, developing, and maintaining business intelligence solutions, such as data warehouses, data marts, and data lakes Building ETL (extract, transform, load) processes to integrate data from various sources into a centralized data repository Creating dashboards, reports, and visualizations to provide insights and actionable intelligence to stakeholders Designing and implementing data model...

Job Name (Digital Banking) Data Quality Analyst Location - Mumbai Grade - Senior Manager / AVP Looking for Business Analyst working in Regulated sector by RBI - Bank, Lending NBFC or consulting Firms - Working on Banking data. Having experience in Business credit risk. Predominant Skills - Data Quality; Remediation Processes (Databases, SQL and Python) Data Visualisation Skills (Dashboard, Tableau Power, BI) Informatica Data Quality Basic understanding of Data Lakes and Cloud environment Job Purpose HDFC Bank has huge volume of data, both structured and unstructured, and we are focused on creating assets out of data and deriving best value from the data for the Bank. The Data Remediation and...

YoE: 5+ (Senior) / 7+ (Expert) Very good experience with Azure and their data stack (Azure Data Factory, Azure Databricks, Data Lakes in Azure, PowerBI, Azure Synapse) Good experience interacting with customers and stakeholders alike Very good experience leading initiatives and supporting other teams Roles and Responsibilities As a Senior Software Engineer, you will be responsible for designing, developing, and implementing high-quality software solutions. You will work closely with cross-functional teams to deliver scalable and efficient applications that meet business needs. This role requires a strong focus on the software development lifecycle and best practices

About The Role At Boeing, we innovate and collaborate to make the world a better place. Were committed to fostering an environment for every teammate thats welcoming, respectful and inclusive, with great opportunity for professional growth. Find your future with us. Overview As a leading global aerospace company, Boeing develops, manufactures and services commercial airplanes, defense products and space systems for customers in more than 150 countries. As a top U.S. exporter, the company leverages the talents of a global supplier base to advance economic opportunity, sustainability and community impact. Boeings team is committed to innovating for the future, leading with sustainability, and ...

Role & responsibilities We are recruiting for a technically strong, people-centric Data Engineering Manager to lead a high-impact AI & Data engineering team based in India. This group will build the data platform and products to support the analytics, insights and data science needs for our core subscription business. Data has always been at the heart of the Economist Group, and ultimately we aim to help the business make data driven judgements based on real time, actionable insights How you will contribute in this role: Work with data product managers, analysts, and data scientists to build data and ML pipelines, data warehouse/data lake-house for analytics, reporting and prediction. Build ...

About the Role We are looking for a Data Warehouse Engineer with strong expertise across the Azure Data Platform to design, build, and maintain modern data warehouse and analytics solutions. This role requires hands-on experience with Azure Synapse Analytics, Data Factory, Data Lake, Azure Analysis Services, and Power BI . The ideal candidate will ensure seamless data ingestion, storage, transformation, analysis, and visualization, enabling the business to make data-driven decisions. Key Responsibilities Data Ingestion & Orchestration 10-15years of experience in designing and building scalable ingestion pipelines using Azure Data Factory . Integrate data from multiple sources (SQL Server, re...

As a Salesforce Environment Manager, you will be responsible for overseeing the environment management of Salesforce orgs and handling deployments across multiple orgs. Your primary responsibilities will include: - Overseeing Salesforce Data Cloud environments in development, staging, and production stages. - Defining best practices for environment setup, security, and governance. - Managing data pipelines, ingestion processes, and harmonization rules to ensure efficient data flow. - Establishing role-based access control (RBAC) for data security and compliance. - Monitoring data processing jobs, ingestion performance, and data harmonization processes. - Ensuring compliance with data privacy...

Americana Restaurants International PLC is a pioneering force in the MENA region and Kazakhstan's Out-of-Home Dining industry, and ranks among the world's leading operators of Quick Service Restaurants (QSR) and casual dining establishments. With an extensive portfolio of iconic global brands and a dominant regional presence, we have consistently driven growth and innovation for over 60 years. Our expansive network of 2,600+ restaurants spans 12 countries throughout the Middle East, North Africa, and Kazakhstan from Kazakhstan in the east to Morocco in the west powered by a team of over 40,000+ talented individuals committed to delivering exceptional food, superior service, and memorable exp...