1507 Data Lake Jobs - Page 7

Key Responsibilities: Develop complex SQL queries for data extraction, transformation, and loading (ETL) processes within the data warehouseDocument SQL development standards and procedures. Design and optimize SQL scripts to improve data retrieval performance and data quality. Implement and maintain dimensional data models (star schema, snowflake schema) using SQL. Write stored procedures, functions, views, and triggers to automate data workflows. Collaborate with BI teams and business stakeholders to gather reporting requirements and translate them into SQL-based solutions. Optimize existing SQL queries and database objects for better performance. Work with large datasets to validate and e...

As a Senior Data Engineer based in Pune, you will play a crucial role in building and optimizing scalable data pipelines, designing modular transformations, ensuring data governance, and enabling analytics across lakehouse and warehouse architectures. Your expertise in Azure Databricks, Apache Spark (PySpark), Azure Data Factory, Data Lake, Snowflake, and dbt will be key to your success in this role. **Key Responsibilities:** - **Data Engineering & Pipeline Development** - Design and implement ETL/ELT pipelines using Azure Databricks (PySpark, SQL, Delta Lake) or Snowflake (SQL, dbt). - Build metadata-driven ingestion frameworks to integrate data from relational databases, APIs, and flat fil...

As a BI Architect at Internet Brands, you will play a crucial role in leading the design, development, and optimization of enterprise-wide Business Intelligence solutions. Your technical expertise in Power BI, Azure Data Services, SQL, Excel, and SharePoint will be instrumental in delivering impactful data solutions, dashboards, and reporting frameworks that drive data-driven business decisions. You will collaborate closely with key business stakeholders to translate complex data requirements into effective BI solutions. **Key Responsibilities:** - Architect and design scalable, maintainable Power BI solutions, including datasets, dataflows, dashboards, and paginated reports. - Build and man...

Role Overview: As a Project Manager/Senior Project Manager at GormalOne LLP, you will play a crucial role in driving data-centric product initiatives for the DairyTech ecosystem. Your focus will be on building scalable data platforms, enabling advanced analytics, and delivering actionable insights through intuitive dashboards and visualization tools to empower decision-making across supply chain, operations, sales, and customer engagement. Key Responsibilities: - Define and own the product strategy for the Data & Analytics platform to support business growth in the DairyTech domain. - Identify data-driven opportunities in collaboration with business stakeholders, ensuring alignment with orga...

What We Offer Our company culture is focused on helping our employees enable innovation by building breakthroughs together HowWe focus every day on building the foundation for tomorrow and creating a workplace that embraces differences, values flexibility, and is aligned to our purpose-driven and future-focused work We offer a highly collaborative, caring team environment with a strong focus on learning and development, recognition for your individual contributions, and a variety of benefit options for you to choose from Apply now! What You'll Do We are seeking a hands-on Product Manager with strong technical acumen and a passion for data engineering to drive the evolution of our data founda...

Job description Hiring for Azure Databrick Engineer Mandatory Skills: Databrick, Data lake, Azure Responsibilities A day in the life of an Infoscion As part of the Infosys consulting team, your primary role would be to actively aid the consulting team in different phases of the project including problem definition, effort estimation, diagnosis, solution generation and design and deployment You will explore the alternatives to the recommended solutions based on research that includes literature surveys, information available in public domains, vendor evaluation information, etc. and build POCs You will create requirement specifications from the business needs, define the to-be-processes and d...

Job description Hiring for Azure Databrick Engineer Mandatory Skills: Databrick, Data lake, Azure Responsibilities A day in the life of an Infoscion As part of the Infosys consulting team, your primary role would be to actively aid the consulting team in different phases of the project including problem definition, effort estimation, diagnosis, solution generation and design and deployment You will explore the alternatives to the recommended solutions based on research that includes literature surveys, information available in public domains, vendor evaluation information, etc. and build POCs You will create requirement specifications from the business needs, define the to-be-processes and d...

Join General Mills Digital & Technology team shaping the future of data engineering for one of the worlds most loved food companies! We’re looking for experienced Data Engineers (5–8 yrs) skilled in SQL, Python, and Cloud Data Warehousing (GCP preferred) to drive enterprise-scale digital transformation . Location: Pune (Kalyani Nagar) Walk-In Drive: 1st November, Friday Step 1: Complete a 60-min online technical test before Monday to qualify for the interview! What You’ll Work On: Design and build scalable data pipelines & warehouse solutions on Cloud (GCP). Integrate business data for actionable insights across global systems. Collaborate with global teams using Agile methods. You Bring: St...

Required Qualifications: 10-12 years of overall experience in data architecting, design, and development of data warehouse systems (Cloud/on premises and Analytics) at enterprise scale. •Must have implemented end to end platform modernization projects. Strong experience with Microsoft Fabric, Azure Synapse, Databricks or similar modern data platforms. Proven expertise in data modeling (ER/Studio, ERWin, dbt, Power BI Semantic Models), data integration, and data governance frameworks. Good knowledge of Azure DevOps, GitHub Actions, CI/CD Pipelines Strong collaboration, communication, and leadership skills in cross-functional environments. Must be hands on, deeply technical and exposure to lat...

GCP Cloud Data EngineerLocation: Kochi Design and Develop Data Pipelines: Build, optimize, and maintain scalable ETL/ELT pipelines using GCP tools such as Cloud Dataflow, Data Fusion, Pub/Sub, Dataproc, and Composer (Airflow) Data Modeling & Warehousing: Design and implement efficient data models and schemas for BigQuery or other GCP data stores that support analytical and operational needs Data Integration: Ingest structured and unstructured data from multiple internal and external sources into GCP-based data lakes and warehouses Performance Optimization: Monitor and optimize data pipeline performance, query efficiency, and cost-effectiveness within GCP Automation & CI/CD: Implement infrast...

Project description Information and Document Systems is a global technology change and delivery organization comprising nearly 200 individuals located mostly in Switzerland, Poland, and Singapore. Providing global capturing and document processing, archiving, and retrieval solutions to all business divisions focusing on supporting Legal, Regulatory, and Operational functions. Responsibilities Design, implement, and manage data solutions on Azure Develop and maintain data pipelines using Databricks Ensure efficient data storage and retrieval using Azure Storage and Data Lake Automate infrastructure and application deployments with Ansible Write clean, maintainable code in Python Collaborate w...

We are looking for experienced Azure Data Engineers with 8- 10 years of hands-on experience to join our team in Vijayawada This is a permanent, work-from-office position Key Skills Required: Strong experience in Azure Data Factory, Azure Databricks, Azure Synapse, Azure Fabric, and Data Lake Hands-on experience in Infrastructure setup and data pipeline orchestrationExpertise in SQL, ETL pipelines, and Data Modeling Experience working with Lakehouse and Medallion Architecture (BronzeSilverGold layers) Good understanding of cloud data architecture, data governance, and security best practices Strong analytical, problem-solving, and communication skills Ability to collaborate with cross-functio...

Immediate Requirement : Azure Data Engineer - Azure Data Factory, Azure Databricks, Azure Synapse, Azure Fabric, and Data Lake. Hands-on experience in Infrastructure setup and data pipeline orchestration(8 10 Years Experience) Vijayawada We are looking for experienced Azure Data Engineers with 810 years of hands-on experience to join our team in Vijayawada. This is a permanent, work-from-office position. Role : Azure Data Engineer Experience : 8-10 years Employment Type : Permanent Salary : Will be discussed during the interview process Key Skills Required: Strong experience in Azure Data Factory, Azure Databricks, Azure Synapse, Azure Fabric, and Data Lake Hands-on experience in Infrastruct...

Immediate Requirement Remote Contract | #tgsa #Oracle #OCI #DataIntegration #Finance #O2C #DataEngineering Role : Lead OCI Data Integration & Engineering (Finance/O2C) Type : Remote | Contract Experience : 8-12 years Location : Offshore (India) We are seeking a Lead OCI Data Integration & Engineering to design, architect, and govern OCI-based data integration solutions for Finance and Order-to-Cash (O2C) domains. The role involves leading a small technical team responsible for developing, optimizing, and maintaining OCI Data Integration (OCI DI) pipelines and frameworks. Key Skills: OCI Data Integration (OCI DI), Data Flow, Object Storage, ADW Strong SQL/PLSQL & performance tuning Data Lake/...

Overview As a data engineering manager, you will be the key technical expert overseeing PepsiCo's data product build & operations and drive a strong vision for how data engineering can proactively create a positive impact on the business You'll be empowered to create & lead a strong team of data engineers who build data pipelines into various source systems, rest data on the PepsiCo Data Lake, and enable exploration and access for analytics, visualization, machine learning, and product development efforts across the company As a member of the data engineering team, you will help lead the development of very large and complex data applications into public cloud environments directly impacting...

Design and develop integration of Snowflake with a cloud platform and platform enhancements, integrations, and performance optimisation. Work on data ingestion using Python, cataloguing, and lineage tracking, Develop and architect ETL workflows. Required Candidate profile 5 years in developing and scaling data platforms centered around Snowflake, with Azure. Hands on Python Understanding of modern data architectures such as Data Mesh, Lakehouse, and ELT.

Skilled Data Engineer with 0-1 years of relevant experience in SQL, PySpark, ETL, Data Lakes and Azure Tech Stack. Responsibilities 0-1 years of experience in building data Pipelines with Python/PySpark. 0-1 years of experience in Azure ETL stack ( eg. Blog Storage, Data Lake, Data Factory, Synapse). 0-1 years of experience with SQL. Qualifications Excellent verbal and written communication skills. UG: B.Sc in Any Specialization, BCA in Any Specialization, B.Tech/B.E. in Any Specialization. A good internet connection is a must. Azure certifications will be a bonus

SUMMARY Wissen Technology is Hiring for Data Engineer About Wissen Technology: At Wissen Technology, we deliver niche, custom-built products that solve complex business challenges across industries worldwide. Founded in 2015, our core philosophy is built around a strong product engineering mindset ensuring every solution is architected and delivered right the first time. Today, Wissen Technology has a global footprint with 2000+ employees across offices in the US, UK, UAE, India, and Australia. Our commitment to excellence translates into delivering 2X impact compared to traditional service providers. How do we achieve this? Through a combination of deep domain knowledge, cutting-edge techno...

Job Title: DWP Data Architect Location: Bangalore (Whitefield) or Chennai (Siruseri) or Pune (Talawade) or Mumbai (Airoli (West). Type of Hire: Full-Time Min: 18+ yrs About Us: Atos is a global leader in digital transformation, dedicated to delivering innovative solutions that meet the evolving needs of our clients. Within our Digital Workplace (DWP) organization, we are building a cutting-edge DWP Data Platform to enhance our services and empower data-driven decision-making. Position Overview: We are seeking a skilled and experienced DWP Data Architect to join our R&D team. The successful candidate will be responsible for designing and developing the DWP Data Platform, which will serve as a...

Senior Technology Principal Data Architect Remote Responsibilities: * Lead data architecture initiatives across organization. * Ensure compliance with TOGAF, CDMP, MDM standards. * Collaborate on oil & gas/energy sector projects.

Hiring Senior Data Engineer Required Experience: 5-8 years Job Summary: The Senior Data Engineer will lead the design and development of our data pipelines and architecture. This role is central to building and maintaining a robust data infrastructure that enables analytics and business intelligence within the financial domain. Key Responsibilities: Lead the design, construction, and maintenance of scalable and reliable data pipelines. Build and optimize ETL/ELT processes to move and transform large datasets. Architect and manage data warehouses and data lakes. Ensure data quality and integrity across all data systems. Collaborate with data scientists and analysts to understand their data ne...

Experience in developing modern Data platform, data lake Experience in development of large-scale enterprise data warehouse and data lake solution. Maintain robust data catalogue Manage Azure cloud platform for Data and Analytics Immediate to 15 Days

Job Description: Senior Data Engineer AWS & Python Location: Bangalore Experience Level: 5+ Years Employment Type: Full-Time Role Overview We are seeking a seasoned ETL Developer with deep expertise in AWS serverless architecture and Python programming. The ideal candidate will architect and optimize data pipelines using AWS Lambda, Step Functions, and Glue Jobs, ensuring scalable, cost-efficient, and high-performance ETL workflows across diverse data domains. Key Responsibilities - Design, develop, and maintain ETL pipelines using AWS Glue, Lambda, and Step Functions - Implement scalable data ingestion, transformation, and orchestration workflows - Optimize Python-based data processing scri...

Role & responsibilities Serve as a technical resource in managing and developing governance, process and procedures for the database ETL environment Resolve increasingly complex problems and develop and implement solutions where expertise is required to interpret against policies, guidelines or processes Collaborate, consult, and present technical information to Environment Management Serve as a technical resource in managing and developing governance, process and procedures for the database ETL environment Resolve increasingly complex problems and develop and implement solutions where expertise is required to interpret against policies, guidelines or processes Collaborate, consult, and pres...

Role Summary We have an excellent opportunity for an experienced Data Architect to join our cloud services team and play a key role in supporting our continued growth plans. These plans aim to solidify our position as a leading global Services partner with AWS. Data Architects are expected to routinely act as the lead on large scale, complex projects and provide mentoring to their fellow technical consultants. Our Technical Consultants provide post-sales technical consultancy, undertake delivery and implementation engagements, as well as providing pre-sales qualification and design to consultancy engagements. A typical AWS Data Architect will have had five or more years experience in a techn...