1019 Data Lake Jobs - Page 41

As an Data Engineer at IBM you will harness the power of data to unveil captivating stories and intricate patterns. You'll contribute to data gathering, storage, and both batch and real-time processing. Collaborating closely with diverse teams, you'll play an important role in deciding the most suitable data management systems and identifying the crucial data required for insightful analysis. As a Data Engineer, you'll tackle obstacles related to database integration and untangle complex, unstructured data sets. In this role, your responsibilities may include Implementing and validating predictive models as well as creating and maintain statistical models with a focus on big data, incorporat...

As an Data Engineer at IBM you will harness the power of data to unveil captivating stories and intricate patterns. You'll contribute to data gathering, storage, and both batch and real-time processing. Collaborating closely with diverse teams, you'll play an important role in deciding the most suitable data management systems and identifying the crucial data required for insightful analysis. As a Data Engineer, you'll tackle obstacles related to database integration and untangle complex, unstructured data sets. In this role, your responsibilities may include: Implementing and validating predictive models as well as creating and maintain statistical models with a focus on big data, incorpora...

This role requires a deep understanding of data quality frameworks, test planning, and stakeholder engagement. The candidate should possess leadership capabilities and be hands-on with SQL and automation. Job Description : Own QA strategy and execution for Azure-based data engineering projects. Define test plans and ensure traceability across test artifacts, requirements, and defects. Lead validation of Snowflake-based data lakes, transformations, and Power BI dashboards. Guide the QA team in testing complex SQL logic, Data Vault structures, and downstream integrations. Coordinate with product owners, architects, and developers to align test coverage with business logic. Manage test data set...

This role requires a deep understanding of data quality frameworks, test planning, and stakeholder engagement. The candidate should possess leadership capabilities and be hands-on with SQL and automation. Job Description : Own QA strategy and execution for Azure-based data engineering projects. Define test plans and ensure traceability across test artifacts, requirements, and defects. Lead validation of Snowflake-based data lakes, transformations, and Power BI dashboards. Guide the QA team in testing complex SQL logic, Data Vault structures, and downstream integrations. Coordinate with product owners, architects, and developers to align test coverage with business logic. Manage test data set...

8+years of experience in data engineering, with a minimum of 2+ years in a leadership or lead capacity. Proven experience building and operating large-scale data platforms in a production environment. Track record of successfully delivering complex data projects from ideation to deployment. Educational Background : Bachelor's or Masters degree in Computer Science, Engineering, or a related technical field. Communications Excellent analytical, problem-solving, and critical thinking skills with meticulous attention to detail. Strong communication (written and verbal) and interpersonal skills, with the ability to collaborate effectively with cross-functional teams. Ability to work independently...

The candidate must possess knowledge relevant to the functional area, and act as a subject matter expert in providing advice in the area of expertise, and focus on continuous improvement for maximum efficiency. It is vital to focus on the high standard of delivery excellence, provide top-notch service quality and develop successful long-term business partnerships with internal/external customers by identifying and fulfilling customer needs. He/she should be able to break down complex problems into logical and manageable parts in a systematic way, and generate and compare multiple options, and set priorities to resolve problems.The ideal candidate must be proactive, and go beyond expectations...

Skill: Data Engineer Experience: 6+ Years Location: Bangalore & Pune Shift Timings: 4:00 PM to 1:00 AM IST Mode: Hybrid Notice Period: Immediate - 15 Days Must-Have Skills: Minimum of 6 years of Data Engineering Experience Must be an expert in SQL, Data lake, Azure, ETL Must be an expert in data modeling Incorta experience is a plus Excellent oral and written communication skills Self-starter with analytical, organizational, and problem-solving skills Must be highly flexible and adaptable to change Power BI Strong programming skills in languages such as SQL, Python Experience with data modelling, data warehousing, and dimensional modelling concept Familiarity with data governance, data secur...

In this senior technical role for ACV Retail, you will architect and deliver robust data pipelines, warehouses, and lakes that enable advanced analytics, machine learning, and business intelligence at scale. You will set technical direction, mentor engineering teams, and ensure best practices for performance, security, and cost-effectiveness in our cloud-based data ecosystem. You will collaborate with cross-functional teams to deliver high-quality, robust, and scalable solutions that empower our customers to manage and analyze their data effectively. You will have deep expertise in designing, building, and optimizing modern, scalable data platforms on AWS, MS SQL Server and MongoDB. You will...

Reference Code: HR1175440031573725 Designation: Data Engineer Azure & Databricks Job Description for Data Engineer Azure & Databricks Location: Bengaluru [Hybrid] Experience Required: 4 to 6 years Employment Type: Full-time Department: Data Engineering / Analytics (*Note: This is a requirement for one of Uplers Clients) About the Client: Our client is building scalable data platforms leveraging modern cloud-native and open-source technologies to drive decision intelligence across the organization. Our data lake is designed on the Microsoft Medallion Architecture, powered by Databricks and Azure-native services. We are looking for a passionate Data Engineer to join our team and help in expand...

Role: Sr. Data Engineer Location: Bangalore Experience: 4-12 Years About Company The organisation is a global technology consulting and software development firm headquartered in Bangalore, India. It specialises in providing end-to-end solutions in custom software development, enterprise applications, cloud services, and product engineering. It offers a collaborative and growth-oriented work culture, encouraging continuous learning, innovation, and opportunities to work on international projects using the latest technologies. About the role The Data Engineering Lead will be responsible for managing and leading a team of engineers to design, build and maintain data pipelines, data warehouses ...

Job Summary: We are seeking a highly skilled Senior Data Engineer with 8-10 years of experience in building scalable data solutions and a solid understanding of AI/ML workflows. The ideal candidate will have expertise in data engineering , cloud platforms , and machine learning integration , and will work closely with data scientists, ML engineers, and software developers to operationalize intelligent data systems. Key Responsibilities: Design and implement data pipelines for structured, semi-structured and unstructured data from diverse sources (real-time and batch). Develop and maintain data lakes, data warehouses, and feature stores for scalable ML model training and inference. Collaborat...

Having a mix of - Data Analysis - Solutioning for enterprise data lake - Serving regulatory, transactional, business analytics and reporting requirements - Data Science led enablement

Job Description BE/B.Tech or equivalent 8~13 years' experience in IT or professional services experience in IT delivery or large-scale IT analytics projects Role requires him/her to design and implement data modeling solutions using relational, dimensional, and NoSQL databases. You will work closely with data architects to design bespoke databases using a mixture of conceptual, physical, and logical data models. What we look for: BE/B.Tech or equivalent The data modeler designs, implements, and documents data architecture and data modeling solutions, which include the use of relational, dimensional, and NoSQL databases. These solutions support enterprise information management, business inte...

Responsibilities for GCP Data Engineer : Job Accountabilities - Hands on Experience in GCP Data Components (BigQuery / Data fusion / Cloudsql etc) Data Lake and Data Warehouse Understanding Manage DevOps lifecycle of project (Code Repository, Build, Release) Good to have : end to end BI Landscape knowledge Participate in unit and integration testing Interaction with business users for Requirement understanding and UAT Understanding of Data Security and Data Compliance Agile Understanding Project Documentation Understanding Good SQL Knowledge Certification (Good to have) Domain Knowledge of Different Industry Sector Mandatory skill sets : GCP

Job Title:Automation Testing - Data Experience: 0-5 Years Location:Remote Job Description : Design, develop, and execute automated tests for data pipelines, data warehouses, and data lakes. Validate data quality, accuracy, and consistency across the entire data lifecycle. Develop and maintain test scripts for data integration, data transformation, and a loading processes. Utilize data profiling and validation tools to identify and resolve data quality issues. Work closely with data engineers and data scientists to ensure data accuracy and integrity.e

Job TitleSenior DataLake Implementation Specialist Experience: 1012+ Years Location: Bangalore Type: Full-time / Contract Notice Period: Immediate Job Summary: We are looking for a highly experienced and sharp DataLake Implementation Specialist to lead and execute scalable data lake projects using technologies such as Apache Hudi, Hive, Python, Spark, Flink , and cloud-native tools on AWS or Azure . The ideal candidate must have deep expertise in designing and optimizing modern data lake architectures with strong programming skills and data engineering capabilities. Key Responsibilities: Design, develop, and implement robust data lake architectures on cloud platforms (AWS/Azure). Implement s...

Capgemini Invent Capgemini Invent is the digital innovation, consulting and transformation brand of the Capgemini Group, a global business line that combines market leading expertise in strategy, technology, data science and creative design, to help CxOs envision and build whats next for their businesses. Your Role Should have developed/Worked for atleast 1 Gen AI project. Has data pipeline implementation experience with any of these cloud providers - AWS, Azure, GCP. Experience with cloud storage, cloud database, cloud data warehousing and Data lake solutions like Snowflake, Big query, AWS Redshift, ADLS, S3. Has good knowledge of cloud compute services and load balancing. Has good knowledg...

Capgemini Invent Capgemini Invent is the digital innovation, consulting and transformation brand of the Capgemini Group, a global business line that combines market leading expertise in strategy, technology, data science and creative design, to help CxOs envision and build whats next for their businesses. Your Role Should have developed/Worked for atleast 1 Gen AI project. Has data pipeline implementation experience with any of these cloud providers - AWS, Azure, GCP. Experience with cloud storage, cloud database, cloud data warehousing and Data lake solutions like Snowflake, Big query, AWS Redshift, ADLS, S3. Has good knowledge of cloud compute services and load balancing. Has good knowledg...

Experience in developing cloud-based analytics solutions with a minimum of 3 years of core experience in MS Azure and Databricks. Strong development and problem-solving skills. Experienced in Architecture, design and development Data platforms / Datalakes using ETL or ELT approach, preferably Databricks Delta lakehouse. Architecture, design and development of real-time data workflows and pipelines using (Py)Spark Structured Steaming solutions. Expertise in Data modelling with RDBMS systems, preferably PostgreSQL database Must have programming skills: Python, PySpark, SQL Architecture and design of data pipelines using CI/CD methodology. Comfortable in adopting security-first development prin...