1507 Data Lake Jobs - Page 5

About The Role Project Role : Application Support Engineer Project Role Description : Act as software detectives, provide a dynamic service identifying and solving issues within multiple components of critical business systems. Must have skills : EPIC Systems Good to have skills : NA Minimum 2 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Support Engineer, you will act as software detectives, providing a dynamic service that identifies and resolves issues within various components of critical business systems. Your typical day will involve collaborating with team members to troubleshoot software problems, analyzing syste...

About The Role Project Role : Business and Integration Practitioner Project Role Description : Assists in documenting the integration strategy endpoints and data flows. Is familiar with the entire project life-cycle, including requirements analysis, coding, testing, deployment, and operations to ensure successful integration. Under the guidance of the Architect, ensure the integration strategy meets business goals. Must have skills : Personal Insurance Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Business and Integration Practitioner, your typical day involves collaborating with various teams to do...

About The Role Project Role : Application Support Engineer Project Role Description : Act as software detectives, provide a dynamic service identifying and solving issues within multiple components of critical business systems. Must have skills : EPIC Systems Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Support Engineer, you will act as software detectives, providing a dynamic service that identifies and resolves issues within various components of critical business systems. Your typical day will involve collaborating with team members to troubleshoot software problems, analyzing syste...

About the Role - We are seeking a highly skilled and experienced Senior Data Scientist to join our data science team. - As a Senior Data Scientist, you will play a critical role in driving data-driven decision making across the organization by developing and implementing advanced analytical solutions. - You will leverage your expertise in data science, machine learning, and statistical analysis to uncover insights, build predictive models, and solve complex business challenges. Key Responsibilities - Develop and implement statistical and machine learning models (e.g., regression, classification, clustering, time series analysis) to address business problems. - Analyze large and complex datas...

Support Development, and maintain automated test frameworks, tools, and test cases for Data Engineering and Data Warehouse applications. Collaborate with cross-functional teams, including software developers, data engineers, and data analysts, to ensure comprehensive testing coverage and adherence to quality standards. Conduct thorough testing of data pipelines, ETL processes, and data transformations using Big Data technologies. Apply your knowledge of Data Warehouse/Data Lake methodologies and best practices to validate the accuracy, completeness, and performance of our data storage and retrieval systems. Identify, document, and track software defects, working closely with the development ...

Required Skills Python / Scala, spark/pyspark, Hive, AWS, EMR, S3, SQL, Airflow/ Github 3-4 years experience developing Data & Analytics solutions Experience building data lake solutions leveraging one or more ofthe followingAWS, EMR, S3, Hive & Spark Experience with relational SQL Experience with scripting languages such as Shell, Python Experience with source control tools such as GitHub and related dev process Experience with workflow scheduling tools such as Airflow In-depth knowledge of scalable cloud Has a passion for data solutions Strong understanding of data structures and algorithms Strong understanding of solution and technical design Has a strong problem-solving and analytical mi...

Overview Job Summary : We are looking for a skilled GCP Data Engineer with 3 to 6 years of experience to join our dynamic team. The ideal candidate will have a strong background in data engineering, cloud technologies, and experience with Google Cloud Platform (GCP) services. You will be responsible for designing, building, and maintaining scalable data pipelines and frameworks that support our data analytics and machine learning initiatives. Key Responsibilities : Design and implement data pipelines using GCP services such as BigQuery, Dataflow, and Pub/Sub. Collaborate with data scientists and analysts to understand data needs and deliver appropriate solutions. Optimize data storage and pr...

Key Responsibilities: Optimize scalable data pipelines for ingestion, transformation, and loading of large datasets from diverse sources. Utilize Azure Data Factory for orchestration and automation of ETL/ELT processes, ensuring efficient data flow. Work extensively with Azure services such as Azure Blob Storage and Azure Data Lake Storage (ADLS Gen2) for efficient data storage and management. Integrate and manage data flows using Azure Logic Apps for event-driven automation and workflow orchestration. Develop and maintain robust SQL queries, stored procedures, and data models to support reporting and analytical requirements. Implement and enforce data governance, quality, and security best ...

Dear Candidate, I hope this message finds you well. My name is Vikram Kishore, and Im part of the Talent Acquisition Team at UST Global, Bangalore. I came across your profile on job portals/social media and found it aligns well with a current opportunity were hiring for. Please take a moment to review the position details below and confirm if it matches your experience and career aspirations. If you find it suitable, kindly share your updated resume along with the mandatory information requested. Job Summary: We are looking for a highly skilled Senior Data Engineer with over 6 years of experience in data engineering and a strong focus on data migration projects. The ideal candidate will have...

Role & responsibilities 7 to 12+ years of hands-on experience in SQL database design, data architecture, ETL, Data Warehousing, Data Mart, Data Lake, Big Data, Cloud (AWS) and Data Governance domains. Take ownership of the technical aspects of implementing data pipeline & migration requirements, ensuring that the platform is being used to its fullest potential through designing and building applications around business stakeholder needs. Interface directly with stakeholders to gather requirements and own the automated end-to end data engineering solutions. Implement data pipelines to automate the ingestion, transformation, and augmentation of both structured, unstructured, real time data, an...

Shift : 24*5 Shift Position Overview: You will be the subject matter expert for Power BI and Crystal Reports, responsible for delivering accurate reports, maintaining data integrity, and providing insights that support governance and service reviews. The candidate must be adept at working with both modern and legacy reporting platforms and be able to deliver high-quality work during Canadian business hours. Key Responsibilities : Power BI/SSIS/SSRS,SAS Viya, SAS Viya ,Data Synapse/Data Lake/Data Factory Reporting Development & Maintenance:Design, develop, deploy, and maintain robust reports and interactive dashboards using Power BI and Crystal Reports (optional)Translate business requirement...

About The Role Project Role : Application Support Engineer Project Role Description : Act as software detectives, provide a dynamic service identifying and solving issues within multiple components of critical business systems. Must have skills : EPIC Systems Good to have skills : NA Minimum 2 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Support Engineer, you will act as software detectives, providing a dynamic service that identifies and resolves issues within various components of critical business systems. Your typical day will involve collaborating with team members to troubleshoot software problems, analyzing syste...

We are seeking a highly skilled and motivated Senior Engineer to join our team. The ideal candidate will have a strong foundation in Python programming, PySpark, and hands-on experience with AWS services including EMR, SageMaker, and OpenSearch. This role demands excellent problem-solving abilities and a solid academic background. Key Responsibilities: Design, develop, and optimise scalable data pipelines using Python and PySpark. Build and deploy machine learning models using AWS SageMaker. Work with large-scale data processing on AWS EMR. Implement and manage search solutions using AWS OpenSearch. Collaborate with cross-functional teams to understand requirements and deliver robust solutio...

As a Data Architect, you are required to: Design & develop technical solutions which combine disparate information to create meaningful insights for business, using Big-data architectures Build and analyze large, structured and unstructured databases based on scalable cloud infrastructures Develop prototypes and proof of concepts using multiple data-sources and big-data technologies Process, manage, extract and cleanse data to apply Data Analytics in a meaningful way Design and develop scalable end-to-end data pipelines for batch and stream processing Regularly scan the Data Analytics landscape to stay up to date with latest technologies, techniques, tools and methods in this field Stay curi...

About The Role Project Role : Business and Integration Practitioner Project Role Description : Assists in documenting the integration strategy endpoints and data flows. Is familiar with the entire project life-cycle, including requirements analysis, coding, testing, deployment, and operations to ensure successful integration. Under the guidance of the Architect, ensure the integration strategy meets business goals. Must have skills : SAP Configure Price & Quote Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Business and Integration Practitioner, you will assist in documenting the integration strategy...

Responsibilities Data Architecture: Develop and maintain the overall data architecture, ensuring scalability, performance, and data quality. AWS Data Services: Expertise in using AWS data services such as AWS Glue, S3, SNS, SES, Dynamo DB, Redshift, Cloud formation, Cloud watch, IAM, DMS, Event bridge scheduler etc. Data Warehousing: Design and implement data warehouses on AWS, leveraging AWS Redshift or other suitable options. Data Lakes: Build and manage data lakes on AWS using AWS S3 and other relevant services. Data Pipelines: Design and develop efficient data pipelines to extract, transform, and load data from various sources. Data Quality: Implement data quality frameworks and best pra...

TCS Hiring for skill " MS-Fabric Developer ". Role: MS-Fabric Developer Experience: 4-6 Years Work Location: Kolkata/Bangalore Responsibilities: Design and build data pipelines and workflows in Microsoft Fabric using Lakehouse, Dataflow Gen2, and Warehouse. Develop and optimize ETL/ELT processes for structured, semi-structured, and unstructured data. Implement data models, partitions, and performance tuning in Fabric and Synapse. Integrate data from multiple sources into OneLake ensuring quality, lineage, and consistency. Collaborate with architects, analysts, and BI developers to enable analytics and reporting solutions . Ensure compliance with data governance, security, and RBAC policies ....

Strong understanding of data integration concepts and ETL/ELT processes.Solid understanding of SQL and relational databases. Bachelor's degree in Computer Science, Engineering, or a related field. Key Responsibilities: Design, develop, and maintain scalable data pipelines and ETL processes to support data integration from various sources. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that meet their needs. Optimize and improve existing data systems for performance, reliability, and scalability. Implement data quality and validation processes to ensure data integrity and accuracy. Manage and monitor data environments, ...

Dear Candidate , Please find the details below: Skills - Data Lead (MS Fabric - Mandatory Skill) Exp - 8 to 12 years Location Pune-Viman Nagar (WFO) Please find the job description below: Design and build data pipelines, lakehouse architectures (Bronze–Silver–Gold) , and semantic models in Microsoft Fabric. Develop data ingestion and transformation workflows using Data Factory, Dataflows Gen2, SQL, and PySpark. Integrate Fabric with Power BI for analytics and reporting, ensuring data quality, governance, and performance optimization. Implement DevOps (CI/CD, Git) practices for Fabric assets and stay updated with Microsoft Fabric roadmap (Cortex AI, Copilot, Real-Time Intelligence). Kindly Sh...

Job Responsibilities : SQL Development : - Write medium to complex SQL queries to support data extraction, transformation, and analysis. - Optimize SQL queries for performance and maintainability.PySpark/Spark Development : - Develop, test, and deploy data processing applications using PySpark or Spark with Scala. - Implement and maintain ETL/ELT data pipelines, ensuring efficient data processing and integration.ETL/ Data Engineering Pipeline Design : - Design and implement robust ETL pipelines to support data ingestion, transformation, and loading. - Collaborate with data architects and engineers to ensure seamless data flow and integration across systems. Cloud Technology Utilization : - L...

SUMMARY W issen Technology is Hiring for Azure Databricks Engineer About Wissen Technology: At Wissen Technology, we deliver niche, custom-built products that solve complex business challenges across industries worldwide. Founded in 2015, our core philosophy is built around a strong product engineering mindset ensuring every solution is architected and delivered right the first time. Today, Wissen Technology has a global footprint with 2000+ employees across offices in the US, UK, UAE, India, and Australia . Our commitment to excellence translates into delivering 2X impact compared to traditional service providers. How do we achieve this? Through a combination of deep domain knowledge, cutti...

Build and optimize large-scale data platforms on AWS. Must have strong skills in PySpark, AWS Glue, Redshift, S3, and Lambda. Design robust ETL/ELT pipelines in a fast-paced environment. Apply now recruiter2@rankskills.in Perks and benefits Mediclaim policy & Personal Accident Policy

Senior Data Engineer - Palantir Foundry We are looking for a Senior Data Engineer with strong hands-on experience in Palantir Foundry to design, build, and optimize scalable data pipelines and analytics solutions. Required Skills & Qualifications: 5+ years of experience in data engineering, analytics, or software development. Proven expertise in Palantir Foundry (pipelines, ontology, fusion, transformations). Strong programming skills in Python and SQL . Experience with AWS , data lakes, and cloud data warehouses. Familiarity with ETL processes, CI/CD pipelines, and Git. Strong problem-solving and debugging skills. Excellent communication and teamwork abilities. Required Skills Python,AWS,Pa...

Job description- Databricks Years of Experience- 7-11 years Location- Bangalore Job Summary: We are seeking a talented Data Engineer with strong expertise in Databricks, specifically in Unity Catalog, PySpark, and SQL, to join our data team. You'll play a key role in building secure, scalable data pipelines and implementing robust data governance strategies using Unity Catalog. Key Responsibilities: Design and implement ETL/ELT pipelines using Databricks and PySpark. Work with Unity Catalog to manage data governance, access controls, lineage, and auditing across data assets. Develop high-performance SQL queries and optimize Spark jobs. Collaborate with data scientists, analysts, and business...

Position Overview: You will be the subject matter expert for Power BI and Crystal Reports, responsible for delivering accurate reports, maintaining data integrity, and providing insights that support governance and service reviews. The candidate must be adept at working with both modern and legacy reporting platforms and be able to deliver high-quality work during Canadian business hours. Key Responsibilities: Power BI/SSIS/SSRS,SAS Viya, SAS Viya ,Data Synapse/Data Lake/Data Factory Reporting Development & Maintenance:Design, develop, deploy, and maintain robust reports and interactive dashboards using Power BI and Crystal Reports (optional) Translate business requirements into effective da...