999 Data Lake Jobs - Page 20

Overview As Senior Analyst, Data Modeling, your focus would be to partner with D&A Data Foundation team members to create data models for Global projects. This would include independently analyzing project data needs, identifying data storage and integration needs/issues, and driving opportunities for data model reuse, satisfying project requirements. Role will advocate Enterprise Architecture, Data Design, and D&A standards, and best practices. You will be performing all aspects of Data Modeling working closely with Data Governance, Data Engineering and Data Architects teams. As a member of the data modeling team, you will create data models for very large and complex data applications in p...

Job Title Senior Software EngineerExperience 12-20 YearsLocation Bangalore : Strong knowledge & hands-on experience in AWS Data Bricks Nice to have Worked in hp eco system (FDL architecture) Technically strong to help the team on any technical issues they face during the execution. Owns the end-to-end technical deliverablesHands on data bricks + SQL knowledge Experience in AWS S3, Redshift, EC2 and Lambda services Extensive experience in developing and deploying Bigdata pipelines Experience in Azure data lake Strong hands on in SQL development / Azure SQL and in-depth understanding of optimization and tuning techniques in SQL with Redshift Development in Notebooks (like Jupyter, DataBricks, ...

We are looking to hire Data engineer for the Platform Engineering team. It is a collection of highly skilled individuals ranging from development to operations with a security first mindset who strive to push the boundaries of technology. We champion a DevSecOps culture and raise the bar on how and when we deploy applications to production. Our core principals are centered around automation, testing, quality, and immutability all via code. The role is responsible for building self-service capabilities that improve our security posture, productivity, and reduce time to market with automation at the core of these objectives. The individual collaborates with teams across the organization to ens...

Role: Senior Solution Architect Location: Hyderabad Work mode: Onsite Duration: C2H Date of Join: With in 15days We seek a bright, inquisitive, energetic, and skilled Senior Solutions Architect(SSA) to join our team in Hyderabad. Successful candidates will have a bachelors degree in computer science or computer engineering, from a top university, and 6+ years of work experience. Further, candidates will have experience in a wide range of development: 5+ years of strong experience designing and architecting Data Lake systems, data transformation & ETL on large data sets using open technologies 5+ Experience building Web and API application in Public Cloud environment (one of the major cloud p...

We are seeking a highly experienced Principal Solution Architect to lead the design, development, and implementation of sophisticated cloud-based data solutions for our key clients. The ideal candidate will possess deep technical expertise across multiple cloud platforms (AWS, Azure, GCP), data architecture paradigms, and modern data technologies. You will be instrumental in shaping data strategies, driving innovation through areas like GenAI and LLMs, and ensuring the successful delivery of complex data projects across various industries. Key Responsibilities: Solution Design & Architecture: Lead the architecture and design of robust, scalable, and secure enterprise-grade data solutions, in...

8+ years of experience in data engineering with a strong focus on AWS services . Proven expertise in: Amazon S3 for scalable data storage AWS Glue for ETL and serverless data integration using Amazon S3, DataSync, EMR, Redshift for data warehousing and analytics Proficiency in SQL , Python , or PySpark for data processing. Experience with data modeling , partitioning strategies , and performance optimization . Familiarity with orchestration tools like AWS Step Functions , Apache Airflow , or Glue Workflows . Strong understanding of data lake and data warehouse architectures. Excellent problem-solving and communication skills. Mandatory Competencies Beh - Communication ETL - ETL - AWS Glue Bi...

As a Senior ETL & Data Streaming Engineer at DataFlow Group, a global provider of Primary Source Verification solutions and background screening services, you will be a key player in the design, development, and maintenance of robust data pipelines. With over 10 years of experience, you will leverage your expertise in both batch ETL processes and real-time data streaming technologies to ensure efficient data extraction, transformation, and loading into our Data Lake and Data Warehouse. Your responsibilities will include designing and implementing highly scalable ETL processes using industry-leading tools, as well as architecting batch and real-time data streaming solutions with technologies ...

The SF Data Cloud Architect plays a critical role within Salesforce's Professional Services team, assisting in pre-sales activities and leading the design and implementation of enterprise-grade Data Management solutions. As the SF Data Cloud Architect, you are responsible for architecting scalable solutions across enterprise landscapes using Data Cloud. Your primary focus is to ensure that data is prepared for enterprise AI, applying data governance guardrails, and supporting enterprise analytics and automation. This role encompasses the ANZ, ASEAN, and India markets. To excel in this role, you should possess deep expertise in data architecture, project lifecycle management, and comprehensiv...

The project is expected to last for 6 months with a monthly rate of 1.60 Lac. The ideal candidate should have 4-7 years of experience and the work location will be in Bangalore with hybrid working options available. As a candidate, you are required to have a strong proficiency in Python, LLMs, Lang Chain, Prompt Engineering, and related Gen AI technologies. Additionally, you should have proficiency with Azure Databricks and possess strong analytical, problem-solving, and stakeholder communication skills. A solid understanding of data governance frameworks, compliance, and internal controls is essential. Your experience should include data quality rule development, profiling, and implementati...

The opportunity: As a Software Developer, you will be responsible for developing applications using Power Apps, Power Automate, and SharePoint as per the job description. How you'll make an impact: You will develop complex applications with Microsoft Power Apps and Power Automate using SharePoint/Dataverse or SQL as a backend. You will propose and guide the team to establish app data storage and retrieval in the Enterprise data platform, utilizing data lake and data bricks. Connecting with the business to gather requirements and set priorities for development, as well as engaging with subject matter experts to understand business processes, will be crucial aspects of your role. Organizing ch...

As a Data Engineer, you will be responsible for designing, developing, and maintaining robust ETL pipelines using Azure Data Factory (ADF) to support complex insurance data workflows. Your role will involve integrating and extracting data from various Guidewire modules such as PolicyCenter, BillingCenter, and ClaimCenter, ensuring data quality, integrity, and consistency. You will be tasked with building reusable components for data ingestion, transformation, and orchestration across Guidewire and Azure ecosystems. Optimizing ADF pipelines for performance, scalability, and cost-efficiency while following industry-standard DevOps and CI/CD practices will be a key part of your responsibilities...

Designation: Associate Product Architect Experience Required: 4-7 years Notice Period: Immediate to 30 days If anyone is interested, kindly share your resume with cbruno@trinitylifesciences.com Roles & Responsibilities: Data Pipeline solutioning based on the requirements and incorporating various optimization techniques based on various sources involved and data volume. Understanding of storage architectures such as Data Warehouse, Data Lake, and Lake houses Deciding tech stack and development standards, proposing tech solutions and architectural patterns and recommending best practices for the big data solution Providing thought leadership and mentoring to the data engineering team on how d...

The Modern Data Engineer is responsible for designing, implementing, and maintaining scalable data architectures using cloud technologies, primarily on AWS, to support the next evolutionary stage of the Investment Process. They build robust data pipelines, optimize data storage, and access patterns, and ensure data quality while collaborating across engineering teams to deliver high-value data products Key Responsibilities • Implement and maintain data pipelines for ingestion, transformation, and delivery • Ensure data quality through validation and monitoring processes • Collaborate with senior engineers to design scalable data solutions • Work with business analysts to understand and imple...

Principal Data Engineer: Lead architecture for scalable, secure AI-ready data platforms. Build high-throughput pipelines, enable ML workflows, enforce governance, and drive innovation across modern data stacks.

Responsibilities Data Architecture: Develop and maintain the overall data architecture, ensuring scalability, performance, and data quality. AWS Data Services: Expertise in using AWS data services such as AWS Glue, S3, SNS, SES, Dynamo DB, Redshift, Cloud formation, Cloud watch, IAM, DMS, Event bridge scheduler etc. Data Warehousing: Design and implement data warehouses on AWS, leveraging AWS Redshift or other suitable options. Data Lakes: Build and manage data lakes on AWS using AWS S3 and other relevant services. Data Pipelines: Design and develop efficient data pipelines to extract, transform, and load data from various sources. Data Quality: Implement data quality frameworks and best pra...

Responsibilities Data Architecture: Develop and maintain the overall data architecture, ensuring scalability, performance, and data quality. AWS Data Services: Expertise in using AWS data services such as AWS Glue, S3, SNS, SES, Dynamo DB, Redshift, Cloud formation, Cloud watch, IAM, DMS, Event bridge scheduler etc. Data Warehousing: Design and implement data warehouses on AWS, leveraging AWS Redshift or other suitable options. Data Lakes: Build and manage data lakes on AWS using AWS S3 and other relevant services. Data Pipelines: Design and develop efficient data pipelines to extract, transform, and load data from various sources. Data Quality: Implement data quality frameworks and best pra...

5+ years of experience in data engineering with a strong focus on AWS services . Proven expertise in: Amazon S3 for scalable data storage AWS Glue for ETL and serverless data integration using Amazon S3, DataSync, EMR, Redshift for data warehousing and analytics Proficiency in SQL , Python , or PySpark for data processing. Experience with data modeling , partitioning strategies , and performance optimization . Familiarity with orchestration tools like AWS Step Functions , Apache Airflow , or Glue Workflows . Strong understanding of data lake and data warehouse architectures. Excellent problem-solving and communication skills. Mandatory Competencies Beh - Communication ETL - ETL - AWS Glue Bi...

Are you a seasoned data engineer with a passion for hands-on technical work? Do you thrive in an environment that values innovation, collaboration, and cutting-edge technologies? We are looking for a seasoned Integration Engineer to join our team, someone who is passionate about building and maintaining scalable data pipelines and integrations. The ideal candidate will have a strong foundation in Python programming, experience with Snowflake for data warehousing, proficiency in AWS and Kubernetes (EKS) for cloud services management, and expertise in CI/CD practices, Apache Airflow, DBT, and API development. This role is critical to enhancing our data integration capabilities and supporting o...

Job Role - Data Engineer Location - Bangalore / Navi Mumbai / Thane Job Responsibilities : Fundamentals of DevOps, DevSecOps, CD / CI Pipeline using ADO Good understanding of MPP Architecture, MySQL, RDS, MS SQL DB, Oracle ,Postgres DB Would need to interact with Software Integrators on a day-today basis. Deployment and testing skills Strong communication skills ELT - Trino, Azure Data factory, Azure Databricks, PySpark, Python, Iceberg, Parquet CDC Tool like Qlik/ Golden Gate/Dbsium/IBM CDC, Kafka/ Solace • Scripting Shell, Python, Java, Good Understanding of Azure Cloud Engineering – ADLS, Iceberg, Databricks, AKS, RHEL Good understanding of MS Project Development skill using Trino, PySpa...

Hiring an AWS Data Engineer for a 6-month hybrid contractual role based in Bellandur, Bengaluru. The ideal candidate will have 46 years of experience in data engineering, with strong expertise in AWS services (S3, EC2, RDS, Lambda, EKS), PostgreSQL, Redis, Apache Iceberg, and Graph/Vector Databases. Proficiency in Python or Golang is essential. Responsibilities include designing and optimizing data pipelines on AWS, managing structured and in-memory data, implementing advanced analytics with vector/graph databases, and collaborating with cross-functional teams. Prior experience with CI/CD and containerization (Docker/Kubernetes) is a plus.

Job Role: Snowflake / SQL Architect Duration: 6 months contract Job Description: • Architect and manage scalable data solutions using Snowflake and advanced SQL, optimizing performance for analytics and reporting. • Design and implement data pipelines, data warehouses, and data lakes, ensuring efficient data ingestion and transformation. • Develop best practices for data security, access control, and compliance within cloud-based data environmentsCollaborate with cross-functional teams to understand business needs and translate them into robust data architectures. • Evaluate and integrate third-party tools and technologies to enhance the Snowflake ecosystem and overall data strategy.

Greetings!!! This is in regard to a Job opportunity for Technical Program Manager_Data Warehousing & BI with Datamatics Global Services Ltd. Position: PeopleSoft Solution Architect Website: https://www.datamatics.com/ Job Location: Dubai (Onsite)/ Mumbai / Bangalore Job Description: We are looking for Technical Program manager to lead Data Warehouse and BI projects Essential Duties and Responsibilities: Understand the business requirement and project in detail Define the project scope, estimation of resources and timelines, goals, deliverables & measures of success Ensure the team is thoroughly trained on application / technology Guide the team in creating a detailed project work plan & time...

The SAP Delivery Manager role at a Manufacturing Organization involves overseeing the implementation and delivery of SAP projects. You will be responsible for ensuring successful project execution, integration with third-party applications, and adherence to best practices. Your key responsibilities will include leading project management activities, optimizing SAP solutions for manufacturing processes, providing technical leadership in SAP modules, managing team members, and collaborating with stakeholders across different departments. Additionally, you will be required to implement quality assurance processes, identify opportunities for process improvement, manage project risks, and ensure ...

Experience needed: 12-18 years Type: Full-Time Mode: WFO Shift: General Shift IST Location: Hyderabad NP: Immediate Joinee - 30 days Job Summary: We are looking for an experienced and visionary Data Architect - Azure Data & Analytics to lead the design and delivery of scalable, secure, and modern data platform solutions leveraging Microsoft Azure and Microsoft Fabric . This role requires deep technical expertise in the Azure Data & Analytics ecosystem, strong experience in designing cloud-native architectures, and a strategic mindset to modernize enterprise data platforms. Key Responsibilities: Architect and design Modern Data Platform solutions on Microsoft Azure, including ingestion, trans...

As a Lead Data Engineer, you will be responsible for leveraging your 7 to 12+ years of hands-on experience in SQL database design, data architecture, ETL, Data Warehousing, Data Mart, Data Lake, Big Data, Cloud (AWS), and Data Governance domains. Your expertise in a modern programming language such as Scala, Python, or Java, with a preference for Spark/ Pyspark, will be crucial in this role. Your role will require you to have experience with configuration management and version control apps like Git, along with familiarity working within a CI/CD framework. If you have experience in building frameworks, it will be considered a significant advantage. A minimum of 8 years of recent hands-on SQL...