999 Data Lake Jobs - Page 11

As a Databricks Architect with 5-8 years of experience, you will be responsible for designing, implementing, and optimizing scalable data architectures leveraging Databricks on public cloud platforms. Your role will involve designing enterprise-grade solutions for batch and real-time data analytics, with hands-on expertise in Databricks, Spark, and cloud-based data services. Your key responsibilities will include designing and developing end-to-end data architectures and pipelines with Databricks, optimizing Databricks performance through efficient data processing, job tuning, and resource management, implementing data security, governance, and best practices, collaborating with stakeholders...

You are ready to gain the skills and experience needed to grow within your role and advance your career, and we have the perfect software engineering opportunity for you. As a Software Engineer II at JPMorgan Chase within the Employee Platforms team, you will be part of an agile team dedicated to enhancing, designing, and delivering the software components of the firm's cutting-edge technology products in a secure, stable, and scalable manner. In your role as an emerging member of the software engineering team, you will execute software solutions by designing, developing, and technically troubleshooting various components within a technical product, application, or system, while acquiring th...

Position Purpose - Mission The data engineer is responsible for Designing, Architecting and implementing robust, scalable and maintainable data pipelines. candidate will work directly with upstream stockholders (applications owners, data providers) and downstream stakeholders (Data consumers, Data analysts, Data Scientists) to define the data pipeline requirements, implement solutions that serve downstream stakeholders needs through APIs, materialized views. On day to day, Candidate works in conjunction with the Data Analyst, for the aggregation and preparation of data. interacts with security, continuity and IT architecture to validate the IT assets designs and develops. Furthermore, works ...

Overview Annalect is currently seeking a data engineering lead to join our technology team. In this role you will be building data pipelines and developing data set processes. We are looking for people who have a shared passion for technology, design & development, data, and fusing these disciplines together to build cool things. In this role, you will lead teams working on one or more software and data products in the Annalect Engineering Team. You will participate in technical architecture, design and development of software products as well as research and evaluation of new technical solutions. You will also help us drive the vision forward for data engineering projects by helping us exte...

Position Purpose DPR team member guarantees application production for both technical and functional support for a given Business Line or Business Line application chain, on the IT asset management for the infrastructure (IAAS , PAAS, CAAS and IT cloud ). He/she ensures that the service is maintained in operational condition. He/she ensures the smooth running of the processes (batch process[1]ing, transfer, etc.) and the proper functioning in the application sense of the term (relevant business data, functional result, correct execution of application workflows, etc.). In a context of accelerating change, he/she manages the various releases within his/her scope. He/she intervenes not only in...

Position Purpose The CE&P AML IT team is in charge of AML Monitoring tools for CIB and all regions. AML Monitoring tools are mainly used by Financial Security Compliance and CIB ITO LoD1. The purpose of the role is to seek a highly skilled and experienced AML Functional, Technical, and Data Architect with expertise in Actimize models and rules. The candidate will have a strong background in developing and optimizing database models on the AML Data Lake architecture, specifically focusing on Actimize. They will be responsible for designing, implementing, and maintaining data architecture solutions that effectively support our AML and compliance activities, with a specific emphasis on Actimize...

IBS Software is looking for Senior Data Engineer to join our dynamic team and embark on a rewarding career journey A Senior Data Engineer is a technical expert responsible for designing, building, and maintaining the systems and infrastructure needed to support data-driven applications and analytics The job responsibilities of a Senior Data Engineer may include: Designing and implementing scalable and reliable data pipelines, data models, and data infrastructure for processing large and complex datasets Developing and maintaining databases, data warehouses, and data lakes that store and manage the organization's data Developing and implementing data integration and ETL (Extract, Transform, L...

CRISIL is looking for Snowflake Developer to join our dynamic team and embark on a rewarding career journey A Snowflake Developer is responsible for designing and developing data solutions within the Snowflake cloud data platform They play a critical role in helping organizations to store, process, and analyze their data effectively and efficiently Responsibilities:Design and develop data solutions within the Snowflake cloud data platform, including data warehousing, data lake, and data modeling solutions Participate in the design and implementation of data migration strategiesEnsure the quality of custom solutions through the implementation of appropriate testing and debugging proceduresPro...

Your Career Our Data & Analytics group is responsible for working with various business owners/stakeholders from Sales, Marketing, People, GCS, Infosec, Operations, and Finance to solve complex business problems which will have a direct impact on the metrics defined to showcase the progress of Palo Alto Networks. We leverage the latest technologies from the Cloud & Big Data ecosystem to improve business outcomes and create through prototyping, Proof-of-Concept projects and application development. We are looking for a Staff IT Data and ML platform Engineer. Cloud engineering and business intelligence (BI) tools. The ideal candidate will be responsible for designing, implementing, and maintai...

Design, implement, and maintain data pipelines for processing large datasets, ensuring data availability, quality, and efficiency for machine learning model training and inference. Collaborate with data scientists to streamline the deployment of machine learning models, ensuring scalability, performance, and reliability in production environments. Develop and optimize ETL (Extract, Transform, Load) processes, ensuring data flow from various sources into structured data storage systems. Automate ML workflows using ML Ops tools and frameworks (e.g., Kubeflow, MLflow, TensorFlow Extended (TFX)). Ensure effective model monitoring, versioning, and logging to track performance and metrics in a pro...

Project description We are looking for a skilled Data Engineer with strong experience in AWS and Apache Airflow to join a dynamic data team. You will be responsible for building and maintaining scalable data pipelines, orchestrating workflows, and ensuring data quality and availability across platforms. esponsibilities Data Pipeline DevelopmentDesign, build, and maintain robust, scalable, and efficient ETL/ELT pipelines for ingesting, transforming, and loading data from various sources into our data lake and data warehouse. AWS ExpertiseDevelop and manage data solutions using a wide range of AWS services, including but not limited to StorageS3 (for data lakes), RDS (PostgreSQL, MySQL), Redsh...

Project description We are looking for a skilled Data Engineer with strong experience in AWS and Apache Airflow to join a dynamic data team. You will be responsible for building and maintaining scalable data pipelines, orchestrating workflows, and ensuring data quality and availability across platforms. esponsibilities Data Pipeline DevelopmentDesign, build, and maintain robust, scalable, and efficient ETL/ELT pipelines for ingesting, transforming, and loading data from various sources into our data lake and data warehouse. AWS ExpertiseDevelop and manage data solutions using a wide range of AWS services, including but not limited to StorageS3 (for data lakes), RDS (PostgreSQL, MySQL), Redsh...

Project description We are looking for a skilled Data Engineer with strong experience in AWS and Apache Airflow to join a dynamic data team. You will be responsible for building and maintaining scalable data pipelines, orchestrating workflows, and ensuring data quality and availability across platforms. esponsibilities Data Pipeline DevelopmentDesign, build, and maintain robust, scalable, and efficient ETL/ELT pipelines for ingesting, transforming, and loading data from various sources into our data lake and data warehouse. AWS ExpertiseDevelop and manage data solutions using a wide range of AWS services, including but not limited to StorageS3 (for data lakes), RDS (PostgreSQL, MySQL), Redsh...

Tezo is a new generation Digital & AI solutions provider, with a history of creating remarkable outcomes for our customers. We bring exceptional experiences using cutting-edge analytics, data proficiency, technology, and digital excellence. Role: Data Solution Architect Experience: 10-12 years Location: Hyderabad (or willing to relocate) About the Role Tezo is looking for a experienced Data Solution Architect with 1012 years of expertise in designing, architecting, and delivering enterprise-grade data solutions. The ideal candidate will have a strong background in data modelling, data warehousing, and presales engagements , with the ability to translate business requirements into scalable, s...

Project Role : Packaged/SaaS Application Engineer Project Role Description : Configure and support packaged or SaaS applications to adapt features, manage releases, and ensure system stability. Use standard tools, APIs, and low-code platforms to align solutions with business needs while preserving compatibility and performance. Must have skills : Tax Accounting Good to have skills : NAMinimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Packaged/SaaS Application Engineer, we are seeking an experienced Tax Functional Consultant with in-depth knowledge of the SOVOS tax compliance platform to support our SAP landscape and ensure seam...

Develop and execute test scripts to validate data pipelines, transformations, and integrations. Formulate and maintain test strategiesincluding smoke, performance, functional, and regression testingto ensure data processing and ETL jobs meet requirements. Collaborate with development teams to assess changes in data workflows and update test cases to preserve data integrity. Design and run tests for data validation, storage, and retrieval using Azure services like Data Lake, Synapse, and Data Factory, adhering to industry standards. Continuously enhance automated tests as new features are developed, ensuring timely delivery per defined quality standards. Participate in data reconciliation and...

Classic pipeline Powershell Yaml Biceps Arm Templateterraform/ Biceps CI/CD Experience with data lake and analytics technologies in Azure (e.g., Azure Data Lake Storage, Azure Data Factory, Azure Databricks)- most important Data background with Azure & Powershell. Location: Chennai, Hyderabad, Kolkata, Pune, Ahmedabad, Remote. Keywords Classic pipeline,PowerShell,YAML,Biceps,ARM Template,CI/CD,Azure Data Lake Storage,Azure Data Factory,Azure Databricks,Azure DevOps*Mandatory Key Skills Classic pipeline,PowerShell,YAML,Biceps,ARM Template,CI/CD,Azure Data Lake Storage,Azure Data Factory,Azure Databricks,Azure DevOps*

The Senior Database Administrator exercises judgment when following general instructions and is responsible for working independently to support database operations, focusing on resolving routine and semi-routine database issues of limited to moderate complexity. This role involves learning multiple database technologies while supporting mission-critical applications. As a Senior Database Engineer on the Marketing Technology team, you will help deploy and maintain scalable combinations of people, process, and technology that ensure best practices in campaign planning / execution, lead generation, segmentation, and data management. You will be expected to stay abreast of industry and technolo...

We are looking for a skilled Azure Data Engineer to design, build, and maintain scalable data pipelines and cloud-based data solutions on Microsoft Azure. You will work closely with data analysts, scientists, and business stakeholders to ensure efficient data processing, storage, and access. Key Responsibilities: Design and develop robust and scalable data pipelines using Azure Data Factory , Databricks , and Azure Synapse Analytics Develop and optimize ETL/ELT processes Implement data lake and data warehouse solutions using Azure Data Lake Storage , SQL Server , and Synapse Work with structured and unstructured data from various sources (e.g., APIs, databases, files) Ensure data quality, in...

Role Description: As a Senior Technical Lead - Big Data Platform at Incedo, you will be responsible for designing and implementing big data platforms to support large-scale data integration projects. You will work with data architects and data engineers to define the platform architecture and build the necessary infrastructure. You will be skilled in big data technologies such as Hadoop, Spark, and Kafka and have experience in cloud computing platforms such as AWS or Azure. You will be responsible for ensuring the performance, scalability, and security of the big data platform and troubleshooting any issues that arise. Roles & Responsibilities: Designing, developing and maintaining large-sca...

About Role: We are seeking an experienced AWS Cloud Architect to design, implement, and optimize our cloud infrastructure and data platform solutions. The ideal candidate will bring deep expertise in AWS services, Infrastructure as Code (IaC), security, networking, and data platforms, with a proven track record in delivering large-scale, reliable, and secure cloud environments. Roles & Responsibilities Design and implement secure, scalable AWS cloud architectures (compute, storage, networking, data, CI/CD). Develop Infrastructure as Code (Terraform/CloudFormation/CDK) and automated provisioning pipelines. Ensure security, compliance, and governance across AWS environments. Optimize cloud cos...

About The Role The Data Architect plays a critical role in designing, implementing, and managing the enterprise data architecture for ELGi, ensuring that data platforms, systems, and solutions are scalable, efficient, and aligned with business needs. Role & responsibilities Data Architecture Design and Strategy Define and implement the enterprise data architecture strategy, ensuring alignment with business and IT objectives. Design scalable, secure, and cost-effective data platforms, including data lakes, data warehouses, and real-time streaming solutions. Develop data models and integration frameworks to support analytics, reporting, and business intelligence (BI) initiatives. Drive the ado...

Project Role : Business and Integration Practitioner Project Role Description : Assists in documenting the integration strategy endpoints and data flows. Is familiar with the entire project life-cycle, including requirements analysis, coding, testing, deployment, and operations to ensure successful integration. Under the guidance of the Architect, ensure the integration strategy meets business goals. Must have skills : SAP Configure Price & Quote Good to have skills : NAMinimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Business and Integration Practitioner, you will assist in documenting the integration strategy endpoints and d...

Project Role : Business and Integration Practitioner Project Role Description : Assists in documenting the integration strategy endpoints and data flows. Is familiar with the entire project life-cycle, including requirements analysis, coding, testing, deployment, and operations to ensure successful integration. Under the guidance of the Architect, ensure the integration strategy meets business goals. Must have skills : SAP Configure Price & Quote Good to have skills : NAMinimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Business and Integration Practitioner, you will assist in documenting the integration strategy endpoints and d...

Below is the JD. We are seeking a highly skilled ETL Data Tester with strong experience in ETL testing, Data Warehousing, and automation using Python . The ideal candidate should also have hands-on expertise in Cloud Data platforms (AWS/Azure) with exposure to Glue, Redshift, Synapse, or equivalent technologies . This role involves validating end-to-end data pipelines, ensuring data accuracy, quality, and performance across complex ETL processes. Key Responsibilities Perform ETL testing for data pipelines, staging, transformation, and target tables. Validate data extraction, transformation, and loading processes from multiple sources to Data Warehouse. Conduct data quality checks, reconcilia...