999 Data Lake Jobs - Page 9

Senior data engineers at Thoughtworks are engineers who build, maintain and test the software architecture and infrastructure for managing data applications. They are involved in developing core capabilities which include technical and functional data platforms. They are the anchor for functional streams of work and are accountable for timely delivery. They work on the latest big data tools, frameworks and offerings (data mesh, etc.), while also being involved in enabling credible and collaborative problem solving to execute on a strategy. Job responsibilities You will develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solution...

Lead data engineers at Thoughtworks develop modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. They might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing problems. On projects, they will be leading the design of technical solutions, or perhaps overseeing a program inception to build a new product. Alongside hands-on coding, they are leading the team to implement the solution. Job responsibilities You will lead and manage data engineering projects from inception to completion, including goal-setting, ...

Role & responsibilities We are seeking a hands-on Data Engineer to develop, optimize, and maintain automated data pipelines supporting data governance and analytics initiatives. This role will focus on building production-ready workflows for ingestion, transformation, quality checks, lineage capture, access auditing, cost usage analysis, retention tracking, and metadata integration, primarily using Azure Databricks , Azure Data Lake , and Microsoft Purview . Experience: 4+ years in data engineering, with strong Azure and Databricks experience Key Responsibilities Pipeline Development Design, build, and deploy robust ETL/ELT pipelines in Databricks (PySpark, SQL, Delta Lake) to ingest, transf...

Your opportunity to make a real impact and shape the future of financial services is waiting for you. Let's push the boundaries of what's possible together. As a Senior Director of Software Engineering at JPMorgan Chase within the Consumer and Community Banking division, you will be responsible for leading various technical domains, overseeing the activities of multiple departments, and fostering cross-functional collaboration. Your technical expertise will be utilized across different teams to promote the adoption and implementation of advanced technical methods, helping the firm stay ahead of industry trends, best practices, and technological advancements. Leads multiple technology and pro...

Hi, What you will do at HGS We are looking for dynamic and result oriented cloud data engineers to join our fast-growing Cloud Analytics practice. Candidate should be self-starters with a passion for business analytics and Data and use their excellent problem solving and analytical skills along with superb written and oral communication skills to develop solutions that delight our customers. Keep reading if you have a strong desire to excel and are keen to work on end-to-end cloud analytics projects while further developing your career. Some of your responsibilities would include: Understand existing landscape and business objectives of the customers. Translate their explicit and implicit re...

• Strong hands-on experience with Salesforce Data Cloud and core Salesforce platform Solid understanding of data modelling and integration patterns • Solid understanding of Data Streams, Data Lake, Data Models, Data Transforms and Data Analysis

Job purpose: Manage and create design schema, SQL query tuning, and code review Who you are: Min 3+ years of professional experience in the field of data engineering with knowledge of the data platform and DWH development Min. 2 years of hands-on experience in SSAS tabular models Designed Data Ingestion and Orchestration Pipelines with Kafka and Python Design and develop DBT models and build the data pipeline processes to perform processes as per DBT scripting Experience with analytical tools such as SQL (Snowflake), ETL/ELT (Azure Data Factory, APIs), Cloud (Azure Functions & Storage), and BI tools (Power BI, ThoughtSpot) Proficient in SSAS DAX queries Experience in a role performing data w...

Reference 25000GFH Responsibilities The position of back office cash management agent consists of recording in our tools the information contained in the contracts or amendments signed with the clients These actions enable the implementation or updating of cash management solutions contracts for major Societe Generale, France and International clients MAIN ACCOUNTABILITIES: Analyze and implement contracts and endorsements of national and international cash management products for customers Corporates and Banks, in dedicated IT tools, Record all process steps in dedicated tool until complete validation for each contract or amendments Follow up on contracts and amendments implemented in relati...

We are looking for a Hadoop Developer with hands-on experience in managing, developing data solutions on Hadoop ecosystems. The candidate should have strong technical expertise in data lake design, data pipelines, and real-time/batch data processing. Required Candidate profile 3+ Yrs in Manage & support Cloudera Hadoop on-premise clusters. Work on data modelling, governance, migrations, application development. Proficiency in Spark, Hive, Impala, Kafka, related tools. Perks and benefits To be disclosed post interview

Senior Data Engineer Cloud & Modern Data Architectures Role Overview: We are looking for a Senior Data Engineer with expertise in ETL/ELT, Data Engineering, Data Warehousing, Data Lakes, Data Mesh, and Data Fabric architectures . The ideal candidate should have hands-on experience in at least one or two cloud data platforms (AWS, GCP, Azure, Snowflake, or Databricks) and a strong foundation in building PoCs, mentoring freshers, and contributing to accelerators and IPs. Must-Have: 5-8 years of experience in Data Engineering & Cloud Data Services . Hands-on with any 2 clouds AWS (Redshift, Glue), GCP (BigQuery, Dataflow), Azure (Synapse, Data Factory), Snowflake, Databricks . Strong SQL, Pytho...

As an experienced and dynamic Analytical Team Lead with expertise in Qlik SaaS, Power BI, Data Lake solutions, and AI/ML technologies, you will be responsible for leading a team of data analysts and engineers. Your role will involve driving business intelligence (BI) initiatives, building scalable analytics platforms, and leveraging advanced AI/ML models to uncover actionable insights. It is essential to maintain a strong balance of technical expertise, strategic thinking, and leadership skills to align data strategies with organizational goals. Your key responsibilities will include leadership and team management, where you will lead, mentor, and manage a team of data analysts, BI developer...

As an Data Engineer at IBM you will harness the power of data to unveil captivating stories and intricate patterns. You'll contribute to data gathering, storage, and both batch and real-time processing. Collaborating closely with diverse teams, you'll play an important role in deciding the most suitable data management systems and identifying the crucial data required for insightful analysis. As a Data Engineer, you'll tackle obstacles related to database integration and untangle complex, unstructured data sets. In this role, your responsibilities may include Implementing and validating predictive models as well as creating and maintain statistical models with a focus on big data, incorporat...

Youll make a difference by: Having Expertise in multi-cloud platforms AWS, GCP, and Azure. Possessing Strong skills in data ingestion, ETL/ELT, batch & streaming pipelines, and data warehousing. Having Hands-on experience with Big Data tools like Spark, Hadoop, Kafka, Hive, and Databricks. Having Knowledge of ML engineering and MLOps practices for scalable deployments. Having Proficiency in Python, SQL, Scala; exposure to Java is a plus. Having Experience with CI/CD, Docker, Kubernetes, and Infrastructure as Code (Terraform/CloudFormation). Having Ability to design innovative, scalable, and secure data-driven solutions. Youll win us over by: Holding a graduate BE / B.Tech / MCA/ M.Tech / M.S...

About The Role Project Role : Software Development Lead Project Role Description : Develop and configure software systems either end-to-end or for a specific stage of product lifecycle. Apply knowledge of technologies, applications, methodologies, processes and tools to support a client, project or entity. Must have skills : PTC Windchill Good to have skills : NAMinimum 12 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Software Development Lead, you will be responsible for developing and configuring software systems, either end-to-end or for specific stages of the product lifecycle. Your typical day will involve collaborating with var...

About The Role Project Role : Software Development Lead Project Role Description : Develop and configure software systems either end-to-end or for a specific stage of product lifecycle. Apply knowledge of technologies, applications, methodologies, processes and tools to support a client, project or entity. Must have skills : Microsoft Fabric Good to have skills : NAMinimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Software Development Lead, you will develop and configure software systems, either end-to-end or for specific stages of the product lifecycle. Your typical day will involve collaborating with various teams to ensure t...

Job Title: Microsoft Purview Specialist (Junior Level) Type: Contract (36 Months Project) Location: Mumbai, Delhi / NCR, Bengaluru , Kolkata, Chennai, Hyderabad, Ahmedabad, Pune, Remote Experience: 1--3 Years Preferred Availability: Immediate Joiners Preferred Were looking for a Junior Microsoft Purview Specialist to support our data cataloging and governance initiatives in a fast-paced remote setup. Key Responsibilities: Assist in the configuration and management of Microsoft Purview Support data cataloging, classification, and lineage tracking Work with data owners to ensure proper tagging and metadata management Help implement data governance policies Assist in integrating Purview with Az...

Type: Contract (36 Months Project) Availability: Immediate Joiners Preferred Were looking for a Junior Microsoft Purview Specialist to support our data cataloging and governance initiatives in a fast-paced remote setup. Key Responsibilities: Assist in the configuration and management of Microsoft Purview Support data cataloging, classification, and lineage tracking Work with data owners to ensure proper tagging and metadata management Help implement data governance policies Assist in integrating Purview with Azure and on-premises sources Document governance processes and resolve Purview-related issues Collaborate with project teams for timely delivery Primary Skills Required: Microsoft Purvi...

Type: Contract (36 Months Project) Location: Remote- Bengaluru,Hyderabad,Delhi / NCR,Chennai,Pune,Kolkata,Ahmedabad,Mumbai Availability: Immediate Joiners Preferred Were looking for a Junior Microsoft Purview Specialist to support our data cataloging and governance initiatives in a fast-paced remote setup. Key Responsibilities: Assist in the configuration and management of Microsoft Purview Support data cataloging, classification, and lineage tracking Work with data owners to ensure proper tagging and metadata management Help implement data governance policies Assist in integrating Purview with Azure and on-premises sources Document governance processes and resolve Purview-related issues Col...

As a Senior Azure Data Engineer, your responsibilities will include: Building scalable data pipelines using Databricks and PySpark Transforming raw data into usable business insights Integrating Azure services like Blob Storage, Data Lake, and Synapse Analytics Deploying and maintaining machine learning models using MLlib or TensorFlow Executing large-scale Spark jobs with performance tuning on Spark Pools Leveraging Databricks Notebooks and managing workflows with MLflow Qualifications: Bachelors/Masters in Computer Science, Data Science, or equivalent 7+ years in Data Engineering, with 3+ years in Azure Databricks Strong hands-on in: PySpark, Spark SQL, RDDs, Pandas, NumPy, Delta Lake Azur...

We are looking for a highly skilled and experienced Data Engineer with over 5 years of experience to join our growing data team. The ideal candidate will be proficient in Databricks, Python, PySpark, and Azure, and have hands-on experience with Delta Live Tables. In this role, you will be responsible for developing, maintaining, and optimizing data pipelines and architectures to support advanced analytics and business intelligence initiatives. You will collaborate with cross-functional teams to build robust data infrastructure and enable data-driven decision-making. Key Responsibilities: .Design, develop, and manage scalable and efficient data pipelines using PySpark and Databricks .Build an...

We are seeking an experienced Data Architect to join our team , working with our UAE-based client. The ideal candidate should have 8-12 years of hands-on experience in data architecture, with at least 4 years in architectural design and integration. Strong expertise in MS Dynamics and data lake architecture is required, along with proficiency in ETL, data modeling, data integration, and data quality assurance. The candidate should have a strong problem-solving mindset, the ability to handle architectural issues, and experience in troubleshooting. They should also be a proactive contributor and a team player with a flexible attitude. The role requires immediate availability and the ability to...

We are seeking an experienced Azure Data Engineer with 36 years of experience for a 6-month remote contract. The candidate will be responsible for developing and supporting IT solutions using technologies like Azure Data Factory, Azure Databricks, Azure Synapse, Python, PySpark, Teradata, and Snowflake. The role involves designing ETL pipelines, developing Databricks notebooks, handling CI/CD pipelines via Azure DevOps, and working on data warehouse modeling and integration. Strong skills in SQL, data lake storage, and deployment/monitoring are required. Prior experience in Power BI and DP-203 certification is a plus. Location: Remote- Bengaluru,Hyderabad,Delhi / NCR,Chennai,Pune,Kolkata,Ahm...

Responsibilities: Design and implement scalable data pipelines to ingest, process, and analyze large volumes of structured and unstructured data from various sources. Develop and optimize data storage solutions, including data warehouses, data lakes, and NoSQL databases, to support efficient data retrieval and analysis. Implement data processing frameworks and tools such as Apache Hadoop, Spark, Kafka, and Flink to enable real-time and batch data processing. Collaborate with data scientists and analysts to understand data requirements and develop solutions that enable advanced analytics, machine learning, and reporting. Ensure data quality, integrity, and security by implementing best practi...

Hiring an AWS Data Engineer for a 6-month hybrid contractual role based in Bellandur, Bengaluru. The ideal candidate will have 7+ years of experience in data engineering, with strong expertise in AWS services (S3, EC2, RDS, Lambda, EKS), PostgreSQL, Redis, Apache Iceberg, and Graph/Vector Databases. Proficiency in Python or Golang is essential. Responsibilities include designing and optimizing data pipelines on AWS, managing structured and in-memory data, implementing advanced analytics with vector/graph databases, and collaborating with cross-functional teams. Prior experience with CI/CD and containerization (Docker/Kubernetes) is a plus.

Hiring an AWS Data Engineer for a 6-month hybrid contractual role based in Bellandur, Bengaluru. The ideal candidate will have 46 years of experience in data engineering, with strong expertise in AWS services (S3, EC2, RDS, Lambda, EKS), PostgreSQL, Redis, Apache Iceberg, and Graph/Vector Databases. Proficiency in Python or Golang is essential. Responsibilities include designing and optimizing data pipelines on AWS, managing structured and in-memory data, implementing advanced analytics with vector/graph databases, and collaborating with cross-functional teams. Prior experience with CI/CD and containerization (Docker/Kubernetes) is a plus.