1019 Data Lake Jobs - Page 38

Project Role : Software Development Engineer Project Role Description : Analyze, design, code and test multiple components of application code across one or more clients. Perform maintenance, enhancements and/or development work. Must have skills : BlueYonder Order Management Good to have skills : NAMinimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :Role Overview:We are looking for an experienced Integration Architect to lead the design and execution of integration strategies for Blue Yonder (BY) implementations across cloud-native environments. The ideal candidate will possess strong expertise in integrating supply chain platforms w...

Notice Period - Immediate joiner Responsibilities Lead, develop and support analytical pipelines to acquire, ingest and process data from multiple sources Debug, profile and optimize integrations and ETL/ELT processes Design and build data models to conform to our data architecture Collaborate with various teams to deliver effective, high value reporting solutions by leveraging an established DataOps delivery methodology Continually recommend and implement process improvements and tools for data collection, analysis, and visualization Address production support issues promptly, keeping stakeholders informed of status and resolutions Partner closely with on and offshore technical resources Pr...

5+ years of experience in data engineering with a strong focus on AWS services . Proven expertise in: Amazon S3 for scalable data storage AWS Glue for ETL and serverless data integration using Amazon S3, DataSync, EMR, Redshift for data warehousing and analytics Proficiency in SQL , Python , or PySpark for data processing. Experience with data modeling , partitioning strategies , and performance optimization . Familiarity with orchestration tools like AWS Step Functions , Apache Airflow , or Glue Workflows . Strong understanding of data lake and data warehouse architectures. Excellent problem-solving and communication skills. Mandatory Competencies Beh - Communication ETL - ETL - AWS Glue Bi...

As Architect at IBM you will harness the power of data to unveil captivating stories and intricate patterns. You'll contribute to data gathering, storage, and both batch and real-time processing. Collaborating closely with diverse teams, you'll play an important role in deciding the most suitable data management systems and identifying the crucial data required for insightful analysis. As a Data Architect, you'll tackle obstacles related to database integration and untangle complex, unstructured data sets. In this role, your responsibilities may include Implementing and validating predictive models as well as creating and maintain statistical models with a focus on big data, incorporating a ...

Dear Aspirant , Greetings from TCS ! TCS presents excellent opportunity for Data Lake - Engineer / Consultant / Solution Architect / Technical Architect Exp: 7 - 18 Yrs Job Location: Chennai / Bangalore / Hyderabad / Mumbai / Pune / Kolkata / Delhi / Noida / Gurgaon Implementation experience in Data Lake Experience in architecture definition, design and implementation of data lake solutions on Azure or AWS or Snowflake. Designs and models Data lake architecture, implements standards, best practices and processes to improve the management of information and data throughout its lifecycle across this platform. Design and implement data engineering, ingestion and curation functions on data lake ...

Dear Aspirant , Greetings from TCS ! TCS presents excellent opportunity for Data Lake - Engineer / Consultant / Solution Architect / Technical Architect Exp: 7 - 18 Yrs Job Location: Chennai / Bangalore / Hyderabad / Mumbai / Pune / Kolkata / Delhi / Noida / Gurgaon Implementation experience in Data Lake Experience in architecture definition, design and implementation of data lake solutions on Azure or AWS or Snowflake. Designs and models Data lake architecture, implements standards, best practices and processes to improve the management of information and data throughout its lifecycle across this platform. Design and implement data engineering, ingestion and curation functions on data lake ...

Project Role :Application Support Engineer Project Role Description : Act as software detectives, provide a dynamic service identifying and solving issues within multiple components of critical business systems. Must have skills : EPIC Systems Good to have skills : NAMinimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Support Engineer, you will act as software detectives, providing a dynamic service that identifies and resolves issues within various components of critical business systems. Your typical day will involve collaborating with team members to troubleshoot software problems, analyzing system performance, an...

Project Role :Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Data Engineering Good to have skills : Oracle Procedural Language Extensions to SQL (PLSQL), Python (Programming Language), Google BigQueryMinimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your...

About The Role Job Title: Data Architect - Utilities Domain S&C GN Management Level: 09 to 07 Location: Mumbai / Pune / Bangalore / Gurgaon / Hyderabad Must Have Skills: Enterprise Data Architecture, Data Modeling, Utilities Domain Knowledge, Cloud-based Data Platforms (AWS/Azure/GCP) Good to Have Skills: Data Governance (Collibra, Purview, Unity Catalog), Data Product Design, Utilities Analytics (Asset Performance, Risk Modeling), SCADA/OMS/PI Historian Knowledge Job Summary : As a Data Architect in the Utilities domain, you will lead the design and implementation of modern, scalable, and secure enterprise data architectures. You will define data strategies, create architecture blueprints, ...

Project Role :Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Data Engineering Good to have skills : Oracle Procedural Language Extensions to SQL (PLSQL), Python (Programming Language), Google BigQueryMinimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your...

Project Role :Business and Integration Practitioner Project Role Description : Assists in documenting the integration strategy endpoints and data flows. Is familiar with the entire project life-cycle, including requirements analysis, coding, testing, deployment, and operations to ensure successful integration. Under the guidance of the Architect, ensure the integration strategy meets business goals. Must have skills : Personal Insurance Good to have skills : NAMinimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Business and Integration Practitioner, your typical day involves collaborating with various teams to document integratio...

The Data Platform Engineer will be responsible for designing, implementing, and optimising the technical foundation of our Microsoft Fabric environment. This role combines deep platform architecture expertise with governance, security, cost management, and vendor oversight to ensure high performance, scalability, and compliance across enterprise data systems. You will provide architectural leadership for both internal teams and external vendors, driving best practices for building robust, future-ready data products on the Microsoft Fabric platform. Key Responsibilities Platform Architecture & Infrastructure Design and implement enterprise-grade Microsoft Fabric architecture with a focus on p...

Strong expertise in Microsoft Fabric, Python/PySpark, SQL, and data warehousing/lakehouse concepts. Excellent analytical, problem-solving, and communication skills with experience in agile environments; certifications

Your Role IT experience with a minimum of 5+ years of experience in creating data warehouses, data lakes, ETL/ELT, data pipelines on cloud. Has data pipeline implementation experience with any of these cloud providers - AWS, Azure, GCP. preferably - Life Sciences Domain Experience with cloud storage, cloud database, cloud Data ware housing and Data Lake solutions like Snowflake, Big query, AWS Redshift, ADLS, S3. Experience with cloud storage, cloud database, cloud Data ware housing and Data Lake solutions like Snowflake, Big query, AWS Redshift, ADLS, S3. Experience in using cloud data integration services for structured, semi structured and unstructured data such as Azure Databricks, Azure...

Lead data engineers at Thoughtworks develop modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. They might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing problems. On projects, they will be leading the design of technical solutions, or perhaps overseeing a program inception to build a new product. Alongside hands-on coding, they are leading the team to implement the solution. Job responsibilities You will lead and manage data engineering projects from inception to completion, including goal-setting, ...

Greetings from Future Focus Infotech!!! We have multiple opportunities Azure Data Engineer Exp: 4+yrs Skills : Azure Data Bricks Location : Hyderabad / Chennai / Bnagalore Job Type- This is a Permanent position with Future Focus Infotech Pvt Ltd & you will be deputed with our client. A small glimpse about Future Focus Infotech Pvt Ltd. (Company URL: www.focusinfotech.com) If you are interested in above opportunity, send updated CV and below information to reema.b@focusinfotech.com Kindly mention the below details. Total Years of Experience: Current CTC: Expected CTC: Notice Period : Current location: Available for interview on weekdays: Pan Card : Thanks & Regards, Reema reema.b@focusinfotec...

Data Engineer - Azure+Databricks Location: Bangalore | 3 day WFO Experience: 6+ Requirements: 5+ years of experience in data engineering roles. Hands-on experience with: Azure Data Factory (ADF) building pipelines, triggers, linked services. Azure Databricks building and managing Spark jobs in PySpark. Azure Synapse Analytics data warehousing, SQL queries, workspace orchestration. Apache Kafka – consuming and processing real-time data streams. Strong in SQL, Python, and Spark for data manipulation and transformation. Exposure to CI/CD practices (Azure DevOps, Git workflows, build/release pipelines). Understanding of data lake architecture and modern data warehousing principles.

MEC Tech Lead( Lead Data Engineer ) Location Bangalore Must-Have: - Data Lake - Python, SQL - Large Scale Data Platform Management Good to have: - Apache Spark and KAFKA - Business Intellgence - Team Leadership Experience: 10+ Years Domain: eCommerce / Financial Reconciliation Brief JD: We are seeking a seasoned Technical Lead – Data Engineering to lead and operate a large-scale data processing and reconciliation platform for an eCommerce enterprise. The role involves managing real-time data ingestion and batch processing (SQL, Python, PySpark, Hive), and BI reporting pipelines (MySQL, Tableau, ClickView) to support the Finance team in month-end reconciliation and MIS reporting. You will be ...

Define overall AWS architecture for DTA (compute, networking, storage, data plane, messaging, CI/CD). Create ArchiMate deployment/instance diagrams and map infrastructure to logical components. Required Candidate profile Implement IaC (Terraform / AWS CloudFormation / CDK) for repeatable, auditable environments (dev/test/stage/prod). Build automated provisioning pipelines and guardrails.

Greetings from peoplefy ! We are hiring for one of our Product based MNC Client based in Pune location . Requirements : 5+ Years of experience as a Data Engineer SQL ETL Data Warehouse Data Lake & MLOps (Good to have) Work Mode - Hybrid Notice Period - Who can join us in the month of August Education - Any Technical background. Interested Candidates can send Updated CV on deeksha.ka@peoplefy.com

Job Title: Principal Data Engineer, Logistics Employment Type: Full Time Experience: 12+ Years About the Role: We are looking for a Principal Data Engineer to lead the design and delivery of scalable data solutions using Azure Data Factory and Azure Databricks. This is a consulting-focused role that requires strong technical expertise, stakeholder engagement, and architectural thinking. You will work closely with business, functional, and technical teams to define data strategies, design robust pipelines, and ensure smooth delivery in an Agile environment. Responsibilities Collaborate with business and technology stakeholders to gather and understand data needs Translate functional requireme...

Location: Bangalore, Chennai Extract data from source system using Data Factory pipelines Massaging and Cleansing the data Transform data based on business rules Expose the data for reporting needs and exchange data with downstream applications. Standardize the various integration flows (e.g decom ALDML Init integration, simplify ALDML Delta integration).

Responsibilities: Design, develop, and implement robust and scalable data pipelines using Azure Data Bricks, PySpark, and SQL Data Factory to support data ingestion, transformation, and loading processes. Collaborate closely with data scientists, analysts, and other cross-functional teams to gather data requirements and translate them into efficient data solutions. Optimize and fine-tune data pipelines for performance, reliability, and data quality, ensuring smooth and efficient data processing. Monitor, troubleshoot, and resolve any issues or errors in data pipelines ensuring data integrity and availability. Utilize your expertise in data modeling and schema design to ensure data structures...

Overall experience between 10-15 years. Demonstrated considerable experience (minimum 5-7 Years) implementing Data platform/Big data projects on Hyperscalars platform. (Primarily on AWS/Databricks & Google cloud) Extensive working experience on implementing data warehouse, data lake, data mart projects (5-8 years) Strong solution/architect skills in building Data engineering pipelines. (> 5 Years) Hands on experience working in AWS (glue, redshift, s3, athena)/Databricks/Spark (pyspark preferred) /Snowflake/Google cloud (GCS, Big query, dataproc, dataflow, composor). Experience working on Real team data engineering projects Having Data engineering Certifications will be added advantage Good ...

Hiring Data Engineer for our leading Investment Banking Client Location: Bangalore Experience: 2-7 Years Notice Period: Immediate Work Mode: Hybrid (10 days in a month) Interview Mode: 2 levels (1st level virtual discussion - 2nd level - F2F round - Mandatory) Mandatory skills : Master Data engineering fundamentals concepts (Data warehouse, Data Lake, Data Lakehouse) Master Golang, Bash, SQL, Python Master of HTTP and REST API Best practices Master batch and streaming datapipeline using Kafka Master code versioning with Git and best practices for continuous integration & delivery (CI/CD) Master writing clean and tested code following software engineering best practices (Readable, Modular, Re...