999 Data Lake Jobs - Page 4

Primary skill - Google BigQuery Experience:: 8+ Yrs GCP Senior Data Engineer

helps employees unleash their potential while creating value for themselves and the company. Additionally, everyone has individual work and personal needs. We seek to enable the best work environment that helps you and the business work together to produce superior results.

Role & responsibilities Lead design, development, and implementation of digital tools and solutions for the engineering department. Act as the first line of resolution for all digital and software issues.Manage, mentor, and train a team of developers, ensuring productivity and high-quality delivery. Define and execute the product vision, roadmap, and adoption strategy across functions. Collaborate with Engineering, IT, and Business teams to identify opportunities for digitization. Drive innovation by introducing AI/ML, Data Science, analytics, automation, and computer vision solutions.Explore and integrate Open Source APIs/software (e.g., YOLO for computer vision, automation use cases). Over...

Roles and Responsibilities Design and implement data solutions using Data Architecture principles, including Data Models, Data Warehouses, and Data Lakes. Develop cloud-based data pipelines on AWS/GCP platforms to integrate various data sources into a centralized repository. Ensure effective Data Governance through implementation of policies, procedures, and standards for data management. Collaborate with cross-functional teams to identify business requirements and develop technical roadmaps for data engineering projects. Desired Candidate Profile 7-12 years of experience in Solution Architecting with expertise in Data Architecture, Data Modeling, Data Warehousing, Data Integration, Data Lak...

Who We Are At Kyndryl, we design, build, manage and modernize the mission-critical technology systems that the world depends on every day. So why work at Kyndryl? We are always moving forward – always pushing ourselves to go further in our efforts to build a more equitable, inclusive world for our employees, our customers and our communities. The Role 12 – 15 Years of relevant experience on Big Data Platforms / Databricks / Data Fabric. Hands on experience in the area of Data Platforms (DwH / Datalake) like Cloudera / Databricks / MS Data Fabric / Teradata / Apache Hadoop / BigQuery / AWS Big Data Solutions (EMR, Redshift, Kinesis) / Qlik etc. Strong understanding of data modelling and datab...

Why Join Decision Point? Work with a top-tier analytics consulting firm known for data-driven innovation. Get exposure to Fortune 500 clients and real-world impact projects. Be part of a collaborative culture that encourages leadership and learning. Solve complex business problems using cutting-edge tech across domains Key Responsibilities Lead and deliver end-to-end data engineering projects in a fast-paced environment Design and implement scalable data pipelines using PySpark , SQL , and orchestration tools Develop robust data models to support analytics and reporting Optimize data storage and processing on AWS (Glue, S3, Redshift, Lambda) and Azure (ADF, Synapse, Blob Storage) Collaborate...

Role Overview: At 66degrees, you will be responsible for owning the end-to-end design of modern data platforms on Microsoft Azure. You will provide architectural leadership, guide the data engineering team in building secure and scalable data platforms, and deliver raw data into analytics-ready assets. Additionally, you will act as a liaison between business and technology stakeholders to define data strategy, standards, and governance while optimizing cost, performance, and compliance across the Azure ecosystem. Key Responsibilities: - Design and document data architectures on Azure Synapse Analytics, Data Lake Storage Gen2, Microsoft Fabric, and CosmosDB - Lead migration of on-premises wor...

Key Responsibilities Lead and mentor a team of data engineers, providing technical guidance, performance feedback, and career development. Architect, develop, and maintain scalable ETL/ELT pipelines using AWS services , PySpark , SQL , and Python . Drive the design and implementation of robust data models and data warehouses/lakes to support analytics and reporting. Ensure data quality, security, and governance across all stages of the data lifecycle. Collaborate with product and engineering teams to integrate data solutions into production environments. Optimize data workflows and performance across large, complex datasets. Manage stakeholder relationships and translate business needs into ...

remote typeOn-site locationsBengaluru, KA time typeFull time posted onPosted 4 Days Ago job requisition idREQ423419 7+ years of overall experience in building data systems, of which 2+ years minimum in Azure Power BI. Excellent understanding of SQL and ability to write complex SQL queries in a performant way. Excellent understanding of Power BI dataset & dataflows design. Good understanding of row-level security models implemented in reporting solutions. Good understanding of Datawarehouse concepts; experience working with a dimensional model is a plus. Hands-on knowledge in writing structured Databricks code components using PySpark is a plus. Good knowledge of how ETL auditing works in a p...

remote typeOn-site locationsBengaluru, KA time typeFull time posted onPosted 5 Days Ago job requisition idREQ408131 Data Engineer 2 JLL Technologies COE- Bangalore What this job involves About the role #JLLTechAmbitions Azure Data Engineer for implementation of HR Datawarehouse project. Sounds like you? To apply you need to be Experience & Education 4+ years of overall experience in building data systems, of which 2+ years minimum in Azure Databricks. Excellent understanding of SQL and ability to write complex SQL queries in a performant way. Good understanding of Datawarehouse concepts; experience working with a dimensional model is a plus. Excellent hands-on knowledge in writing structured...

About The Role Project Role : Software Development Engineer Project Role Description : Analyze, design, code and test multiple components of application code across one or more clients. Perform maintenance, enhancements and/or development work. Must have skills : BlueYonder Order Management Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :Role Overview:We are looking for an experienced Integration Architect to lead the design and execution of integration strategies for Blue Yonder (BY) implementations across cloud-native environments. The ideal candidate will possess strong expertise in integrating supply c...

Job Title : Snr Data Analyst Reports To Tittle : IT Head Business Function/Sub Function: Information Technology Location: Noida, India Position Overview: The Power BI Developer/Analyst is responsible for designing, developing, and deploying business intelligence reports using Microsoft's Power BI. This role involves working closely with stakeholders to gather requirements, create data models, and provide insights through reports and dashboards. Key Responsibilities: Develop and maintain Power BI reports, dashboards, and visualizations. Translate business needs into technical specifications for BI tools. Collaborate with business analysts, data engineers, and other stakeholders to gather data...

Senior Solution Architect: RoleOverview Experienced Senior Solution Architect Data to lead the design and governance ofenterprise-wide data platforms and analytics solutions. Lead design andoptimisation of the data ecosystem for a large engineering enterprise with adiverse application landscape that includes multiple ERPs (Baan, Oracle, SAP), cloud platforms, and SaaS solutions. Demonstratedtechnical expertise with strong architectural leadership is a must for therole. Key Responsibilities Define and govern the enterprise data architecture, ensuring alignment with business strategy and IT standards. Design end-to-end data solutions across ingestion, storage, modelling, analytics, and governa...

Data Platform Engineer: Key Position Responsibilities Work with the Data Platform team to design, implement, and maintain scalable, secure, and resilient data platform solutions. Deliver solutions that meet requirements within agreed timeframes, ensuring quality and desired outcomes. Develop and manage data platform infrastructure using CI/CD pipelines and automation tools. Support and manage key data platform services, such as data lakes, data warehouses, stream processing, data transformation, data integration, data quality, and analytics tools. Enable consuming teams within Enterprise Data to effectively utilise these services. Collaborate with the Cloud team to ensure alignment with best...

Key Responsibilities Design scalable ETL/ELT data pipelines using Azure Data Factory, Synapse Pipelines, and Databricks. Develop data ingestion workflows for structured and semi-structured data sources, including IoT streams and batch files. Define and enforce data modeling standards for the raw, curated, and semantic layers in ADLS Gen2. Create PySpark jobs and reusable transformation frameworks for cleansing, validation, and enrichment. Oversee data partitioning, versioning, and metadata strategies to ensure high performance and maintainability. Coordinate with ML engineers to support feature engineering pipelines and training datasets. Mentor data engineers, conduct code reviews, and enfo...

The Opportunity Join our team at Nutanix as a Staff Engineer in our Pune office, where you will play a crucial role in providing a solid Nutanix Cloud Manager (NCM) product to our customers. Your mission will be to design and build an observability platform that allows our customers to proactively monitor and manage their infrastructure and applications. By building a reliable NCM data platform and driving the adoption of best practices, you will contribute to the success of our products. This is a unique opportunity to work with cutting-edge technologies, lead and mentor engineers, and be part of a fast-paced environment where autonomy and ownership are valued. The work will range from anal...

Mandatory Skills: Python/ pyspark Azure Data Factory (ADF) Databricks Data Lake Snowflake or SQL Good to have: SQL Alchemy CI\CD, Azure fundamentals , GIT Pydantic Integration of data solutions with CETRM trading Systems(Allegro, RightAngle, Endur)

Skills Required: Familiarity with data processing engines such as Apache Spark, Flink, or other big data tools. Design, develop, and implement robust data lake architectures on cloud platforms (AWS/Azure). Implement streaming and batch data pipelines using Apache Hudi, Apache Hive, and cloud-native services like AWS Glue, Azure Data Lake, etc. Architect and optimize ingestion, compaction, partitioning, and indexing strategies in Apache Hudi. Develop scalable data transformation and ETL frameworks using Python, Spark, and Flink. Work closely with DataOps/DevOps to build CI/CD pipelines and monitoring tools for data lake platforms. Ensure data governance, schema evolution handling, lineage tra...

12+ years of related experience with a Bachelors degree; or 10 years and a Master’s degree; or a PhD with 8 years applied industry experience; or equivalent experience. 10+ years of experience in data and advanced analytics At least 8 years of experience working on data technologies in Azure/AWS Experience building modern products and infrastructure Experience working with .Net/Java and Microservice Architecture Expertise in SQL and Python Expertise in SQL Server, Azure Data Services, and other Microsoft data technologies. Expertise in Databricks, Microsoft Fabric Strong understanding of data modeling, data warehousing, data lakes, data mesh and data products.

About the Role We are seeking a highly skilled and experienced Data Architect to join our team. The ideal candidate will have at least 18 years of experience in Data engineering and Analytics and a proven track record of designing and implementing complex data solutions. As a senior principal data architect, you will be expected to design, create, deploy, and manage Blackbauds data architecture. This role has considerable technical influence within the Data Platform, Data Engineering teams, and the Data Intelligence Center of Excellence at Blackbaud. This individual acts as an evangelist for proper data strategy with other teams at Blackbaud and assists with the technical direction, specific...

Responsibilities This is an individual contributor role that is responsible for the designing and developing of data solutions that are strategic for the business and built on the latest technologies and patterns. This a global role that requires partnering with both the regional IT teams as well as the other global engineering teams. Contribute to the design of information infrastructure, and data management processes to move the organization to a more sophisticated, agile and robust target state data architecture Develop systems that ingest, cleanse and normalize diverse datasets, develop data pipelines from various internal and external sources and build structure for previously unstructu...

Senior data engineers at Thoughtworks are engineers who build, maintain and test the software architecture and infrastructure for managing data applications. They are involved in developing core capabilities which include technical and functional data platforms. They are the anchor for functional streams of work and are accountable for timely delivery. They work on the latest big data tools, frameworks and offerings (data mesh, etc.), while also being involved in enabling credible and collaborative problem solving to execute on a strategy. Job responsibilities You will develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solution...

About the role: We are seeking a highly skilled and experienced Data Architect to join our team. The ideal candidate will have at least 1 2 years of experience in s oftware & data engineering and a nalytics and a proven track record of designing and implementing complex data solutions. Y ou will be expected to design, create, deploy, and manage Blackbauds data architecture. This role has considerable technical influence within the Data Platform, Data Engineering teams, and the Data Intelligence Center of Excellence atBlackbaud. Thisindividual acts as an evangelist for proper data strategy with other teams at Blackbaud and assists with the technical direction, specifically with data, of other...

As a Data Engineering Senior Associate at Microsoft Fabric, Azure (Databricks & ADF), PySpark, you will be responsible for designing and implementing scalable data solutions within the Microsoft Azure ecosystem. With 4-10 years of experience in the field, you will leverage your expertise in Microsoft Fabric, Azure Databricks, PySpark, Python, and SQL to build end-to-end data pipelines, ensuring efficient data processing and extraction. Your primary responsibilities will include gathering requirements, designing and implementing data pipelines using Microsoft Fabric & Databricks, performing ETL operations to extract data into Azure Data Lake Storage, implementing data security measures, monit...

Hello Candidate, Greetings from Hungry Bird IT Consulting Services Pvt Ltd. We are hiring Lead Data Engineer for our client. Job Title: Lead Data Engineer Location: Hyderabad Job Type: Full-Time Experience: 5+ years (2+ years in a leadership role) Role Overview: We are looking for a highly skilled and experienced Lead Data Engineer to oversee the design, development, and management of scalable data infrastructure and pipelines. You will work closely with cross-functional teams, lead a team of engineers, and drive best practices in data engineering using modern cloud and big data technologies like Databricks , AWS , Airflow , and FastAPI . Key Responsibilities: Lead the design, development, a...