26 Lakehouse Architecture Jobs

Job Description We are Omnissa! The world is evolving fast, and organizations everywherefrom corporations to schoolsare under immense pressure to provide flexible, work-from-anywhere solutions. They need IT infrastructure that empowers employees and customers to access applications from any device, on any cloud, all while maintaining top-tier security. That's where Omnissa comes in. The Omnissa Platform is the first AI-driven digital work platform that enables smart, seamless and secure work experiences from anywhere. It uniquely integrates multiple industry-leading solutions including Unified Endpoint Management, Virtual Apps and Desktops, Digital Employee Experience, and Security & Complia...

As a Senior Data Engineer at Persistent Ltd., you will be responsible for designing and developing scalable data pipelines using Azure Databricks, PySpark, and Delta Lake. Your key responsibilities will include: - Implementing and optimizing data warehousing solutions using Snowflake. - Integrating AI capabilities into data workflows using tools like ChatGPT, Copilot, Databricks AI Functions, or Snowflake Copilot. - Collaborating with data scientists and analysts to enable AI-powered insights, including summarization, classification, and sentiment analysis. - Building and maintaining ETL/ELT workflows to ensure data quality, performance, and governance. - Working with stakeholders to underst...

Role Overview: As an Azure Fabric developer, you will be skilled in designing, implementing, and managing data solutions using the Microsoft Fabric platform. Your role will involve integrating data engineering, data science, real-time analytics, and business intelligence capabilities within a single SaaS experience. You should have a strong foundation in data modeling, data pipeline creation, and visualization using Power BI, with hands-on expertise in OneLake, Lakehouses, Dataflows Gen2, and Notebooks. Key Responsibilities: - Design and build modern data solutions using Microsoft Fabric components such as Lakehouse, Data Warehouse, Data Pipelines, Notebooks, and Power BI. - Ingest and trans...

Must have skills: Hands-on experience with Databricks platform, including Delta Lake/ Lakehouse architecture Person should be familiar with Python / Pyspark code (not needed a developer) Knowledge of data structures, data modeling, ETL/ELT, and data warehousing. SQL basic in data querying and troubleshooting / manipulation. Key asks for the role: We need a candidate who can drive high-level design and solutioning based on established patterns. The person will collaborate closely with Solution Architect team. At this level, the candidate will not be working as a full-time developer but should be familiar with Python code and able to perform code reviews, debugging, and mentoring of junior dev...

We are seeking a skilled Microsoft Fabric Expert to design, develop, and manage enterprise-scale data engineering, analytics, and integration solutions within Microsoft Fabric. This role will focus on building data pipelines and analytics models that seamlessly integrate Anaplan planning systems and SAP S/4HANA ERP to enable automated reporting, advanced analytics, and connected planning across the organization. Key Responsibilities: Data Engineering & Architecture Design, implement, and maintain data pipelines, lakehouses, and semantic models within Microsoft Fabric (Data Engineering, Data Factory, Power BI, OneLake). Develop dataflows to ingest, clean, and transform data from SAP S/4HANA (...

Key Responsibilities: Design, implement, and maintain Lakehouse architecture , including data lake setup and management Create, document, and maintain data products that serve business intelligence and operational needs Develop and enforce data governance frameworks , including ownership of a data catalog and related policies Design data models that support scalable and high-performance data systems Establish and promote database development standards and best practices Build and automate data workflows using Python , including development of CI/CD pipelines and unit tests Collaborate with cross-functional teams to ensure data systems support organizational goals Stay current with emerging d...

At Seco, we're shaping the future of manufacturing with data, AI, and automation. We're now looking for an AI & Data Solution Architect a key role that combines strategic architectural leadership with hands-on development. If you're passionate about building scalable, cloud-native data and AI solutions and want to see your work make an impact across an organization, this is the role for you. About The Job In this position, you architect and lead the development of end-to-end data and AI solutions that align with business goals and technical strategy. You experiment with and evaluate ML and GenAI models, while ensuring that all componentsfrom feature engineering and training pipelines to depl...

Who You'll Work With At Nike, we leverage the power of data and technology to serve athletes* around the world. The Data & AI (DAI) team is at the forefront of this missionbuilding scalable, secure, and intelligent platforms that power decision-making and personalized experiences across the Nike ecosystem. Who We Are Looking For We are looking for a skilled software engineer with a passion for building and maintaining data platforms. You thrive in a collaborative environment and have a proven track record of delivering reliable software. Skillset Required 3+ years of experience in software development, with a strong foundation in distributed systems and data platforms. Deep expertise with cl...

Tomorrow is our home. Start at BSH Home Appliances Group if you believe in delivering quality: As a leading manufacturer of home appliances and solutions, we can rely on our employees who do their best. With our global brands Bosch, Siemens, Gaggenau and Neff as well as our local brands, we fully trust in their excellent work. In return, they know we will give them the chance to extend their skills and grow. Join us now and give your career a home. BSH Household Appliances Manufacturing Private Limited | Full time | Data Architect - Data Engineering, Power BI, Cloud (AWS) Bangalore Your responsibilities Design scalable data architectures for the Data Management and Engineering areas using cl...

As a Data Engineer at Omnissa, you will play a crucial role in delivering as an individual contributor. You should have a minimum of 2 to 8 years of experience in Data Engineering on AWS. Your responsibilities will include: - Strong Proficiency in SQL, Python, Apache Spark, AWS Data Stack (S3, EMR, Glue Catalog, Athena, Lambda, Airflow), Starburst / Trino. - Solid Understanding of Lakehouse Architecture - Apache Iceberg / Delta Lake. - Experience with CI/CD practices using GitHub Actions. - Ability to collaborate in cross-functional teams and communicate technical concepts clearly. - Mindset to design solutions for scale, proactively involve in additional areas and domains. - Experience with...

Inviting applications for the role of Lead Consultant- Databricks Developer ! In this role, the Databricks Developer is responsible for solving the real world cutting edge problem to meet both functional and non-functional requirements. Responsibilities Design and develop scalable data pipelines using Databricks ( PySpark /SQL/Delta Live Tables). Implement ETL/ELT frameworks leveraging the Lakehouse (Bronze, Silver, Gold) architecture. Implement and manage data governance using Unity Catalog to ensure secure access, compliance, and centralized management of data, users, and permissions across the Databricks Lakehouse. Optimize data models, queries, and workflows for scalability, cost, and pe...

Inviting applications for the role of Lead Consultant- Databricks Developer ! In this role, the Databricks Developer is responsible for solving the real world cutting edge problem to meet both functional and non-functional requirements. Responsibilities Design and develop scalable data pipelines using Databricks ( PySpark /SQL/Delta Live Tables). Implement ETL/ELT frameworks leveraging the Lakehouse (Bronze, Silver, Gold) architecture. Implement and manage data governance using Unity Catalog to ensure secure access, compliance, and centralized management of data, users, and permissions across the Databricks Lakehouse. Optimize data models, queries, and workflows for scalability, cost, and pe...

8 yrs. in software development background, with major experience in intense: Business requirements analysis and data modelling Data querying, particularly with SQL query engines Big data analytics data processing, data lake / lakehouse architecture Required Candidate profile Hands-on experience of Big Data opensource technologies : Apache Kafka Apache Pekko Apache Spark & Spark Structured Streaming Delta Lake or Apache Iceberg AWS Athena, Trino MongoDB AWS S3, MinIO S3

Inviting applications for the role of Lead Consultant- Databricks Developer ! In this role, the Databricks Developer is responsible for solving the real world cutting edge problem to meet both functional and non-functional requirements. Responsibilities Design and develop scalable data pipelines using Databricks ( PySpark /SQL/Delta Live Tables). Implement ETL/ELT frameworks leveraging the Lakehouse (Bronze, Silver, Gold) architecture. Implement and manage data governance using Unity Catalog to ensure secure access, compliance, and centralized management of data, users, and permissions across the Databricks Lakehouse. Optimize data models, queries, and workflows for scalability, cost, and pe...

You are looking for a skilled and experienced Microsoft Fabric Engineer to join the data engineering team. Your main responsibilities will include designing, developing, and maintaining data solutions using Microsoft Fabric. This will involve working across key workloads such as Data Engineering, Data Factory, Data Science, Real-Time Analytics, and Power BI. In this role, you will need to have a deep understanding of Synapse Data Warehouse, OneLake, Notebooks, Lakehouse architecture, and Power BI integration within the Microsoft ecosystem. Some of your key responsibilities will include designing and implementing scalable and secure data solutions, building and maintaining Data Pipelines usin...

Key Result Areas and Activities: Design and implement Lakehouse architectures using Databricks, Delta Lake, and Apache Spark. Lead the development of data pipelines, ETL/ELT processes, and data integration strategies. Collaborate with business and technical teams to define data architecture standards, governance, and security models. Optimize performance and cost-efficiency of Databricks clusters and jobs. Provide technical leadership and mentorship to data engineers and developers. Integrate Databricks with cloud platforms (Azure, AWS, or GCP) and enterprise systems. Evaluate and recommend tools and technologies to enhance the data ecosystem. Ensure compliance with data privacy and regulato...

Who We Are Boston Consulting Group partners with leaders in business and society to tackle their most important challenges and capture their greatest opportunities. BCG was the pioneer in business strategy when it was founded in 1963. Today, we help clients with total transformation-inspiring complex change, enabling organizations to grow, building competitive advantage, and driving bottom-line impact. To succeed, organizations must blend digital and human capabilities. Our diverse, global teams bring deep industry and functional expertise and a range of perspectives to spark change. BCG delivers solutions through leading-edge management consulting along with technology and design, corporate...

We are looking for a Data Architect with a minimum of 12 years of experience, including at least 4 years in Azure data services. As a Data Architect, you will be responsible for leading the design and implementation of large-scale data solutions on Microsoft Azure. Your role will involve leveraging your expertise in cloud data architecture, data engineering, and governance to create robust, secure, and scalable platforms. Key Skills: - Proficiency in Azure Data Factory, Synapse, Databricks, and Blob Storage - Strong background in Data Modeling and Lakehouse Architecture - Experience with SQL, Python, and Spark - Knowledge of Data Governance, Security, and Metadata Management - Familiarity wi...

Job description Some careers shine brighter than others. If you're looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further. HSBC is one of the largest banking and financial services organisations in the world, with operations in 64 countries and territories. We aim to be where the growth is, enabling businesses to thrive and economies to prosper, and, ultimately, helping people to fulfil their hopes and realise their ambitions. We are currently seeking an experienced professional to...

You are a skilled Data Engineer with expertise in the Azure Data Platform, specifically Azure Databricks, PySpark, Azure Data Factory, and Synapse Analytics. Your primary responsibility will be to design, develop, and optimize large-scale data pipelines and analytics solutions. Your key responsibilities will include developing and optimizing data pipelines using Azure Data Factory for ingestion into Azure Databricks, implementing PySpark transformations in Databricks with a focus on performance tuning, building and maintaining data layers, and ensuring efficient export strategies for reporting and analytics. You will also work with Azure Synapse for advanced querying, transformations, and re...

Job Requirements Job Requirements Role/ Job Title: Data Engineer Function/ Department: Data & Analytics Job Purpose The Data Engineer is responsible for developing day to day data engineering projects and aiding in building the business data collection systems and processing pipelines. Responsible for efficient code for building and maintaining optimized and highly available data pipelines that facilitate deeper analysis and reporting by the Data and Analytics department. He/She works with Data and Analytics teams in leveraging data with reporting and scientific tools, for example, Tableau, Python, and Spark. The Data Engineer strives to continuously develop most efficient code for data pipe...

LSEG (London Stock Exchange Group) is a prominent provider of financial markets infrastructure worldwide, offering financial data, analytics, news, and index products to a vast customer base spanning over 170 countries. Committed to excellence, we collaborate with our customers throughout the trade lifecycle to assist them in making informed decisions, executing trades, raising capital, and optimizing their operations. With a rich history of over three centuries, cutting-edge technologies, and a global team of 25,000 professionals across 60 countries, we are dedicated to promoting financial stability, driving economic empowerment, and fostering sustainable growth. In the role of Group Direct...

You should have 9+ years of experience and be located in Chennai. You must possess in-depth knowledge of Python and have good experience in creating APIs using FastAPI. It is essential to have exposure to data libraries like Pandas, DataFrame, NumPy etc., as well as knowledge in Apache open-source components. Experience with Apache Spark, Lakehouse architecture, and Open table formats is required. You should also have knowledge in automated unit testing, preferably using PyTest, and exposure in distributed computing. Experience working in a Linux environment is necessary, and working knowledge in Kubernetes would be an added advantage. Basic exposure to ML and MLOps would also be advantageou...

As an ideal candidate for this role, you should possess in-depth knowledge of Python and have good experience in creating APIs using FastAPI. You should also have exposure to data libraries like Pandas, DataFrame, NumPy, as well as knowledge in Apache open-source components and Apache Spark. Familiarity with Lakehouse architecture and Open table formats is also desirable. Additionally, you should be well-versed in automated unit testing, preferably using PyTest, and have exposure to distributed computing. Experience working in a Linux environment is a must, while working knowledge in Kubernetes would be considered an added advantage. Basic exposure to ML and MLOps would also be advantageous ...

Seeking a Principal Data Engineer with the following skills, an excellent opportunity for top-tier coding experts . Experience with building and maintaining a Lakehouse architecture . Advanced expertise in Python and SQL. Expert in leveraging cloud-based data platform ( Snowflake , Databricks ) capabilities to create an enterprise lake house. Advanced expertise with AWS ecosystem Experience using spark for data ingestion/ processing Key Responsibilities Design, develop and maintain scalable data pipelines and architectures to support data ingestion, integration and analytics. Be accountable for technical delivery and take ownership of solutions. Lead a team of senior and junior developers pr...