59 Lakehouse Architecture Jobs

As an Azure Databricks Engineer at Dhanam Cloud Computing Private Limited, you will play a crucial role in building and maintaining end-to-end data pipelines using ADF, Databricks, or Fabric. Your responsibilities will include ingesting and transforming structured & unstructured data into ADLS / Lakehouse, developing scalable ETL/ELT solutions using PySpark, Python, and SQL, implementing Delta Lake best practices, and optimizing Spark jobs. You will collaborate with Data Science teams to deploy and operationalize ML models, ensuring data governance, security, and quality with tools like Unity Catalog and RBAC. Furthermore, you will be involved in implementing CI/CD pipelines using Git & Azur...

Role Overview We are seeking a highly skilled Senior Databricks AI/ML Engineer to lead the design, development, and deployment of advanced analytics and machine learning solutions. The ideal candidate will bring deep expertise in Databricks, strong hands-on experience in both AI and traditional ML models, and advanced proficiency in SQL and Python. The engineer will work closely with cross-functional teams to build scalable data and ML pipelines, optimize models, and deliver impactful insights for business growth. Key Responsibilities Design, build, and deploy end-to-end AI and traditional ML models using Databricks. Develop scalable ETL/ELT pipelines, feature engineering workflows, and mode...

Who You'll Work With At Nike, we leverage the power of data and technology to serve athletes* around the world. The Data & AI (DAI) team is at the forefront of this missionbuilding scalable, secure, and intelligent platforms that power decision-making and personalized experiences across the Nike ecosystem. Who We Are Looking For We are looking for a skilled software engineer with a passion for building and maintaining data platforms. You thrive in a collaborative environment and have a proven track record of delivering reliable software. Skillset Required 3+ years of experience in software development, with a strong foundation in distributed systems and data platforms. Deep expertise with cl...

Company Overview Computomic was founded in 2019 with a vision to design and deploy mission critical and highly differentiated Data & AI solutions for companies looking to migrate their data stack from legacy platforms such as Teradata, Cloudera, DataStage and Informatica, to modern platforms like Databricks. Over the last few years, we have become one of the fastest growing partners for Databricks, building a strong and mature practice, and delivering large-scale Databricks migration and transformation projects for some of the world's leading companies. Our consulting services and tooling help customers realize value from their data by modernizing their data stack, and we deploy accelerators...

As a Data Architect specializing in Azure with over 12 years of experience, including 4+ years in Azure data services, you will be responsible for leading the design and delivery of enterprise-scale data solutions on Microsoft Azure. Your expertise in cloud data architecture, data engineering, and governance will be crucial in building robust, secure, and scalable platforms. **Key Skills We're Looking For:** - Proficiency in Azure Data Factory, Synapse, Databricks, and Blob Storage - Strong background in Data Modeling & Lakehouse Architecture - Experience with SQL, Python, and Spark - Knowledge of Data Governance, Security, and Metadata Management - Familiarity with CI/CD, Infra as Code (ARM...

As a Senior Data Engineer at Mindcurv, you will play a crucial role in designing and implementing scalable data solutions for our clients. You will be part of our dynamic Data and Analytics team, collaborating with cross-functional teams to ensure the organization leverages data as a strategic asset. Your responsibilities will include: - Designing, building, and maintaining scalable data pipelines and ETL processes using Databricks and other modern tools. - Architecting, implementing, and managing cloud-based data warehousing solutions on Databricks (Lakehouse Architecture). - Developing and maintaining optimized data lake architectures to support advanced analytics and machine learning use ...

Role Overview: You will be responsible for utilizing your 5+ years of experience in Data Modeling, particularly Dimensional modeling, to support industrial data initiatives at EZData Advisory. Your key role will involve designing scalable data models, collaborating with cross-functional teams, and driving data architecture best practices across CCEP domains. Key Responsibilities: - Participate in Requirement workshops/ Backlog refinement workshop to understand data requirements for the project. - Build and maintain conceptual, logical, and physical data models using industry-standard tools (e.g., ER/Studio, Erwin). - Collaborate closely with Data Analysts, Data Stewards, and the Data Governa...

Company Description EZData Advisory is a consultancy specializing in data engineering and analytics, offering modern solutions tailored for diverse industries. The company provides certified data experts to ensure reliable and prompt project delivery without ramp-up time. Our services include aligning data strategies with long-term organizational goals, ensuring secure, scalable, and insight-driven outcomes. Additionally, EZData delivers custom pre-built data solutions designed to save time and fit seamlessly with your unique tech stack. Throughout every project, we prioritize efficiency, transparency, and measurable results. Role Description Experience: 3-5 Location: Remote (preferable Pune...

Responsibilities Develop, optimize, and maintain scalable data pipelines using Databricks (PySpark/SQL). Collaborate with data scientists to build, train, and deploy machine learning models for use cases such as recommendation engines and time series forecasting. Work with large datasets to prepare and process structured and unstructured data for analytics and ML. Implement and maintain CI/CD pipelines for model deployment and versioning. Collaborate with cross-functional teams to gather requirements and deliver data-driven solutions. Optimize query performance and manage data storage efficiently on the Lakehouse architecture. Qualifications Bachelor of Engineering / B. Tech/B Sc. 2-4 years ...

As a Strong Dremio / Lakehouse Data Architect, you will have the following responsibilities: - Deep experience with cloud object storage (S3 / ADLS / GCS) and file formats such as Parquet, Delta, Iceberg along with distributed query planning concepts. - Hands-on experience integrating data via APIs, JDBC, Delta/Parquet, object storage, and coordinating with data engineering pipelines (Airflow, DBT, Kafka, Spark, etc.). - Proven experience designing and implementing lakehouse architecture including ingestion, curation, semantic modeling, reflections/caching optimization, and enabling governed analytics. - Strong understanding of data governance, lineage, RBAC-based access control, and enterpr...

NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Sr.Database Engineer Database to join our team in Bangalore, Karn?taka (IN-KA), India (IN). Job Responsibilities: Configuration, maintenance and monitoring of PostgreSQL , Cosmos and similar databases in cloud preferably azure cloud . Administer and manage Databricks workspaces, clusters, notebooks, jobs, and user access. Perform performance tuning, query optimization, and resource monitoring across Databricks and SQL databases. Develop and enforce standards for databas...

NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Sr.Database Engineer Database to join our team in Bangalore, Karn?taka (IN-KA), India (IN). Job Responsibilities: . Configuration, maintenance and monitoring of PostgreSQL , Cosmos and similar databases in cloud preferably azure cloud . . Administer and manage Databricks workspaces, clusters, notebooks, jobs, and user access. . Perform performance tuning, query optimization, and resource monitoring across Databricks and SQL databases. . Develop and enforce standards for...

Job Application Link: https://app.fabrichq.ai/jobs/7651f5ee-7067-41e8-9b00-177569e3ad98 Job Summary: We are looking for an accomplished Principal Data Architect to lead the design and implementation of cloud-native, scalable, and intelligent data platforms. The ideal candidate will have deep hands-on experience across Azure, AWS, and GCP, with proven expertise in Databricks and AI/ML integration. This is a client-facing leadership role that demands both technical excellence and strategic communication skills. Key Responsibilities Design and implement modern data architectures using Databricks, Azure, AWS, or GCP. Lead data lakehouse, AI/ML pipeline, and analytics platform development end to ...

As a Data Engineer at Omnissa, you will be responsible for delivering in an individual contributor role. Your key responsibilities will include: - Minimum 2 to 8 years of experience with Data Engineering on AWS. - Strong Proficiency in SQL, Python, Apache Spark, AWS Data Stack (S3, EMR, Glue Catalog, Athena, Lambda, Airflow), Starburst / Trino. - Solid Understanding of Lakehouse Architecture - Apache Iceberg / Delta Lake. - Experience with CI/CD practices using GitHub Actions. - Ability to collaborate in cross-functional teams and communicate technical concepts clearly. - Mindset to design solutions for scale, proactively involve in additional areas and domains. - Experience with Tableau or ...

We are seeking a skilled and proactive Data Platform Administrator to manage, monitor, and optimize our cloud data platform environment. The ideal candidate will have hands-on experience with cloud-based data platforms, strong knowledge of Spark, big data or related technologies, and a passion for enabling data teams to work efficiently and securely. Key Responsibilities- Platform Administration Handle and maintain workspaces, clusters, pools, and jobs in Databricks or other big data systems. Monitor performance, usage, and costs; optimize cluster configurations. Security & Compliance Configure role-based access control (RBAC), and audit logging. Ensure compliance with data governance and se...

Inviting applications for the role of Lead Consultant- Databricks Developer ! In this role, the Databricks Developer is responsible for solving the real world cutting edge problem to meet both functional and non-functional requirements. Responsibilities Design and develop scalable data pipelines using Databricks ( PySpark /SQL/Delta Live Tables). Implement ETL/ELT frameworks leveraging the Lakehouse (Bronze, Silver, Gold) architecture. Implement and manage data governance using Unity Catalog to ensure secure access, compliance, and centralized management of data, users, and permissions across the Databricks Lakehouse. Optimize data models, queries, and workflows for scalability, cost, and pe...

Introduction A career in IBM Consulting is rooted by long-term relationships and close collaboration with clients across the globe. You'll work with visionaries across multiple industries to improve the hybrid cloud and AI journey for the most innovative and valuable companies in the world. Your ability to accelerate impact and make meaningful change for your clients is enabled by our strategic partner ecosystem and our robust technology platforms across the IBM portfolio Your Role And Responsibilities As a Software Developer you'll participate in many aspects of the software development lifecycle, such as design, code implementation,. You will work towards delivering specific milestones and...

: Job Title: Senior Databricks Architect / Lead Databricks Engineer Experience: 10+ Years (Minimum 4+ Years in Databricks) Locations: Chennai | Bangalore | Pune | Hyderabad Work Mode: Hybrid 3 Days from Office Job Overview We are looking for a highly experienced Databricks Architect with 10+ years of IT experience and at least 4 years of deep, hands-on Databricks expertise. The candidate will lead the design and delivery of scalable, secure, and cost-optimized data platforms on the Databricks Lakehouse ecosystem. This role requires strong architectural ownership, technical leadership, and the ability to guide engineering teams. Key Responsibilities Lead end-to-end Databricks architecture : i...

Essential Skills & Experience:Experience Level: 10 + years experience inData Engineering development with end-to-end Data Platform implementation using AWS tech stack. Mandatory Skills:- Excellent understanding and design experience of Big Data platform, Data Lake, Lakehouse architecture, Medallion architecture and modern data architecture.- Excellent in SQL/PL-SQL scripting in columnar database- Excellent Data Modelling experience- Strong skills in Redshift, SQL, PL-SQL, Glue, PySpark, Spark, S3, Shell scripting- Strong skills in Airflow, Kinesis, Step function and related ETL-DW data services- Develop, enhance & optimize data pipelines using AWS service, custom ETL tools and automating dat...

Role Overview: As an AI/ML Data Scientist specializing in Supply Chain Analytics at Sonata Software, your main role will be to design, develop, and deploy AI/ML models to address complex business challenges within the Supply Chain domain. You will work closely with data engineers and architects to create robust data pipelines and models aligned with Fabric and Lakehouse architecture. Your responsibilities will include leading model training, validation, deployment, and monitoring through MLOps frameworks to ensure scalability and sustainability. Collaboration with stakeholders to translate business requirements into actionable data science solutions, performing data wrangling, feature engine...

As a Data Engineer at Rambus, you will be a crucial part of the Information Architecture & BI Engineering team in Bangalore. Your role involves designing and implementing enterprise data models optimized for both BI and AI workloads. You will report directly to the Technical Director, IT, and contribute significantly to the team's goal of enabling data and AI-driven decision-making. **Responsibilities:** - **Data Modeling & Architecture** - Design and maintain scalable data models for BI and AI workloads. - Implement semantic layers and data Lakehouse structures for cross-domain analytics. - Maintain data dictionaries and documentation for easy data access. - **Pipeline Development** - Build...

Experience Required: 7+ Years Work Location: Bangalore / Chennai / Hyderabad Role Overview: We are seeking an experienced Databricks Administrator to manage, optimize, and maintain our Databricks platform across multiple environments. The ideal candidate will have a strong background in data engineering infrastructure, cluster management, security, governance, and automation within Databricks and related Azure/AWS ecosystems. Key Responsibilities: Databricks Platform Administration: Manage and maintain Databricks workspaces, clusters, jobs, pools, and libraries. Monitor performance and optimize resource utilization across environments (dev, test, prod). Implement autoscaling, cluster policie...

We are looking majorly forAI/ML skills with Databricksfor ourData Scienceprojects. Proven hands-on experience inAI/MLconcepts with a strong track record of delivering data science projects into production environments. (Must-have) Proficiencyin Pythonprogramming, with the ability to write clean, efficient, and maintainable code. (Must have) Understanding of the Lakehouse architecture and its practical applications in modern data platforms. (Good to have) Hands-on experience with Databricks will be a plus , including notebooks, MLflow, Delta Lake, and job orchestration. (Giood to have) Ability to rapidly prototype solutions and iterate toward production-grade implementations using sound engin...

Azure Data Architect (Microsoft Fabric) - JD Overall 10+ years of IT experience Understand the data requirements, source data land scape of the project and architect the solution. Ability to understand the data requirements and come up with the proposed solution components. Hands on experience in designing cost-efficient, fault tolerant and scalable distributed systems on Azure. Understand the data processing requirements like batch computing, stream computing needs and design the solution on Azure technical stack. Design Data Lake, Data Warehouse, experience with Data Modelling Estimate the sizing of the data solution components based on key volumetric statistics. Develop architecture bluep...

Job Description Azure Fabric Good to have skills Azure Synapse, Databricks, or Power BI Service. Knowledge of CI/CD pipelines using Azure DevOps or GitHub. Summary Skilled in design, implementation, and managing data solutions using the Microsoft Fabric platform, integrating data engineering, data science, real-time analytics, and business intelligence capabilities within a single SaaS experience. Should have a strong foundation in data modeling, data pipeline creation, and visualization using Power BI, with hands-on expertise in OneLake, Lakehouses, Dataflows Gen2, and Notebooks. Key Responsibilities Design and build modern data solutions using Microsoft Fabric components: Lakehouse, Data W...