318 Delta Lake Jobs - Page 13

Databricks Technical Leadership: Guide and mentor teams in designing and implementing Databricks solutions. Architecture & Design: Develop scalable data pipelines and architectures using Databricks Lakehouse. Data Engineering: Lead the ingestion and transformation of batch and streaming data. Performance Optimization: Ensure efficient resource utilization and troubleshoot performance bottlenecks. Security & Compliance: Implement best practices for data governance, access control, and compliance. Collaboration: Work closely with data engineers, analysts, and business stakeholders. Cloud Integration: Manage Databricks environments on Azure, AWS, or GCP. Monitoring & Automation: Set up monitori...

Description: We are seeking a Data Engineer with 3-5 year of experience to join our Data Platform team. This role will report to the Manager of data engineering and be involved in the planning, design, and implementation of our centralized data warehouse solution for ETL, reporting and analytics across all applications within the company. Qualifications: Deep knowledge and experience working with Python/Scala and Spark Experienced in Azure data factory, Azure Data bricks, Azure Blob Storage, Azure Data Lake, Delta lake. Experience working on Unity Catalog, Apache Parquet Experience with Azure cloud environments Experience with acquiring and preparing data from primary and secondary disparate...

This role focuses on building efficient, scalable SQL-based data models and pipelines using Data bricks SQL, Spark SQL, and Delta Lake. The ideal candidate will play a key role in transforming raw data into valuable analytical insights.

Job Title: Data Architect Location: Noida (Sec-132) Job Description: 1. Strong experience in Azure - Azure Data Factory, Azure Data Lake, Azure Data bricks 2. Good at Cosmos DB, Azure SQL data warehouse/synapse 3. Excellent in data ingestion (Batch and real-time processing) 4. Good understanding of synapse workspace and synapse analytics 5. Good hands-on experience on Pyspark or Scala spark 6. Good hands-on experience on Delta Lake and Spark streaming 7. Good Understanding of Azure DevOps and Azure Infrastructure concepts 8. Have at least one project end-to-end hands-on implementation experience as an architect 9. Expert and persuasive communication skills (verbal and written) 10. Expert in ...

Role :- Resident Solution ArchitectLocation: RemoteThe Solution Architect at Koantek builds secure, highly scalable big data solutions to achieve tangible, data-driven outcomes all the while keeping simplicity and operational effectiveness in mind This role collaborates with teammates, product teams, and cross-functional project teams to lead the adoption and integration of the Databricks Lakehouse Platform into the enterprise ecosystem and AWS/Azure/GCP architecture This role is responsible for implementing securely architected big data solutions that are operationally reliable, performant, and deliver on strategic initiatives Specific requirements for the role include: Expert-level knowled...

Data Engineer Location - Bangalore We are looking for a skilled and motivated Data Engineer II to join our growing data team. In this role, you will design, build, and maintain scalable data pipelines and infrastructure to support data-driven decision making across the organization. You will work closely with data scientists, analysts, and other engineers to ensure the availability, reliability, and performance of our data systems. The ideal candidate has a strong foundation in data engineering principles, hands-on experience with modern data technologies, and a passion for solving complex data challenges. Key Responsibilities Work with Product Owners and various stakeholders throughout the ...

Job Summary We are looking for a Data Modeler to design and optimize data models supporting automotive industry analytics and reporting. The ideal candidate will work with SAP ECC as a primary data source, leveraging Databricks and Azure Cloud to design scalable and efficient data architectures. This role involves developing logical and physical data models, ensuring data consistency, and collaborating with data engineers, business analysts, and domain experts to enable high-quality analytics solutions. Key Responsibilities: 1. Data Modeling & Architecture: Design and maintain conceptual, logical, and physical data models for structured and unstructured data. 2. SAP ECC Data Integration: Def...

Warm welcome from SP Staffing Services! Reaching out to you regarding permanent opportunity !! Job Description: Exp: 8-14 yrs Location: Hyderabad/Chennai/Kolkata/Delhi Skill: Databricks Architect Must have experience on databricks which consists of Delta lake, Unity Catalog, Databricks workflows orchestration, Security management, Platform governance, Data Security. Must have knowledge of new features available in Databricks and its implications along with various possible use-case . Must have followed various architectural principles to design best suited per problem. Must be well versed with Databricks Lakehouse concept and its implementation in enterprise environments. Must have strong un...

Warm welcome from SP Staffing Services! Reaching out to you regarding permanent opportunity !! Job Description: Exp: 8-14 yrs Location: Hyderabad/Chennai/Kolkata/Delhi Skill: Databricks Architect Must have experience on databricks which consists of Delta lake, Unity Catalog, Databricks workflows orchestration, Security management, Platform governance, Data Security. Must have knowledge of new features available in Databricks and its implications along with various possible use-case . Must have followed various architectural principles to design best suited per problem. Must be well versed with Databricks Lakehouse concept and its implementation in enterprise environments. Must have strong un...

Warm Greetings from SP Staffing Services Private Limited!! We have an urgent opening with our CMMI Level 5 client for the below position. Please send your update profile if you are interested. Relevant Experience: 8 Yrs - 18 Yrs Location- Pan India Job Description : - Experience in Synapase with pyspark Knowledge of Big Data pipelinesData Engineering Working Knowledge on MSBI stack on Azure Working Knowledge on Azure Data factory Azure Data Lake and Azure Data lake storage Handson in Visualization like PowerBI Implement endend data pipelines using cosmosAzure Data factory Should have good analytical thinking and Problem solving Good communication and coordination skills Able to work as Indiv...

Warm Greetings from SP Staffing Services Private Limited!! We have an urgent opening with our CMMI Level 5 client for the below position. Please send your update profile if you are interested. Relevant Experience: 8 Yrs - 18 Yrs Location- Pan India Job Description : - Mandatory Skill: Azure ADB with Azure Data Lake Lead the architecture design and implementation of advanced analytics solutions using Azure Databricks Fabric The ideal candidate will have a deep understanding of big data technologies data engineering and cloud computing with a strong focus on Azure Databricks along with Strong SQL Work closely with business stakeholders and other IT teams to understand requirements and deliver ...

Job Title: Databricks Data Modeler Job Summary We are looking for a Data Modeler to design and optimize data models supporting automotive industry analytics and reporting. The ideal candidate will work with SAP ECC as a primary data source, leveraging Databricks and Azure Cloud to design scalable and efficient data architectures. This role involves developing logical and physical data models, ensuring data consistency, and collaborating with data engineers, business analysts, and domain experts to enable high-quality analytics solutions. Key Responsibilities 1. Data Modeling & Architecture: Design and maintain conceptual, logical, and physical data models for structured and unstructured data...

We are seeking a results-driven Data Project Manager (PM) to lead data initiatives leveraging Databricks and Confluent Kafka in a regulated banking environment. The ideal candidate will have a strong background in data platforms, project governance, and financial services, and will be responsible for ensuring successful end-to-end delivery of complex data transformation initiatives aligned with business and regulatory requirements. Key Responsibilities: Lead planning, execution, and delivery of enterprise data projects using Databricks and Confluent. Develop detailed project plans, delivery roadmaps, and work breakdown structures. Ensure resource allocation, budgeting, and adherence to timel...

Job description Total- 7+ Years Relevant - 4+ Years Location - Hyderabad , Any Location over India Role & responsibilities 5+ years of experience on IT industry in Data Engineering & Data Analyst role. 5 years of development experience using tool Databricks and PySpark, Delta lake, Python, SQL Proficient in writing SQL queries including writing of windows functions Good communication skills with analytical abilities in doing problem solving activities. Preferred candidate profile Mandotory Skills: Databricks and PySpark, Delta lake, Python, SQL If you feel JD suits your profile kindly share me your update CV for below email id -Kavyacn@radiants.com

We are seeking a talented individual to join our Oliver Wyman team at Marsh McLennan. This role will be based in Pune/Gurgaon. This is a hybrid role that has a requirement of working at least three days a week in the office. Senior Manager Data Engineering The OWG Technology department is seeking a highly skilled and motivated Senior Data Engineer to play a critical role in our data transformation program. In this position, you will lead major projects and workstreams, collaborating closely with stakeholders to ensure the successful implementation of data solutions. You will also mentor and coach junior team members, providing guidance during sprints as a technical lead. Your expertise in cl...

Ready to build the future with AI? At Genpact, we don't just keep up with technology we set the pace. AI and digital innovation are redefining industries, and were leading the charge. Genpacts AI Gigafactory , our industry-first accelerator, is an example of how were scaling advanced technology solutions to help global enterprises work smarter, grow faster, and transform at scale. From large-scale models to agentic AI , our breakthrough solutions tackle companies most complex challenges. If you thrive in a fast-moving, innovation-driven environment, love building and deploying cutting-edge AI solutions, and want to push the boundaries of whats possible, this is your moment. Genpact (NYSE: G)...

Core Responsibilities Seasoned Databricks developer having 6+ years of experience is expected to design, build, and maintain scalable data pipelines and workflows using Azure Databricks. This includes: Developing ETL pipelines using Python, SQL, and Delta Live Tables Managing job execution through Databricks Jobs, including scheduling and parameterisation Implementing data transformation using built-in Databricks features Collaborating with data architects and analysts to ensure data models align with business needs Implementing security and governance using features like encryption, access control and data lineage tracking Data performance management using built-in Databricks features (i.e....

Reference Code: HR1175440031573725 Designation: Data Engineer Azure & Databricks Job Description for Data Engineer Azure & Databricks Location: Bengaluru [Hybrid] Experience Required: 4 to 6 years Employment Type: Full-time Department: Data Engineering / Analytics (*Note: This is a requirement for one of Uplers Clients) About the Client: Our client is building scalable data platforms leveraging modern cloud-native and open-source technologies to drive decision intelligence across the organization. Our data lake is designed on the Microsoft Medallion Architecture, powered by Databricks and Azure-native services. We are looking for a passionate Data Engineer to join our team and help in expand...