601 Delta Lake Jobs - Page 15

When 5% of Indian households shop with us, it's important to build data-backed, resilient systems to manage millions of orders every day. We've done this - with zero downtime! ???? Sounds impossible Well, that's the kind of Engineering muscle that has helped Meesho become the e-commerce giant that it is today. We value speed over perfection, and see failures as opportunities to become better. We've taken steps to inculcate a strong Founder's Mindset across our engineering teams, making us grow and move fast. We place special emphasis on the continuous growth of each team member - and we do this with regular 1-1s and open communication. Tech Culture We have a unique tech culture where enginee...

Flexera saves customers billions of dollars in wasted technology spend. A pioneer in Hybrid ITAM and FinOps, Flexera provides award-winning, data-oriented SaaS solutions for technology value optimization (TVO), enabling IT, finance, procurement and cloud teams to gain deep insights into cost optimization, compliance and risks for each business service. Flexera One solutions are built on a set of definitive customer, supplier and industry data, powered by our Technology Intelligence Platform, that enables organizations to visualize their Enterprise Technology Blueprint in hybrid environments-from on-premises to SaaS to containers to cloud. We're transforming the software industry. We're Flexe...

As a Lead Databricks Data Engineer based in Ghansoli, Navi Mumbai, you will be responsible for leading the design and implementation of robust data pipelines and solutions. We are looking for a resource who can join our team within 2-3 weeks. With over 8 years of experience in data engineering, you will leverage your deep technical expertise in Databricks, PySpark, and Azure Data Factory (ADF) to ensure the success of our data integration efforts. Your key responsibilities will include designing, developing, and optimizing large-scale data pipelines using Databricks and PySpark, as well as leading data integration efforts using Azure Data Factory. You will collaborate with cross-functional t...

You will be responsible for developing, optimizing, and maintaining business intelligence and data warehouse systems. Your main accountabilities include developing scalable data pipelines, integrating offline and online data for improved customer understanding, managing data quality and governance strategies, transforming data for analysis, and ensuring data accessibility for the enterprise. To qualify for this role, you should have a Masters/Bachelors degree in Engineering/Computer Science/Math/Statistics or equivalent, strong programming skills in Python/Pyspark/SAS, experience with large datasets and technologies like Hadoop, Hive, and Spark optimization. Additionally, experience with clo...

As a Data Architect with over 6 years of experience, you will be responsible for designing and implementing modern data lakehouse architectures on cloud platforms such as AWS, Azure, or GCP. Your primary focus will be on defining data modeling, schema evolution, partitioning, and governance strategies to ensure high-performance and secure data access. In this role, you will own the technical roadmap for scalable data platform solutions, ensuring they are aligned with enterprise needs and future growth. You will also provide architectural guidance and conduct code/design reviews across data engineering teams to maintain high standards of quality. Your responsibilities will include building an...

Job description Some careers shine brighter than others. If you're looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further. HSBC is one of the largest banking and financial services organisations in the world, with operations in 64 countries and territories. We aim to be where the growth is, enabling businesses to thrive and economies to prosper, and, ultimately, helping people to fulfil their hopes and realise their ambitions. We are currently seeking an experienced professional to...

Job Title: Senior Data Engineer Azure Databricks Experience: 7+ Years Location: Navi Mumbai (On-site) Job Overview: We are looking for a highly skilled Senior Data Engineer with expertise in Azure Databricks, big data technologies, and cloud-based data architectures. The ideal candidate will have hands-on experience building scalable data pipelines and platforms for high-volume batch and real-time processing, preferably in the manufacturing or energy sector. Key Responsibilities: • Design and implement robust data pipelines using Azure Databricks, Spark, and other Azure data services. • Collaborate with architects, data scientists, and business teams to understand requirements and translate ...

Bachelors or masters degree in Computer Science, IT, or related field. 5+ years of data engineering experience, including 1+ years on Azure Data Platform. Strong proficiency in Azure Data Factory, Azure Fabric, and Notebooks (PySpark/Python/SQL). Expertise in Delta Lake, Parquet, and modern data lakehouse architectures. Experience with Azure Synapse Analytics, Databricks (if applicable), and data visualization tools such as Power BI. Skilled in SQL, Python, and PySpark for large-scale data transformations. Experience implementing CI/CD for data pipelines and notebooks using Azure DevOps or Git. Knowledge of data governance, security best practices, and compliance frameworks. If youre ready t...

You are a skilled Data Engineer with expertise in the Azure Data Platform, specifically Azure Databricks, PySpark, Azure Data Factory, and Synapse Analytics. Your primary responsibility will be to design, develop, and optimize large-scale data pipelines and analytics solutions. Your key responsibilities will include developing and optimizing data pipelines using Azure Data Factory for ingestion into Azure Databricks, implementing PySpark transformations in Databricks with a focus on performance tuning, building and maintaining data layers, and ensuring efficient export strategies for reporting and analytics. You will also work with Azure Synapse for advanced querying, transformations, and re...

NTT DATA strives to hire exceptional, innovative, and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking an AI Solution Architect to join our team in Bangalore, Karnataka (IN-KA), India (IN). Role: - AI Solution Architect Experience: - 7+ Years Notice Period: - 30-60 Days Project Overview: We are seeking a seasoned AI Architect with strong experience in Generative AI and Large Language Models (LLMs) including OpenAI, Claude, and Gemini to lead the design, orchestration, and deployment of intelligent solutions across complex use cases. You will architect conversational syste...

As a Databricks Architect with 5-8 years of experience, you will be responsible for designing, implementing, and optimizing scalable data architectures leveraging Databricks on public cloud platforms. Your role will involve designing enterprise-grade solutions for batch and real-time data analytics, with hands-on expertise in Databricks, Spark, and cloud-based data services. Your key responsibilities will include designing and developing end-to-end data architectures and pipelines with Databricks, optimizing Databricks performance through efficient data processing, job tuning, and resource management, implementing data security, governance, and best practices, collaborating with stakeholders...

NTT DATA is looking for an Azure Databricks Developer to join their team in Bengaluru, Karnataka, India. As an Azure Databricks Developer, you will be responsible for advanced experience with Databricks, including Databricks SQL, DataFrames, and Spark using PySpark or Scala. You should have a deep understanding of Spark architecture and optimization strategies, such as tuning Spark SQL configurations, managing data partitions, handling data skew, and leveraging broadcast joins. Your role will also involve proficiency in building and optimizing large-scale data pipelines for ETL/ELT processes using Databricks and familiarity with Delta Lake and data lake architectures. Strong programming skil...

About CoPoint AI: CoPoint AI is a specialized consulting firm that focuses on transforming businesses through process improvement, data insights, and technology-driven innovation. Leveraging AI technologies, Microsoft cloud platforms, and modern web development frameworks, we deliver intelligent, scalable solutions that drive measurable impact for our clients. Our team partners across industries to design and deploy solutions that streamline operations, enhance customer experiences, and enable data-driven growth. Our Vision: We transform businesses through process improvement and data insights leveraging AI on the Microsoft stack. Our Values: - Be Purposeful: Think Straight, Communicate, Alw...

Ready to build the future with AI? At Genpact, we don't just keep up with technology we set the pace. AI and digital innovation are redefining industries, and were leading the charge. Genpacts AI Gigafactory , our industry-first accelerator, is an example of how were scaling advanced technology solutions to help global enterprises work smarter, grow faster, and transform at scale. From large-scale models to agentic AI , our breakthrough solutions tackle companies most complex challenges. If you thrive in a fast-moving, innovation-driven environment, love building and deploying cutting-edge AI solutions, and want to push the boundaries of whats possible, this is your moment. Genpact (NYSE: G)...

We would be looking at some of the folks who have both expert skills in Talend and Pyspark. Engineers Skillset: 1. Talend Studio 2. PySpark 3. AWS Ecosystem (S3, Glue, CloudWatch, SSM, IAM etc) 4. Redshift 5. Aurora 6. Terradata Talend Skillset: 1. Good hands-on experience with Talend Studio and Talend Management Console (TMC) 2. In-depth understanding of Joblets, PreJobs, PostJobs, and SubJobs, with the ability to go through complex designs and understand Talend's data flow and control flow logic 3. Proficient in working with Talend components for S3, Redshift, tDBInput, tMap etc and various Java-based components Pyspark: 4. Solid knowledge of PySpark with the ability to compare, analyze an...

6-month extendable Hybrid role in Indore, Noida, Bangalore, Hyderabad, Gurgaon, or Pune. Requires to go 4 days a month in office 8+ yrs in ETL & pipeline expert skilled in Azure, Spark, SQL, Python/Scala, Synapse, Snowflake, and data architecture.

(A) should have hands-on experience in designing and implementing data solutions using Azure data services, including Azure SQL Database, Azure Data Lake Storage, and Azure Synapse Analytics. (B) Experience in setting up, managing Data Lake.

Role & responsibilities Develop and maintain scalable ETL/ELT pipelines using Databricks (PySpark, Delta Lake). Design and optimize data models in AWS Redshift for performance and scalability. Manage Redshift clusters and EC2-based deployments, ensuring reliability and cost efficiency. Integrate data from diverse sources (structured/unstructured) into centralized data platforms. Implement data quality checks, monitoring, and logging across pipelines. Collaborate with data scientists, analysts, and business stakeholders to deliver high-quality datasets. Required Skills & Experience: 36 years of experience in data engineering. Strong expertise in Databricks (Spark, Delta Lake, notebooks, job o...

Why Join Us Are you inspired to grow your career at one of Indias Top 25 Best Workplaces in IT industry Do you want to do the best work of your life at one of the fastest growing IT services companies Do you aspire to thrive in an award-winning work culture that values your talent and career aspirations Its happening right here at Iris Software. About Iris Software At Iris Software, our vision is to be our clients most trusted technology partner, and the first choice for the industrys top professionals to realize their full potential. With over 4,300 associates across India, U.S.A, and Canada, we help our enterprise clients thrive with technology-enabled transformation across financial servi...

We are looking for a Senior Data Engineer to be based out of our Chennai, Bangalore & Hyderabad offices. This role involves a combination of hands-on contribution, customer engagement, and technical team management. As a Senior Data Engineer, you will Design and build solutions for near real-time stream processing as well as batch processing on the Big Data platform. Role & responsibilities Minimum 6+ years of Professional experience with 4+ years of Big Data project experience Strong in Pyspark, Python, PLSQL, SQL Desirable to have ETL with batch and streaming (Kinesis). Build the solution for optimal extraction, transformation, and loading of data from a wide variety of data sources using ...

Job Objective: We are looking for Azure Data and Analytics Solutions Architect focusing on Data engineering to join our growing team of Data and Analytics specialized Consulting organization. This plays a key role in Digital journey of our clients spread globally with focus on Data & AI at the core of it. This role is in our setup to drive the exploratory sessions to find the opportunities, arrive at the Data and Analytics solutions that could involve technical, process and people. Once the solutions are found, this role will orchestrate, architect and technically drive the solutions and do the hands on when and where needed. This role also will mentor, train and enable the consultants at va...

Were looking for a Data Engineer to build and optimize PySpark-based data pipelines in our Python + Azure ecosystem. Youll work on: Designing and maintaining data pipelines (PySpark, Azure Databricks, ADF, Synapse, ADLS) Optimizing ETL workflows for scalability and performance Ensuring data quality, governance, and security Supporting AI/ML teams with reliable data flows You should have: ?? 3+ years of experience in Python & PySpark ?? Strong knowledge of Azure data services and SQL ?? Experience with big data and CI/CD Bonus: Kafka, Delta Lake, Lakehouse, ML/AI pipelines, Terraform Please fill the below form as it is mandatory (applications without form will be automatically rejected): http...

Greetings from NAM Info!!! Please go through the job description. If you are interested in this opportunity, please reply with the following information to praveen@nam-it.com : Full Name (as in Adhar): Current Location: Expected CTC: Present CTC: Least Notice Period(Last Working Day If any): PAN Number: Job Title: Azure Data Engineer Company: Thermax Limited Location: Pune Job Type: Full-Time Employee of Thermax Experience Level: Senior (7+ years) Interview Process: 2 - 3 Rounds virtual Job Summary: Thermax is seeking a Senior Azure Databricks Engineer to lead the design, development, and deployment of scalable data solutions on the Azure cloud platform. The ideal candidate will have deep ex...

As a Director / Associate Director in Cloud Engineering (Azure Stack), you will be responsible for leading multiple client engagements, driving end-to-end project delivery, and managing high-performing engineering teams specializing in Databricks. Your role will involve hands-on technical expertise, project and people management skills, and a proven track record of delivering large-scale data engineering solutions in cloud-native environments. With at least 14 years of experience in data engineering, including 3+ years in leadership or director-level roles, you will be expected to have a strong background in Databricks, Delta Lake, and cloud data architecture. Your responsibilities will incl...

As a Senior Data Architect, you will play a crucial role in designing and implementing scalable, secure, and high-performance Big Data architectures using Databricks, Apache Spark, and cloud-native services. Your expertise will be essential in leading the end-to-end data architecture lifecycle, from requirements gathering to deployment and optimization. Additionally, you will design repeatable and reusable data ingestion pipelines for various ERP source systems like SAP, Salesforce, HR, Factory, and Marketing systems. Collaboration with cross-functional teams to integrate SAP data sources into modern data platforms will be a key aspect of your role, along with driving cloud cost optimization...