584 Delta Lake Jobs - Page 7

Job Description Job Summary - A mid-senior level Data Analyst lead to manage a critical project for one of our biggest client in insurance domain. The Individual should be passionate about technology, experienced in developing and managing cutting edge technology applications. We are seeking an experienced Project Lead - Data Engineer to oversee the application support and maintenance of enterprise data pipelines and reporting systems. The ideal candidate will be responsible for ensuring seamless data operations, monitoring production pipelines, managing incidents and problems, conducting root cause analysis (RCA), and driving continuous improvements across the data ecosystem. This role also...

Position Overview The Team Lead for Advanced Data Systems Delivery will lead a team responsible for delivering high-performance, scalable data solutions, with a focus on designing and optimizing data architectures for mission-critical Tier 1 systems. This role requires deep expertise in deploying real-time and batch processing systems, utilizing the ArcOne AI platform to architect scalable topologies, tune critical components, and ensure compliance with NFRs and SLAs, while maintaining a strong foundation in data architecture principles. Key Responsibilities Project Leadership & Delivery : Lead the end-to-end delivery of advanced data systems for mission-critical Tier 1 applications, focusin...

Company Description Ralph Lauren Corporation (NYSE:RL) is a global leader in the design, marketing and distribution of premium lifestyle products in five categories: apparel, accessories, home, fragrances, and hospitality. For more than 50 years, Ralph Lauren's reputation and distinctive image have been consistently developed across an expanding number of products, brands and international markets. The Company's brand names, which include Ralph Lauren, Ralph Lauren Collection, Ralph Lauren Purple Label, Polo Ralph Lauren, Double RL, Lauren Ralph Lauren, Polo Ralph Lauren Children, Chaps, among others, constitute one of the world's most widely recognized families of consumer brands. At Ralph ...

FactSet creates flexible, open data and software solutions for over 200,000 investment professionals worldwide, providing instant access to financial data and analytics that investors use to make crucial decisions. At FactSet, our values are the foundation of everything we do. They express how we act and operate, serve as a compass in our decision-making, and play a big role in how we treat each other, our clients, and our communities. We believe that the best ideas can come from anyone, anywhere, at any time, and that curiosity is the key to anticipating our clients needs and exceeding their expectations. We're seeking a passionate and experienced Senior Python & Machine Learning Engineer t...

About the Role We are seeking a highly skilled Data Engineer with deep expertise in Microsoft Azure to design, build, and optimize scalable data pipelines and Lakehouse architectures. You will work closely with cross-functional teams to provide thought leadership deliver robust, secure, and high-performance data solutions that empower analytics and data science initiatives. Key Responsibilities Design, develop, and maintain scalable data pipelines using Azure Data Factory and Azure Synapse Analytics . Build and optimize lakehouse architectures on Azure using Delta Lake . Work closely with client stakeholders to understand their requirements and provide thought leadership to translate the sam...

The D. E. Shaw group is a global investment and technology development firm with more than $60 billion in investment capital as of March 1, 2024, and offices in North America, Europe, and Asia. Since our founding in 1988, our firm has earned an international reputation for successful investing based on innovation, careful risk management, and the quality and depth of our staff. We have a significant presence in the world's capital markets, investing in a wide range of companies and financial instruments in both developed and developing economies. We seek an experienced data engineer to join our Equities team at the D. E. Shaw India office in Hyderabad/Gurugram. The Equities India group colla...

Notice Period-Immediate Joiner or Max 10 days (Do not share long notice period profile.) Permanent Payroll - Anlage Infotech Client - Orion Innovation Location- Kochi, Chennai, Coimbatore, Pune - HYBRID (2/3 days in a week) Role & responsibilities Work Location: Kochi, Chennai, Coimbatore, Pune Hybrid Mode Mandate skills - Pyspark + Azure DataBricks + Azure Data Factory + MS Fabric Experience- 5+ years We are seeking a skilled and experienced Senior Data Engineer with a strong background in Azure Data Services, particularly Azure Databricks, Azure Data Factory, PySpark and MS Fabric. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines and...

As a Data Engineer specializing in Spark & Delta Lake, your role will involve understanding key Spark concepts such as RDDs, DataFrames, DataSets, SparkSQL, and Spark Streaming. You will also be expected to have experience in optimizing Spark performance and a deep understanding of Delta Lake features like time travel, schema evolution, and data partitioning. Your responsibilities will include designing and implementing data pipelines using Spark and Delta Lake as the data storage layer. Proficiency in Python, Scala, or Java for Spark development and integration with ETL processes is essential. Additionally, you should possess knowledge of data ingestion techniques from various sources such ...

Role Summary & Role Description: Technical Manager with specific Oracle, PL/SQL and design, develop, and optimize data workflows on the Databricks platform. The ideal candidate will have deep expertise in Apache Spark, PySpark, Python, job orchestration, and CI/CD integration to support scalable data engineering and analytics solutions. Analyzes, designs, develops and maintains software applications to support business units. Expected to spend 80% of the time on hands-on development, design and architecture and remaining 20% on guiding the team on technology and removing other impediments Capital Markets Projects experience preferred Provides advanced technical expertise in analyzing, design...

Job Description: As a Principal Software Engineer, you will provide technical leadership within development teams, ensuring architectural coherence, collaboration, and best practices. Your role involves bridging the gap between data engineering, data science, and software engineering to help build scalable, maintainable data solutions. You will design and implement solutions, mentor developers, influence technical direction, and drive best practices. Additionally, you will have line management responsibilities, focusing on the growth and development of team members. The role will involve working in an Azure and Databricks environment, leveraging cloud-native technologies and modern data plat...

As the Director of Data and Analytics at KASH Tech, your role will involve driving the strategy, execution, and delivery of data and analytics solutions across modern cloud platforms, AI/ML, and big data ecosystems. Your responsibilities will include defining and executing data modernization strategies, leading enterprise cloud data transformations, developing best-fit methodologies for client solutions, identifying opportunities for AI, automation, and data-driven decision-making, and architecting and implementing scalable data platforms using various tools like Databricks, Azure Synapse, and Microsoft Fabric. Key Responsibilities: - Define and execute data modernization strategies aligned ...

Job Title:Immediate Data Scientist (3+ Years Experience) Bengaluru Location:Bengaluru (Work from Office Minimum 4 Days/Week) Employment Type:Full-time (Third-Party Payroll, Not Contractual) Experience Required:3+ years in AI/ML Educational Qualifications: o B.E./B.Tech/M.Tech/MCA in Computer Science, Electronics & Communication, Electrical Engineering, or a related field. o A master's degree in computer science, Artificial Intelligence, or a specialisation in Deep Learning or Computer Vision is highly preferred. Experience: o 46 years of IT experience, with a minimum of 3+ years in data science o Proven experience in designing and deploying deep learning models, particularly in computer visi...

Role Overview The Technical Architect - Databricks designs and implements scalable data architectures and solutions. The jobholder has expertise in Databricks Lakehouse, data modeling, and cloud integration, ensuring high performance, security, and reliability. Responsibilities Design and implement Databricks-based data architectures to meet business requirements. Develop and optimize data pipelines using PySpark, Scala, or SQL. Establish the Databricks Lakehouse architecture for batch and streaming data. Collaborate with cross-functional teams to integrate Databricks with cloud platforms (e.g., AWS, Azure, GCP). Ensure data security and compliance with best practices. Monitor and troublesho...

Job Description Senior Manager, Lead Data Engineer The Opportunity Based in Hyderabad, join a global healthcare biopharma company and be part of a 130-year legacy of success backed by ethical integrity, forward momentum, and an inspiring mission to achieve new milestones in global healthcare. Be part of an organisation driven by digital technology and data-backed approaches that support a diversified portfolio of prescription medicines, vaccines, and animal health products. Drive innovation and execution excellence. Join a team that is passionate about using data, analytics, and insights to drive decision-making and create custom software, allowing us to tackle some of the world's greatest h...

Position : Data Architect (Databricks, Snowflake) Location : Nagpur, Pune, Chennai, Bangalore Type of Employment : Full time Employment Purpose of the Position : Design and optimize cloud-native data architectures on platforms like Databricks and Snowflake, enabling scalable data engineering, advanced analytics, and AI/ML solutions aligned with business needs. Key Result Areas and Activities : Design and implement Lakehouse architectures using Databricks, Delta Lake, and Apache Spark. Lead the development of data pipelines, ETL/ELT processes, and data integration strategies. Collaborate with business and technical teams to define data architecture standards, governance, and security models. ...

Azure Fabric Specialist London (Hybrid) Experience: 4+ years Client: NHS Contract: Outside IR35 Key Responsibilities Deliver end-to-end Microsoft Fabric OneLake solutions for NHS data platforms, ensuring compliance with NHS DSPT, IG Toolkit, and healthcare data standards. Lead migration of complex on-premises data systems into Fabric Lakehouse and Warehouse, integrating with Power BI, Purview, and secure pipelines. Define and enforce Medallion architecture (BronzeSilverGold) with robust data modelling, governance, lineage, and audit. Engineer high-throughput ETL/ELT across Fabric, Synapse, and Databricks; achieve measurable targets for latency, cost, and reliability . Implement FHIR/HL7 data...

Role Summary & Role Description: Technical Manager with specific Oracle, PL/SQL and design, develop, and optimize data workflows on the Databricks platform. The ideal candidate will have deep expertise in Apache Spark, PySpark, Python, job orchestration, and CI/CD integration to support scalable data engineering and analytics solutions. Analyzes, designs, develops and maintains software applications to support business units. Expected to spend 80% of the time on hands-on development, design and architecture and remaining 20% on guiding the team on technology and removing other impediments Capital Markets Projects experience preferred Provides advanced technical expertise in analyzing, design...

Data Engineer (36 Years) We are looking for a Data Engineer who can work across modern data platforms and streaming frameworks to build scalable and reliable pipelines. If you enjoy working with Spark on Databricks, Kafka, Snowflake, and MongoDB and want to solve real-world data integration challenges this role is for you. What you'll do: You will develop ETL/ELT pipelines in Databricks (PySpark notebooks) or Snowflake (SQL/Snowpark), ingesting from sources like Confluent Kafka Handle data storage optimizations using Delta Lake/Iceberg formats, ensuring reliability (e.g., time travel for auditing in fintech pipelines). Integrate with Azure ecosystems (e.g., Fabric for warehousing, Event Hubs...

We are looking for a skilled Data Engineer with strong expertise in Python, PySpark, SQL, AWS and Databricks to join our data engineering team. The ideal candidate will be responsible for building scalable data pipelines, transforming large datasets, and enabling data-driven decision-making across the organization. Role & responsibilities Data Pipeline Development: Design, build, and maintain scalable data pipelines for ingesting, processing, and transforming large datasets from diverse sources into usable formats. Performance Optimization: Optimize data processing and storage systems for cost efficiency and high performance, including managing compute resources and cluster configurations. A...

Job Description Job Title: MLOps Engineer Experience: 4+ Years Location: / Coimbatore Must-Have Skills: MLOps, Model Deployment & Monitoring Azure Cloud (Azure ML, ADF, AKS, etc.) Databricks (Delta Lake, MLflow, Notebooks, Jobs) CI/CD, GitOps, Infrastructure as Code (Terraform, ARM) Python, PySpark, MLflow, REST APIs Stakeholder & Cross-functional Team Management

Job Description Job Title: MLOps Engineer Experience: 4+ Years Location: Hyderabad Must-Have Skills: MLOps, Model Deployment & Monitoring Azure Cloud (Azure ML, ADF, AKS, etc.) Databricks (Delta Lake, MLflow, Notebooks, Jobs) CI/CD, GitOps, Infrastructure as Code (Terraform, ARM) Python, PySpark, MLflow, REST APIs Stakeholder & Cross-functional Team Management

Experience : 1.00 + years Salary : INR 1800000-2200000 / year (based on experience) Expected Notice Period : 15 Days Shift : (GMT+05:30) Asia/Kolkata (IST) Opportunity Type : Remote Placement Type : Full Time Permanent position(Payroll and Compliance to be managed by: Zero to 1) (*Note: This is a requirement for one of Uplers client - Zero to 1) What do you need for this opportunity Must have skills required: graph features (PPR, Graph/GraphRAG: Neo4j, Jaccard) for constrained recommendations, Re-rankers: cross-encoders, reranking with transformers, Languages: Python 3.10+, Classical ML: scikit-learn, cross-val, Data: pandas, Delta Lake (S3), Feature Engineering, LightGBM/XGBoost, model sele...

As a Data Engineer with 5+ years of hands-on experience in data engineering/ETL using Databricks on AWS/Azure cloud infrastructure and functions, your key responsibilities will include: - Performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement. - Implementing highly performant data ingestion pipelines from multiple sources using data warehousing concepts such as Dimensional (star-schema), SCD2, Data Vault, Denormalized, OBT. - Demonstrating a strong proficiency in Python and SQL for data manipulation and analysis. - Utilizing the features of the Databricks platform including Delta Lake, Databr...

Experience : 1.00 + years Salary : INR 1800000-2200000 / year (based on experience) Expected Notice Period : 15 Days Shift : (GMT+05:30) Asia/Kolkata (IST) Opportunity Type : Remote Placement Type : Full Time Permanent position(Payroll and Compliance to be managed by: Zero to 1) (*Note: This is a requirement for one of Uplers client - Zero to 1) What do you need for this opportunity Must have skills required: graph features (PPR, Graph/GraphRAG: Neo4j, Jaccard) for constrained recommendations, Re-rankers: cross-encoders, reranking with transformers, Languages: Python 3.10+, Classical ML: scikit-learn, cross-val, Data: pandas, Delta Lake (S3), Feature Engineering, LightGBM/XGBoost, model sele...

At BairesDev, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley. Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works on roles that drive significant impact worldwide. When you apply for this position, you're taking the first step in a process that goes beyond the ordinary. We aim to align your passions and skills with our vacancies, setting you on a path to exceptional career development and success. Senior Data Lake Engineer at BairesDev We are seeking a Senior Data Lake Engineer with expertise in data lake architecture, schema-on-read, data...