601 Delta Lake Jobs - Page 3

As a Senior Data Engineer focusing on Azure Databricks, your role involves designing, building, and optimizing scalable data pipelines and solutions using Azure Databricks and related technologies. Your primary goal is to enable faster, data-driven decisions as part of the data transformation journey. You will be based in Nagpur, Pune, Chennai, or Bangalore. Key Responsibilities: - **Data Pipeline Development:** Design and implement robust batch and streaming data pipelines using Azure Databricks and Spark. - **Data Architecture Implementation:** Apply Medallion Architecture to structure data layers (raw, enriched, curated). - **Data Quality & Governance:** Ensure data accuracy, consistency,...

Position Summary Role Value Proposition: Work and collaborate with a nimble, autonomous, cross-functional team of makers, breakers, doers, and disruptors who love to solve real problems and meet real customer needs. You will be using cutting-edge technologies and frameworks to analyze data, to help create the pipeline, and collaborate with the data science team to enable the innovative work in machine learning and AI. Eagerness to learn new technologies on the fly and ship to production Knowledge in data science is a plus More than just a job we hire people who love what they do! Job Responsibilities Building and Implementing data ingestion and curation process developed using Big data tools...

Purpose of the Role: We are seeking a skilled Databricks Architect with 4 to 6 years of experience in data engineering and cloud platforms. Designs and implements scalable data architectures and solutions. The jobholder has expertise in Databricks Lakehouse, data modelling, and cloud integration, ensuring high performance, security, and reliability. Job Responsibilities: Design and implement Databricks-based data architectures to meet business requirements. Develop and optimize data pipelines using PySpark, Scala, or SQL. Establish the Databricks Lakehouse architecture for batch and streaming data. Collaborate with cross-functional teams to integrate Databricks with cloud platforms (e.g., AW...

5 to 7 years of experience in data engineering Architect and maintain scalable, secure, and reliable data platforms and pipelines Design and implement data lake/data warehouse solutions such as Redshift, BigQuery, Snowflake, or Delta Lake Build real-time and batch data pipelines using tools like Apache Airflow, Kafka, Spark, and DBT Ensure data governance, lineage, quality, and observability

About The Organization Join a fast-scaling B2B data intelligence platform that powers revenue growth through precision contact data and advanced data infrastructure. The organization combines automation with human verification to deliver over 95% accuracy across its database of more than 5 million human-verified contacts and 70 million+ machine-processed records. Known for having the highest number of direct dial contacts in the industry, the platform re-verifies every contact every 90 days through a dedicated research team. With a global footprint and a commitment to data excellence, the company supports cross-functional teams with scalable, secure, and high-performance data systems. The wo...

Role Overview: You should have 5+ years of experience and must possess skills in DataBricks, Delta Lake, pyspark or scala spark, and unity catalog. It would be beneficial to have Azure/AWS Cloud skills. Your main responsibility will be to ingest and transform batch and streaming data on the Databricks Lakehouse Platform. Excellent communication skills are required for this role. Key Responsibilities: - Oversee and support the process by reviewing daily transactions on performance parameters - Review performance dashboard and scores for the team - Support the team in improving performance parameters by providing technical support and process guidance - Record, track, and document all queries ...

Job Description We are seeking an experienced Data Architect specializing in Databricks to lead the architecture, design, and migration of enterprise data workloads from on-premises systems (e.g., Oracle, Exadata, Hadoop) to Databricks on Azure or AWS . The role involves designing scalable, secure, and high-performing data platforms based on the medallion architecture (bronze, silver, gold layers), supporting large-scale ingestion, transformation, and publishing of data. Responsibilities Key Responsibilities Define and design cloud-native data architectures on Databricks using Delta Lake, Unity Catalog, and related components. Develop and execute migration strategies for moving on-premises d...

Python (4+ years) : Strong expertise in data workflows and automation. Spark (PySpark) : Hands-on experience with large-scale data processing. Pandas : For detailed data analysis and validation. Delta Lake : Managing structured and semi-structured datasets at scale. SQL : Querying and performing operations on Delta tables. Kubernetes (K8s) : Container orchestration and deployment. Azure cloud : Compute and storage services. Testing frameworks : Proven experience in unit, integration, and system-level testing. Good to have skillsets Experience with climate, ESG, or large-scale data domains . Strong understanding of data standards and governance practices . Advanced SQL and optimization experi...

Skills: Data Engineering, Azure Databricks, Data Modeling, architecture, pyspark, scala, SQL, About The Role We are seeking a Senior Databricks Architect to lead the design and implementation of scalable, secure, and cost-optimized data platforms on Azure using Databricks. You will own end-to-end architecture for data ingestion, transformation, governance, and analytics, and mentor engineering teams to deliver high-quality data solutions. Key Responsibilities Architect and implement enterprise-grade data platforms on Azure Databricks (DLT, Workflows, Unity Catalog) with strong security, governance, and reliability. Design end-to-end data pipelines: batch and streaming (Structured Streaming),...

As a skilled and experienced Technology Stack Administrator, your role will involve managing and optimizing the on-premises infrastructure comprising RedHat OpenShift, Apache Spark, Apache Airflow, Delta Lake, Apache Kafka, and Debezium. Your responsibilities will include: - Platform Administration: - Installing, configuring, and maintaining RedHat OpenShift clusters in an on-premises environment. - Building and orchestrating data pipelines using Apache Airflow. - Implementing and managing Delta Lake for ACID-compliant data lake architecture. - Managing Apache Spark clusters for distributed data processing. - Developing real-time data streaming and CDC solutions using Apache Kafka and Debezi...

Exp: 8+Yrs Work Mode: Work from Office (WFO) Work Location: Kandlakoya, Near Medchal, Telangana Work Timings: 9:30 AM to 6:00 PM Weekend Policy: Only the 2nd and 4th Saturdays are holidays. Job Title: Data Warehouse Architect Department: Data & Analytics / IT Employment Type: Full-Time About the Role We are seeking a highly skilled Data Warehouse Architect to design and build enterprise-grade data platformsincluding data lakes, data warehouses, and data marts to support analytics, business intelligence, and AI applications across multiple business functions such as finance, operations, HR, sales, supply chain, and product management. The ideal candidate will have strong expertise in modern d...

Role Overview: As an experienced Data Architect specializing in Databricks, you will be responsible for leading the architecture, design, and migration of enterprise data workloads from on-premises systems to Databricks on Azure or AWS. Your role will involve designing scalable, secure, and high-performing data platforms based on the medallion architecture (bronze, silver, gold layers) to support large-scale ingestion, transformation, and publishing of data. Key Responsibilities: - Define and design cloud-native data architecture on Databricks utilizing Delta Lake, Unity Catalog, and related services. - Develop migration strategies for transferring on-premises data workloads (Oracle, Hadoop,...

Job description Hiring for Azure Databrick Engineer Mandatory Skills: Databrick, Data lake, Azure Responsibilities A day in the life of an Infoscion As part of the Infosys consulting team, your primary role would be to actively aid the consulting team in different phases of the project including problem definition, effort estimation, diagnosis, solution generation and design and deployment You will explore the alternatives to the recommended solutions based on research that includes literature surveys, information available in public domains, vendor evaluation information, etc. and build POCs You will create requirement specifications from the business needs, define the to-be-processes and d...

Job description Hiring for Azure Databrick Engineer Mandatory Skills: Databrick, Data lake, Azure Responsibilities A day in the life of an Infoscion As part of the Infosys consulting team, your primary role would be to actively aid the consulting team in different phases of the project including problem definition, effort estimation, diagnosis, solution generation and design and deployment You will explore the alternatives to the recommended solutions based on research that includes literature surveys, information available in public domains, vendor evaluation information, etc. and build POCs You will create requirement specifications from the business needs, define the to-be-processes and d...

Job Description We are Omnissa! The world is evolving fast, and organizations everywherefrom corporations to schoolsare under immense pressure to provide flexible, work-from-anywhere solutions. They need IT infrastructure that empowers employees and customers to access applications from any device, on any cloud, all while maintaining top-tier security. That's where Omnissa comes in. The Omnissa Platform is the first AI-driven digital work platform that enables smart, seamless and secure work experiences from anywhere. It uniquely integrates multiple industry-leading solutions including Unified Endpoint Management, Virtual Apps and Desktops, Digital Employee Experience, and Security & Complia...

Company Overview Milestone Technologies is a global IT managed services firm that partners with organizations to scale their technology, infrastructure and services to drive specific business outcomes such as digital transformation, innovation, and operational agility. Milestone is focused on building an employee-first, performance-based culture and for over 25 years, we have a demonstrated history of supporting category-defining enterprise clients that are growing ahead of the market. The company specializes in providing solutions across Application Services and Consulting, Digital Product Engineering, Digital Workplace Services, Private Cloud Services, AI/Automation, and ServiceNow. Milest...

Why Join Iris Are you ready to do the best work of your career at one of India's Top 25 Best Workplaces in IT industry Do you want to grow in an award-winning culture that truly values your talent and ambitions Join Iris Software - one of the fastest-growing IT services companies - where you own and shape your success story . About Us At Iris Software, our vision is to be our client's most trusted technology partner, and the first choice for the industry's top professionals to realize their full potential. With over 4,300 associates across India, U.S.A, and Canada, we help our enterprise clients thrive with technology-enabled transformation across financial services, healthcare, transportati...

Why Join Iris Are you ready to do the best work of your career at one of India's Top 25 Best Workplaces in IT industry Do you want to grow in an award-winning culture that truly values your talent and ambitions Join Iris Software - one of the fastest-growing IT services companies - where you own and shape your success story . About Us At Iris Software, our vision is to be our client's most trusted technology partner, and the first choice for the industry's top professionals to realize their full potential. With over 4,300 associates across India, U.S.A, and Canada, we help our enterprise clients thrive with technology-enabled transformation across financial services, healthcare, transportati...

Why Join Iris Are you ready to do the best work of your career at one of India's Top 25 Best Workplaces in IT industry Do you want to grow in an award-winning culture that truly values your talent and ambitions Join Iris Software - one of the fastest-growing IT services companies - where you own and shape your success story . About Us At Iris Software, our vision is to be our client's most trusted technology partner, and the first choice for the industry's top professionals to realize their full potential. With over 4,300 associates across India, U.S.A, and Canada, we help our enterprise clients thrive with technology-enabled transformation across financial services, healthcare, transportati...

Why Join Iris Are you ready to do the best work of your career at one of India's Top 25 Best Workplaces in IT industry Do you want to grow in an award-winning culture that truly values your talent and ambitions Join Iris Software - one of the fastest-growing IT services companies - where you own and shape your success story . About Us At Iris Software, our vision is to be our client's most trusted technology partner, and the first choice for the industry's top professionals to realize their full potential. With over 4,300 associates across India, U.S.A, and Canada, we help our enterprise clients thrive with technology-enabled transformation across financial services, healthcare, transportati...

Why Join Iris Are you ready to do the best work of your career at one of India's Top 25 Best Workplaces in IT industry Do you want to grow in an award-winning culture that truly values your talent and ambitions Join Iris Software - one of the fastest-growing IT services companies - where you own and shape your success story . About Us At Iris Software, our vision is to be our client's most trusted technology partner, and the first choice for the industry's top professionals to realize their full potential. With over 4,300 associates across India, U.S.A, and Canada, we help our enterprise clients thrive with technology-enabled transformation across financial services, healthcare, transportati...

Job Title Data Engineer - Hadoop, Scala and Databricks Role Summary & Role Description As Data Engineer you will Collaborate across a variety of teams to enable our Data Platform needs and design, implement, and maintain a secure and scalable infrastructure platform spanning across AWS/Azure and our Data Center Own and ensure that internal and external SLA's meet and exceed expectations, System centric KPIs are continuously monitored Work on our data lake, data warehouse, and stream processing systems to create a unified query engine, multi-model databases, analytics extracts and reports, as well as dashboard and visualizations Design and build systems for high availability, high throughput,...

Job Title Data Engineer - Hadoop, Scala and Databricks Role Summary & Role Description As Data Engineer you will Collaborate across a variety of teams to enable our Data Platform needs and design, implement, and maintain a secure and scalable infrastructure platform spanning across AWS/Azure and our Data Center Own and ensure that internal and external SLA's meet and exceed expectations, System centric KPIs are continuously monitored Work on our data lake, data warehouse, and stream processing systems to create a unified query engine, multi-model databases, analytics extracts and reports, as well as dashboard and visualizations Design and build systems for high availability, high throughput,...

Experience: 5 - 10 Years Location: Kochi Work Mode: Hybrid Job Type: Fulltime Mandatory Skills:Python, Pyspark (Scala or Spark), SQL, Rest APIs, Orchestration, Delta Live tables Delta Lake, Databricks, Datafactory, SSIS, ETL, Data Pipelines Snowflake, Snowsql, Snowpipe, Performance Tuning Microsoft Fabric: Dataflows, pipelines, OneLake, integration with Power BI Infrastructure as Code (Terraform, Bicep) Certifications: Databricks, Snowflake, and/or Fabric certification is a plus Qualifications Education: Bachelor's degree in Computer Science, Data Engineering, Information Systems, or related field. Master's degree is a plus. Experience: 5+ years of professional experience in data engineering...

Description About InspireXT : InspireXT is on a mission to build the most trusted supply chains in the world. Our Connected Intelligence vision combines Databricks with deep Oracle ERP/SCM, Salesforce, and industry accelerators to deliver compliant, AI-driven outcomes in Pharma, Manufacturing and Retail. We are investing significantly in our Databricks alliance and building a certified practice from Pune to support global clients across UK, Europe, US and Asia. Role Description As a Databricks Solution Architect at InspireXT, you will partner with our customers to design scalable, governed data architectures and lead migrations into the Databricks Lakehouse. You will bring technical depth an...