23818 Databricks Jobs - Page 6

Data Engineer (Scala | Spark | Azure) We are seeking a Scala and Spark–focused Data Engineer with around 6 years of experience to join our data platform team. This is a hands-on role focused on building, optimizing, and operating scalable batch and streaming data pipelines on Azure. You will work closely with engineering, analytics, and product teams to design reliable data systems and evolve our data architecture to support current and future data initiatives. This role suits someone comfortable owning production pipelines and working deeply with distributed systems. Responsibilities Design, build, and maintain scalable data pipelines using Scala and Apache Spark Develop and optimize batch ...

Job Description: .NET / Azure Technical Architect Designation: Technical Architect – Dotnet/Azure Experience Required: 12+ Years Job Location: Chennai Role Overview We are seeking a hands-on Technical Architect with deep expertise in .NET technologies and Azure Cloud Services. The ideal candidate will be responsible for designing, developing, and guiding the implementation of scalable enterprise solutions. This is a strategic role requiring both architectural leadership and strong coding skills to lead from the front. The role also involves designing modern microservices-based architectures and containerized solutions deployed on Azure. Core Responsibilities Lead the architecture, design, an...

Greeting from ALIQAN Technologies !! 🚀 We Are Hiring – Data Governance Lead. Job Title: Data Governance Lead Organization: NEC Corporation India Pvt. Ltd. Location: Chennai Employment Type: 6 Months Contract + Extendable. Experience: 8–15 years Role Overview: The Data Governance Lead is responsible for defining, executing, and maturing the enterprise-wide data governance strategy, frameworks, and operating models. This role ensures high data quality, regulatory compliance, and consistent usage of data across the organization. Experience in BFSI is a strong value add due to industry-specific regulatory and governance requirements. Key Responsibilities: Lead the design, rollout, and continuous...

Company Introduction: Founded in the UK, NeosAlpha is a global IT consulting and services company specializing in cutting edge technologies, including Application and Business Integration, Business Process Automation, API Management, Cloud CRM, and ERP. As a fast-growing company, we are seeking motivated and talented individuals to join our team on this exciting journey. At NeosAlpha, we foster a performance driven culture that offers limitless opportunities for both personal and professional growth. Our founders bring deep expertise, extensive experience, and long-standing client relationships across the UK and Europe. We have forged strong, mutually beneficial partnerships with leading tec...

Responsibilities A day in the life of an Infoscion • As part of the Infosys delivery team, your primary role would be to interface with the client for quality assurance, issue resolution and ensuring high customer satisfaction. • You will understand requirements, create and review designs, validate the architecture and ensure high levels of service offerings to clients in the technology domain. • You will participate in project estimation, provide inputs for solution delivery, conduct technical risk planning, perform code reviews and unit test plan reviews. • You will lead and guide your teams towards developing optimized high quality code deliverables, continual knowledge management and adh...

Job Role: Agentic AI Developer Experience Range: 4+ Years Location: Pan India Responsibilities: Architect and lead development of scalable, production-grade agentic AI systems. Design serverless, event-driven workflows using Azure Functions, Logic Apps, and Power Automate. Build and optimize ML models for predictive analytics, anomaly detection, and recommendations using Azure ML, Databricks, and Python. Integrate agents with enterprise platforms such as SAP HANA, Salesforce, Snowflake, Kafka, and UiPath. Ensure observability and reliability through Azure Monitor, logging, and alerting frameworks. Define and enforce architecture patterns, reusable components, and governance standards. Lead c...

Hiring: Data Engineer (6–7 Year’s Experience) Location: Remote Experience: 6-7 years Working Hours: 11:00 AM – 9:00 PM IST About the Role We are looking for experienced Data Engineers (6–7 years) with strong expertise in Azure Databricks, ADF, Python, Apache Spark, and SQL. This role involves building scalable data pipelines, optimizing workflows, and collaborating with business teams to deliver high-performing data solutions. ⭐ Key Responsibilities Design & Develop Data Solutions • Build scalable and optimized data pipelines using Azure Databricks, Apache Spark, and other Azure services. • Develop workflows using Azure Data Factory (ADF) and other low-code/no-code automation platforms. Data...

Note: Please apply directly through LinkedIn for this position. We kindly request that candidates refrain from contacting company officials via email or messages regarding this role. About the Company We are an AI and Data Consulting Startup transforming how businesses leverage technology through four core service lines: Consulting Services: AI Strategy, Automation, and Digital Transformation for enterprises. SaaS Platform Development: Building a business application suite similar to Odoo and Zoho that is AI-native and user friendly. Data Lakehouse Solutions: Unified data pipelines for aggregation, cleaning, governance, and advanced analytics. Government Contracting: Developing secure, compl...

1. Position Summary The Data Engineering Lead is responsible for designing, building and operating data platforms and pipelines required for AI, analytics and automation use cases. The role leads a team of Data Engineers to implement the data architecture defined by the Architecture Lead and Solution Architect, ensuring reliable, high-quality and well-governed data for use cases such as Manufacturing Control Tower, Golden Batch, Yield Improvement, OOS prediction and pricing models. 2. Roles Played Data Engineering team lead for AI and analytics initiatives. Owner of data pipelines, transformations and data availability SLAs. Key contributor to data modelling, data quality and governance prac...

Roles & Responsibilities Core Skills Expertise in Azure Stack: ADF, Synapse Analytics. Strong experience with PySpark and SQL for data engineering tasks. Solid understanding of data modeling principles and best practices. Exposure to Generative AI-based development and its integration with data workflows. Hands-on experience with GitHub Actions for automation and deployment. Proven ability to work with large-scale datasets in complex environments. Excellent problem-solving skills and ability to work in a collaborative team environment. Experience working with data in the Finance domain . Familiarity with other Azure services (e.g., Azure Databricks, Azure Data Lake). Knowledge of data govern...

🚀 Hiring: Azure Databricks Engineer 📍 Location :- Indore / Pune (Relocation is not supported) 🏢 Work Mode :- Hybrid – 3 days Work from Office 💰 Compensation :- Highly Competitive 🧪 Interview Process 2 Virtual Interview Rounds 🔍 Role Overview :- We are looking for an experienced Azure Databricks Engineer with strong expertise in building scalable data pipelines and ETL solutions on Azure. The ideal candidate will have hands-on experience with Databricks, PySpark, Azure Data Services, and SQL , and a solid understanding of data engineering best practices. 🎯 Key Responsibilities Design, develop, and optimize ETL pipelines using Azure Databricks and PySpark Build and maintain scalable data proce...

About Client: One of our MNC clients offers technology consulting and digital solutions to global enterprises across industries, enabling transformative scale at unparalleled speed. With 145,000+ professionals across 90+ countries helping 1100+ clients, it provides a full spectrum of services including consulting, information technology, enterprise applications, business process services, engineering services, network services, customer experience & design services, AI & analytics, and cloud & infrastructure services. It is the first Indian company in the world to have been awarded the Sustainable Markets Initiative’s Terra Carta Seal, in recognition of actively leading the charge to create ...

Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by inclusion, talented peers, comprehensive benefits and career development opportunities. Come make an impact on the communities we serve as you help us advance health optimization on a global scale. Join us to start Caring. Connecting. Growing together. Primary Responsibilities Develop reports and analytics that analyze Marketing and Operational trends and performanc...

Job Description: Experience : 8+ Years Location : PAN India ( Remote ) We are looking for a Lead Azure Data Engineer with strong hands-on experience in Azure Data Factory (ADF), Azure Databricks (ADB), PySpark, and SQL . Key Responsibilities Design and develop end-to-end data pipelines using ADF Build and optimize data processing using Databricks and PySpark Develop and tune complex SQL queries Lead technical discussions, code reviews, and best practices Collaborate with stakeholders to understand data requirements Mandatory Skills Azure Data Factory (ADF) Azure Databricks (ADB) PySpark SQL

Company Overview: Innovya Technologies is a dynamic and growing software consulting firm that drives business automation with cutting-edge solutions. We help businesses quickly realize value from their technology and digital initiatives by delivering expert, context-driven product development. Cultural Fit: At Innovya, we thrive in a fast-paced, supportive environment where continuous learning, teamwork, and disciplined execution are key. If you're results-driven, growth-minded, and eager to make an impact, Innovya is the place for you! Job Description: We are actively seeking a Senior Java Developer with a strong background in Enterprise Java and related technologies to design, develop, and...

Role: Databricks with Python Experience range: 5-8 years Location: Hyderabad NOTE: Relevant Databricks experience must be 5 years Job description: Must Have: Extensive expertise in designing and implementing data load processes using Azure Data Factory, Azure Databricks, Delta Lake, Azure Delta Lake Storage and Python/PySpark Proficient with Databricks & Python Senior developers with Full Database/ Datawarehouse/ DataMart development capabilities Senior SME with SQL Server required. Proficiency with standard file formats and markup language technology such as JSON, XML, XSLT. Proficiency with Azure Cloud data environments highly desired. Excellent verbal communication skills. Good problem-so...

About the Role We are looking for a highly skilled Data Engineer to design, build, and maintain robust data pipelines and scalable data infrastructure. You will work closely with analytics, product, and engineering teams to enable high-quality data availability for business insights, machine learning, and operational processes. This role is ideal for an engineer who enjoys solving complex data problems, optimizing systems, and ensuring clean, reliable data flows. Key Responsibilities Design, develop, and maintain scalable ETL/ELT pipelines using modern data engineering tools. Build and optimize data lakes, data warehouses, and streaming architectures . Work with large and complex datasets to...

Suite 7.01A & Suite 7.03 Level 7 Lingkaran Syed Putra Wilayah Persekutuan Kuala Lumpur 59200 Why Valmont We’re Here to Move the World Forward. Valmont impacts millions of people around the world every day, yet they might not realize the many ways. Our technology is helping feed the growing population, supplying the world with more reliable energy and access to renewables, enhancing connectivity in remote and urban locations to create a sustainable future and so much more. Simply put, Valmont is advancing agricultural productivity and reimagining vital infrastructure to make life better. Join a Fortune 1000 company that respects hard work, honors diversity and invests in our employees as we f...

You have over 7 years of experience in Big Data with a strong expertise in Spark and Scala. Your mandatory skills include proficiency in Big Data primarily Spark and Scala, along with a strong knowledge in HDFS, Hive, Impala, Unix, Oracle, and Autosys. It is essential to have strong communication skills and experience in Spark streaming, not limited to Spark batch. Additionally, you should have experience with NoSQL databases such as HBase, Mongo, and Couchbase. Your core skills should encompass PySpark, Python, and SQL. You should also have experience in machine learning with ML Libraries, Scikit-learn, PySpark Mlib, statistical methods, regression, classification, and clustering. In terms ...

As an experienced AI/ML Architect, you will be responsible for architecting and deploying enterprise-scale AI/ML platforms. Your role will involve working in agile, cross-functional teams to deliver measurable impact. With a Masters or PhD in Computer Science, Artificial Intelligence, Machine Learning, or a related quantitative field, you should have 8+ years of experience in this domain. Your key responsibilities will include: - Designing, implementing, and scaling AI infrastructure using technologies such as Databricks, Azure AI, Snowflake, Spark, and Airflow. - Hands-on experience with model selection, fine-tuning, evaluation, and responsible AI governance. - Strong programming skills in ...

As a Data Engineer - Senior at EY's GDS Tax Technology practice in India, you will play a crucial role in developing, implementing, and integrating technology solutions to better serve clients and engagement teams. Your responsibilities will include: - Strong database programming/ backend development experience using SQL Server/Azure SQL, writing complex queries, stored procedures, views, triggers, cursors, UDFs. - Strong knowledge in data modeling and Datawarehouse concepts. - Experience on Azure Data Factory or any other ETL. - Developing, maintaining, and optimizing all data layer components for new and existing systems, including databases, stored procedures, ETL packages, and SQL querie...

Role Overview: You will be responsible for developing, scheduling, and managing ETL processes using SSIS and Azure Data Factory (ADF). Additionally, you will build and optimize data models and OLAP cubes using SSAS and Azure Analysis Services, design and deploy reports using SSRS and Power BI, and migrate on-premises SQL workloads to Azure SQL, Data Lake, and Synapse. You will also be tasked with building scalable data pipelines and processing workflows using Databricks (PySpark), writing complex T-SQL queries, stored procedures, functions, and triggers, and implementing DevOps pipelines for data deployment and automation using Azure DevOps. Collaboration with stakeholders to convert busines...

As a Power BI Developer, your role will involve working closely with stakeholders to identify and define self-service analytics solutions, dashboards, and actionable BI reports. You will play a key part in enterprise BI design, ensuring that the design is repeatable, lean, and maintainable across a large organization. It is essential for you to have a strong fundamental understanding of data warehousing, data modeling, and data engineering best practices. **Responsibilities:** - **Technical Leadership and Development:** - Lead the development, implementation, and maintenance of Power BI reports, dashboards, and analytical solutions. - Build and maintain complex data models, including data wa...

Job Description: You have 4-6 years of experience in the analytics domain, focusing on developing and deploying ML/AI solutions. Additionally, you have at least 1 year of experience working on NLP projects, particularly text mining, using LLMs, working with Hugging Face/Transformer models, and utilizing publicly available LLM APIs. Your level of understanding in machine learning and deep learning methods is proficient. You possess excellent programming skills in Python, Pandas, PySpark, and SQL. Your communication skills are top-notch, allowing you to effectively describe findings to both technical and non-technical audiences. Furthermore, you have a good knowledge of the MS Office suite, es...

As a Data Engineer, your role will involve designing, developing, and maintaining scalable and efficient data pipelines using PySpark and Databricks. You will be responsible for performing data extraction, transformation, and loading (ETL) from diverse structured and unstructured data sources. Additionally, you will develop and maintain data models, data warehouses, and data marts in Databricks. Key responsibilities for this role include: - Proficiency in Python, Apache Spark, and PySpark - Integrating third party data from multiple sources with internal data - Writing and optimizing complex SQL queries for high performance and scalability across large datasets - Collaborating closely with d...