4749 Data Bricks Jobs - Page 24

What your main responsibilities are: Lead and implement advanced analytical processes through data/text mining, model development, and prediction to enable informed business decisions. Apply sound analytical expertise to examine structured and unstructured data from multiple disparate sources to provide insights and recommend high-quality solutions to leadership across levels. Plan initiatives from concept to execution with minimal supervision and communicate results to a broad range of audiences. Develops a superior understanding of Customer Experience touch points through internal and external sources to creatively solve business problems and lead the team from concept to execution of proj...

We are looking for a skilled Big Data Engineer with 6 to 22 years of experience. The ideal candidate will have expertise in Pyspark, Azure Data Bricks, and workflows. This position is available as a contract role across Pan India. Roles and Responsibility Design and develop scalable big data systems using Pyspark and Azure Data Bricks. Implement and manage workflows for efficient data processing. Collaborate with cross-functional teams to integrate data from various sources. Develop and maintain large-scale data pipelines and architectures. Optimize system performance and troubleshoot issues. Ensure data quality and integrity through data validation and testing procedures. Job Requirements S...

We are looking for a skilled Data Engineer with 6-12 years of experience to design, develop, and maintain scalable data pipelines using Databricks, PySpark, Spark SQL, and Delta Live Tables. The ideal candidate will have a strong understanding of data warehousing concepts, ETL processes, and data modeling. Roles and Responsibility Design, develop, and maintain scalable data pipelines using Databricks, PySpark, Spark SQL, and Delta Live Tables. Collaborate with cross-functional teams to understand data requirements and translate them into efficient data models and pipelines. Implement best practices for data engineering, including data quality and security. Optimize and troubleshoot complex d...

Experience: 5+ Years Skill: ITSS- Senior Azure Developer / Data Engineer Notice Period:Immediate. Employment Type: Contract Working Mode: Hybrid Job Description Loc - Bangalore , Hyd, Chennai and Noida Experience: Mid-Level Primary Skillsets: Azure (ADF/ADLS/Key vaults) Secondary Skillsets: Databricks Good to have Skillsets: Ability to communicate well Experience in cloud applications, especially in Azure (basically things covered in Primary skillsets listed below) Work in agile framework Experience in ETL, SQL, PySpark Run with a task without waiting for direction all the time Experience with git repository and release pipelines. Any certifications on Azure Any certification on Databricks w...

Skill:Data Engineer Notice Period:Immediate. Employment Type: Contract Job Description : Experience in Cloud platform, e.g., AWS, GCP, Azure, etc. Experience in distributed technology tools, viz. SQL, Spark, Python, PySpark, Scala Performance Turing Optimize SQL, PySpark for performance Airflow workflow scheduling tool for creating data pipelines GitHub source control tool & experience with creating/ configuring Jenkins pipeline Experience in EMR/ EC2, Databricks etc. DWH tools incl. SQL database, Presto, and Snowflake Streaming, Serverless Architecture .

Role & responsibilities Good understanding of ETL , BI and DW technologies. • Design, implement, and maintain data pipelines for data ingestion, processing, and transformation in Azure and Medallion Architecture is a must. • Work together with data scientists and analysts to understand the needs for data and create effective data workflows. • Create and maintain data storage solutions including Azure SQL Database, Azure Data Lake, and Azure Blob Storage. • Utilizing Azure Data Bricks to create and maintain ETL (Extract, Transform, Load) operations. • Implementing data validation and cleansing procedures will ensure the quality, integrity, and dependability of the data. • Improve the scalabil...

Deployment, configuration & maintenance of Databricks cluster Role-based access controls (RBAC), manage Unity Catalog, &configure service principal Cluster health, optimize resource utilization Azure Data Lake, Key Vault, &implement CI/CD pipeline Required Candidate profile Azure, Python, PySpark, PowerShell & SQL Terraform for provisioning & managing cloud resource ETL processes, data pipeline, & big data technologies Data security principles, compliance requirement

Responsibilities: Design, develop, and maintain data processing pipelines using Databricks on the Azure platform. Collaborate with data engineers, data scientists, and other stakeholders to optimize workflows and ensure data quality. Implement ETL processes to extract, transform, and load data from various sources. Work with Spark SQL and Databricks notebooks to analyze and transform data. Ensure efficient data flow across diverse systems. Provide technical guidance to teams and anchor proof-of-concept projects. Responsible to assemble large, complex sets of data that meet non-functional and functional business requirements. Responsible to identify, design and implement internal process impr...

Core skills required for the role : Databricks Level: Advanced SQL (MSSQL Server) Joins, SQ optimization, basic knowledge of StoredProcedure, Functions PySpark Level: Advanced Azure Delta lake Python Basic Mandatory Competencies Big Data - Big Data - Pyspark Data Science and Machine Learning - Data Science and Machine Learning - Databricks Cloud - Azure - Azure Data Factory (ADF), Azure Databricks, Azure Data Lake Storage, Event Hubs, HDInsight Database - Sql Server - DBA Data Science and Machine Learning - Data Science and Machine Learning - Python

The Principal Data Engineer will be a senior individual contributor responsible for designing, building, and optimizing advanced data solutions that power enterprise-wide analytics, AI/ML, and data-driven decision-making. Reporting directly to the Senior Director of Data Platforms, this role will serve as a technical expert and thought partner in scaling modern data architectures, enabling AI orchestration, and delivering robust, secure, and compliant data products. This position is highly hands-on, requiring expertise in data engineering, Databricks, Python, AI/ML platforms, and orchestration frameworks. The Principal Engineer will work across functional teams to design and implement high-p...

Job Position : Senior Data Scientist Years of Exp : 5+ Yrs Mode of Working : Remote [Travel to Chennai office 1 week every 3 months] Technical Skills Strong hands-on experience with PySpark and Databricks data processing and modelling. Solid foundation in Regression modelling , statistical analysis , and model performance evaluation. Comfortable working with SQL systems and structured/unstructured data pipelines. Proficiency in Excel for quick analytical checks, and PowerPoint for developing clear, executive-friendly insights and presentations. Strong analytical mindset and exceptional problem-solving skills to translate data into actionable business strategies. Good to Have Skills Exposure ...

The Role Addepar is seeking a highly skilled and motivated Software Development Engineer in Test (SDET) - IC3 to be a hands-on in quality for our wealth management solutions. This is a crucial individual contributor role where you will design, implement, and drive the quality engineering processes necessary to ensure our trading application is delivered on time and with exceptional quality and reliability. You will act as the quality expert, working strategically with diverse internal teams including Engineering, Product, Solutions Architecture, Data Solutions, and the Release Team. Your primary focus will be high-leverage technical contributions, driving automation, and owning the quality s...

We are looking for a skilled Senior Azure Developer with 5-9 years of experience to join our team in India. The ideal candidate will have expertise in designing and implementing scalable, secure, and efficient cloud-based solutions on Microsoft Azure. Roles and Responsibility Design, develop, and deploy large-scale Azure applications using various technologies such as .NET, Java, Python, and C#. Collaborate with cross-functional teams to identify business requirements and design solutions that meet those needs. Develop and maintain high-quality code that is well-documented, follows best practices, and adheres to industry standards. Troubleshoot complex technical issues and provide timely res...

Here is the job description for Data Engineer resources we are looking for: Key Responsibilities: Lead Data Engineering Projects: Oversee the development and deployment of end-to-end data ingestion pipelines using Azure Databricks, Apache Spark, and related technologies, ensuring scalability, performance, and efficiency. Design & Architecture: Design high-performance, resilient, and scalable data architectures for data ingestion and processing using best practices for Azure Databricks and Spark. Team Leadership: Provide technical guidance and mentorship to a team of data engineers, fostering a culture of collaboration, continuous learning, and innovation. Collaboration: Work closely with dat...

Job description Job Title: Azure Datalake Engineer (Azure Datafactory, Python Pyspark ) Location: Pune (Viman Nagar) Experience: 4 yrs - 7 yrs Employment Type: Full-Time Key Roles Databricks Development: Build and manage Databricks notebooks using SQL and PySpark within a reusable framework. ETL Development: Design and maintain data integration pipelines in Azure Data Factory. Database Proficiency: Strong knowledge of SQL and experience with relational databases like SQL Server, MySQL, etc. CI/CD & Release Management: Utilize DevOps pipelines for code versioning, automated testing, and release. Cloud Platform: Should have worked in Azure cloud services and architecture best practices. Key Re...

A Data Engineer to design and implement a scalable data platform using Databricks. Must have strong expertise in building modern data architectures, integrating diverse data sources (SQL Server, MongoDB, InfluxDB) & enabling analytics.

Role & responsibilities Design, train, and deploy scalable machine learning and deep learning models . Build end-to-end ML pipelines data ingestion, feature engineering, training, validation, deployment. Work on NLP, computer vision, predictive analytics , and GenAI (LLM fine-tuning) . Collaborate across teams to embed AI solutions into enterprise applications. Leverage Databricks, Snowflake, AWS SageMaker, Azure ML , or GCP Vertex AI . Apply MLOps best practices using MLflow, Kubeflow, Airflow , etc. Preferred candidate profile Immediate joiners can send CV to aman.a@acesoftlabs.com Follow/connect me on linkedln : https://www.linkedin.com/in/aman-b056091b1/

Key Skills: ETL, Python, Data Bricks, SQL Roles and Responsibilities: Design and implement end-to-end data pipelines using Python and Airflow. Develop high-performance SQL queries for data extraction, transformation, and reporting. Automate and modularize ETL workflows with Python scripting and reusable Airflow DAGs. Utilize AWS services (S3, Glue, Redshift, Aurora RDS, CloudWatch) for scalable data solutions. Integrate and transform data from multiple sources such as Alteryx, PostgreSQL, Oracle, and PL/SQL into unified models. Ensure data pipelines are scalable, secure, and optimized for analytics and reporting needs. Collaborate with cross-functional teams to support data-driven decision-m...

As a Cloud Data Engineer at our company, you will be responsible for working with Azure, Python, Data bricks, and Azure Data Factory. With over 8 years of experience in Azure and 5 years of experience in Azure Data Factory, you will have the opportunity to contribute your expertise in a dynamic work environment. **Key Responsibilities:** - Utilize your expertise in Azure, Python, Data bricks, and Azure Data Factory to design, develop, and implement cloud data solutions. - Collaborate with cross-functional teams to ensure the successful delivery of data engineering projects. - Optimize data pipelines and workflows for improved efficiency and performance. - Stay updated on the latest trends an...

As a member of the core Product Management team at Infors Technology Platform, Infor OS, your role will involve working on Infors Data strategy, focusing on Data Fabric, Streaming Technologies, Data Catalogue, Data ledger, and Data ingestion & extraction services. You will be responsible for gathering requirements from internal and external stakeholders, establishing relationships, and driving adoption. Additionally, you will collaborate with industry analysts and customers to understand the latest Data trends, contribute to product vision and direction, and ensure detailed vision realization in partnership with engineering. Your responsibilities will also include product releases, adherence...

As a Sr Associate Data Analytics Lead, you will be responsible for the following: - Implementing data pipelines - Hands-on development experience in Spark and DataBricks pipeline - Optimization of DataBricks pipeline - Working with AWS services - Utilizing ElasticSearch effectively - Demonstrating strong SQL knowledge and Query Optimization skills - Familiarity with REST API - Leading individual projects using AGILE methodologies - Managing a team of developers through effective planning and execution - Collaborating with product management and business users to define product roadmap - Brainstorming solutions for team productivity, efficiency, and training - Creating tools and systems to en...

We are seeking an experienced AWS Databricks Developer to design, develop, and maintain scalable data processing and analytics solutions on the AWS and Databricks platform. The ideal candidate will have strong expertise in building data pipelines, optimizing performance, and integrating multiple AWS services to deliver high-quality data solutions. Key Responsibilities: Overall, 5 to 8 years of experience in IT Industry. Min 6 years of experience working on Data Engineering. Design and develop solution in combination of Cloudera, Palantir and Databricks. Develop Python-based automation scripts to optimize workflows and processes. Integrate Databricks with AWS ecosystem components such as S3, ...

Primary Responsibilities: Work with BI team to build and deploy healthcare data enrichments Design and develop high performance reporting models and dashboards using Power BI/MS Fabric Deploy and manage the Power BI dashboard using Power BI service Ensure connectivity with various sources flat files, on-prem databases, Snowflake, Databricks using Live, Direct Query and Import connections Design and develop Azure Databricks jobs using Python & Spark Develop and maintain CI/CD processes using Jenkins, GitHub, Maven Maintain high quality documentation of data definitions, transformations, and processes to ensure data governance and security Continuously explore new Azure, Power BI features and ...

Role & responsibilities 8+ years of experience as a Data Engineer, with a focus on Databricks and cloud-based data platforms, with a minimum of 4 years of experience in writing unit/end-to-end tests for data pipelines and ETL processes on Databricks. Hands-on experience in PySpark programming for data manipulation, transformation, and analysis. Strong experience in SQL and writing complex queries for data retrieval and manipulation. Experience in Docker for containerising and deploying data engineering applications is good to have. Strong knowledge of the Databricks platform and its components, including Databricks notebooks, clusters, and jobs. Experience in designing and implementing data ...

Project Role : Data Platform Engineer Project Role Description : Assists with the data platform blueprint and design, encompassing the relevant data platform components. Collaborates with the Integration Architects and Data Architects to ensure cohesive integration between systems and data models. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : NAMinimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Platform Engineer, you will assist with the data platform blueprint and design, collaborating with Integration Architects and Data Architects to ensure cohesive integration between systems and da...