2919 Data Bricks Jobs - Page 5

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Microsoft Azure Databricks Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data qualit...

About The Role Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : Microsoft Azure Analytics Services Good to have skills : Scala, Databricks Unified Data Analytics Platform, PySpark Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will design, build, and configure applications to meet business process and application requirements. A typical day involves collaborating with various teams to understand their needs, developing innovative solutions, and ensuring that application...

Technical Skill set: Having 3-5 years of experience in implementing Big Data solution in Cloud environments. Hands-on in implenting Big data solution using Airflow DAG,Spark,Python,Hive,Trino,S3 Bucket,etc Having experience Cloud Data platform like SnowFlake , Databricks is a plus. Knowledge of Financial domain-Credit Card industry is a plus. Responsibilites: Creating an ELT Data pipelines using python script and Airflow DAG. Optimizing the Data pipelines by configuring the Spark system resources Debug an existing Microsoft BI ETLs and understand business logic and convert in to big data pipeline using Airflow DAG. Able to interact with business partners to understand the requirements and pr...

Inviting applications for the role of Lead Consultant-Data Engineer, Azure+Python! Responsibilities Hands on experience with Azure, pyspark, and Python with Kafka Monitor and optimize the performance of cloud resources to ensure efficient utilization and cost-effectiveness. Implement and maintain security measures to protect data and systems within the Azure environment, including IAM policies, security groups, and encryption mechanisms. Develop application programs using Big Data technologies like Apache Hadoop, Apache Spark, etc Build data pipelines by building ETL processes (Extract-Transform-Load) Implement backup, disaster recovery, and business continuity strategies for cloud-based app...

Essential for this role: Education and Qualifications: • Bachelor’s degree in IT, Computer Science, Software Engineering, Business Analytics or equivalent. • Minimum seven plus years of experience in data analytics field • Experience with Azure/AWS Databricks • Experience in building and optimizing data pipelines, architectures and data sets • Excellent experience in Scala or Python, PySpark and SQL • Ability to troubleshoot and optimize complex queries on the Spark platform • Knowledgeable on structured and unstructured data design / modelling, data access and data storage techniques • Expertise in designing and deploying data applications on cloud solutions, such as Azure or AWS • Hands on...

Job Description: 8+ Yrs total experience in IT/Data Engineering projects & 5+ years of relevant experience- Strong coding skills in - Python, SQL, ADF, Databricks (PySpark, Delta live table, Live/structural data streaming, Unity Catalog, Performance Tuning of DLT pipelines with high volume of data processing , Cost Optimization of Databricks when DLT runs in live streaming on Photon, Serverless, non serverless)The candidate should be responsible, take ownership, self driven, dedication to achieve timeline. Should have great problem solving and analytical/reasoning capability,Technical skill with good mindset and behaviour is important good hands-on programming / scripting knowledge in Python...

Job Description: Position: Data Engineer Work Mode : Hybrid Location: Noida Primary Skills: Databricks, python, spark, sql, MLOps, BI

SQL + PLSQL + DWH + ETL + data bricks , python , snowflake, Azure. SAP Data Integration/ Supply Chain Domain Knowledge Consulting experience Very good communication and presentation skills Pre sales support experience, like responding RFP's, effort estimations. Overall 8-10 years of experience Location: Coimbatore,Kolkata,Bengaluru,Chennai,Hyderabad,Pune,Noida

Urgent Requirement Senior Azure Data Engineer - Microsoft Fabric Specialist Location: Noida Sector 62 (Onsite, Long-Term Project Full Time) Need Immediate Joiners Only Experience Required - 10 Years Key Responsibilities: Lead the design, development, and implementation of Fabric Pipelines, Data Flows , and ETL processes . Build and maintain Notebooks using PySpark / SQL for large-scale data processing. Perform SQL Data Modeling, Tuning, and Optimization for performance-efficient data solutions. Design and implement ETL workflows to move data from Fabric to on-premise systems . Develop and manage ADF / Databricks pipelines for data integration and transformation. Apply Medallion Architecture ...

We're seeking a Data Engineer with expertise in Neo4j and Databricks to design and optimize graph-based data pipelines. The ideal candidate will build scalable data solutions, enabling advanced analytics and knowledge graph applications.

This is an exciting opportunity for an experienced developer of large-scale data solutions. You will join a team delivering a transformative cloud hosted data platform for a key Version 1 customer. The ideal candidate will have a proven track record as a senior/self-starting data engineerin implementing data ingestion and transformation pipelines for large scale organisations. We are seeking someone with deep technical skills in a variety of technologies, Informatica, Talend, Azure Data Factory, Snowflake, Azure Synapse Analytics, or Amazon Redshift , to play an important role in developing and delivering early proofs of concept and production implementation. You will ideally haveexperience ...

Experience with databases like Databricks AND Reporting tools like Grafana, Tableau, Carto Scripting with Python Experience in running customer trials for new products/services Analyze performance data to identify the root cause for connectivity issues experienced by the mobile device users Regular report generation and presentations to the stakeholders and communicate complex data to non-technical audiences Familiarity with LTE and 5G wireless networks and Android device services like Google Firebase Troubleshoot and triage issues associated with Device/network and provide trial and post-production support Review Data for accuracy, inconsistencies , anomalies and, gather data from selected ...

PURPOSE OF THE JOB: The purpose of the job is to develop through iterative process data Integration and analytics solutions. Develop data products answering to Projects/Customer needs, from the data ingestion to ML productization. You will Build data analytics solutions, developing Data applications (Data ingestion, Cleaning, data processing, etc.) to provide state-of-the-art advanced analytic and quantitative tools and modelling techniques to derive business insights, solve complex business problems and improve decisions. Reporting to the Data Architect, the role will develop, support and advice on the day-to-day Data platform, Data processing and Data analytics requirements of Business are...

5+ years of overall BI experience, including 5+ years in Advanced Analytics, AI/ML, Gen AI, and Python (at an architect level with strong development skills) Deep expertise in Databricks and Azure Data Factory (architect-level) Capable of handling end-to-end processes including requirement gathering, design, build, deployment, and governance Experience with Power BI is preferred Remote role nearshore or offshore is acceptable Time & Materials model

The ideal candidate will be an experienced DevOps engineer with a strong proficiency in Azure technologies, including Azure Data Factory (ADF), Databricks, and Kubernetes We value quick learners who can adapt swiftly to new challenges and contribute effectively to our team

Power Platform Developer Job Summary Microsoft Power Platform Developer will be responsible for designing, developing, and maintaining applications and solutions using the Microsoft Power Platform, including MS Copilot Studio, Power Automate, Power Apps, Power Pages, Dataverse and Power BI Knowledge on M365, Azure Services and Tools (including Data Factory, Azure SQL, etc.) and SharePoint Development, Dynamic 365 Integration will be highly beneficial for this role Key Responsibilities Develop, Deploy and Maintain Solutions in Power Platform to address business needs and improve processes Work closely with business analysts, project managers, and other stakeholders to gather and understand re...

Design and implement scalable data processing solutions usingApache SparkandJava. Develop and maintain high-performance backend services and APIs. Collaborate with data scientists, analysts, and other engineers to understand data requirements. Optimize Spark jobs for performance and cost-efficiency. Ensure code quality through unit testing, integration testing, and code reviews. Work with large-scale datasets in distributed environments (e.g., Hadoop, AWS EMR, Databricks). Monitor and troubleshoot production systems and pipelines. Experience in Agile Development Process. Experience in leading a 3-5 member team on the technology front Excellent communication skills, problem solving and debugg...

Job Characteristics: Demonstrates full use and application of data science principles, methods, theories, and concepts to assignments where precedents may exist. Demonstrates working knowledge of other related disciplines. Provides solutions to a wide range of difficult problems through design and execution of data science research. Demonstrates ability and initiative to identify and explore novel approaches to data science solutions. Makes strong contributions to the exploration, refinement and deployment of data science solutions. Education/Work Experience: Degree or advanced degree in data science, mathematics, statistics, computer science or related field. BS and 6-8 years related experi...

Databricks Engineers with 2-6 years of hand-on experience in Pyspark, Cloud Platform and SQL. Proven experience in implementing data solutions on the Databricks platform withhands on experience in setting up Databricks cluster, working in Databricks modules,data pipelines for ingestingand transforming data from various sources into Databricks. Spark-based ETL workflows and data pipelines for data preparation and transformation within Databricks. Roles & Responsibilities Bachelors or Master's degree with 2-6 years of professional experience. Proven experience in implementing data solutions on the Databricks platform. Solid understanding of Databricks fundamentals and have hands on experience ...

Role Overview: As an AWS Snowflake DBT Developer at PWC AC, you will be responsible for architecting and delivering highly scalable, distributed, cloud-based enterprise data solutions. You will work on implementing Cloud data engineering solutions like Enterprise Data Lake and Data hub in AWS. Your role will involve hands-on experience with Snowflake utilities, SnowSQL, SnowPipe, ETL data Pipelines, and Big Data model techniques using Python/Java. Additionally, you will be expected to deploy Snowflake features, ensure data security and access controls, and design relational as well as NoSQL data stores. Key Responsibilities: - Architect and deliver highly scalable, distributed, cloud-based e...

?? Location: Hyderabad, India ?? Experience: 2–4 Years ?? Employment Type: Full-time ?? About the Role We are looking for a highly motivated Data Engineer with hands-on expertise in Databricks , PySpark , and SQL . This role involves designing and building large-scale data pipelines, transforming complex datasets, and collaborating closely with cross-functional teams to deliver impactful business solutions. ?? Job Responsibilities Design, develop, and maintain data pipelines and data processing solutions on the Databricks platform. Build and optimize Spark applications using PySpark for efficient data ingestion, transformation, and analysis. Work with large and complex datasets to perform ad...

ROLE : DATA ENGINEER Shift : 6 PM to 3 AM Employment Type : Permanent Role Work Mode: Onsite We are presently looking to fill the Data Engineer position. Below, you'll find the job description for the role. When reviewing resumes, please ensure that candidates have experience with Databricks listed on their resume. Role Overview: As a Data Engineer, you will be responsible for designing, building, and maintaining our data infrastructure, ensuring its scalability, reliability, and efficiency. You will work closely with cross-functional teams to understand data requirements, develop ETL pipelines, and implement solutions for data processing, storage, and analysis. Key Responsibilities: Design,...

Dear, Hope you are doing well. We have an immediate need for Azure Data Engineers all 5 Days Onsite at Office from Pune location and need someone to start Immediate. Send resumes to manju@nam-it.com Role : Azure Data Engineer with Data Lake and Azure Ceritification is a must Location : Pune 5 Days Onsite Project Skills: 8-10 years max Total IT Expeirence required Hands on Azure Databricks, Data Lake Concepts, Product extract from Oracle and SAP Hands on Medallion Architecture Hands on Data Migration and Data Integration experience. Must have strong expeirence wtih Pyspark, Datawarehousing, Manjunath Staffing Manager NAM Info Pvt Ltd, 29/2B-01, 1st Floor, K.R. Road, Banashankari 2nd Stage, Ba...

As a Senior Data Scientist focusing on Autonomous Networks at Nokia, you will be a key player on a dynamic team dedicated to revolutionizing telecom services through AI and machine learning. You will work closely with cross-functional teams, including engineers, product managers, and executive stakeholders, to design and implement cutting-edge data-driven solutions tailored for Communication Service Providers. You will engage directly with customers to understand their needs and drive the deployment of scalable AI/ML use cases that enhance network efficiency and performance. You have: Bachelors/Masters in Computer Science, Statistics, Data Science, Mathematics, or a related field. 15+ years ...

Strong programming skills, Understanding of fundamental statistical concepts, Experience in Azure ML / Data Bricks / Azure Kubernetes Service. • Basic knowledge around MLFlow, Kubeflow, Tensorboard, Azure Application Insights Role & responsibilities Preferred candidate profile