1265 Azure Databricks Jobs - Page 41

Skillls : Azure data bricks, sql, pyspark, Python

Hiring Azure Data Engineer Azure DE - Skills- Azure, Azure data factory, databricks, pyspark, SQL Exp- 5-10 yrs

Required Skills (Technical):- Advanced knowledge of statistical techniques, NLP, machine learning algorithms and deep learning frameworks like TensorFlow, Theano, Keras, Pytorch. Knowledge of work with Pyspark is a must. (Working with Azure Databricks platform is preferred) Advanced knowledge in handling Time Series Data and modelling it with time series algorithms. Knowledge of working with Geospatial data would be preferable. Proficiency with modern statistical modelling (regression, boosting trees, random forests, etc.), machine learning (text mining, neural network, NLP, etc.), optimization (linear optimization, nonlinear optimization, stochastic optimization, etc.) methodologies. Build complex predictive models using ML and DL techniques with production quality code and jointly own complex data science workflows with the Data Engineering team. Familiar with modern data analytics architecture and data engineering technologies (SQL and No-SQL databases). Knowledge of REST APIs and Web Services 6. Experience with Python, R, sh/bash Required Skills (Non-Technical):- Fluent in English Communication (Spoken and verbal) Should be a team player Should have a learning aptitude Detail-oriented, analytically. Extremely organized with strong time-management skills Problem Solving & Critical Thinking Require Work Location :Remote , hyderabad,ahmedabad,pune,chennai,kolkata. Work Timing : 2:30 PM to 11:30 PM IST

Full time with top German MNC for location Bangalore Key Competencies: At least 6 years of experience in large scale Python Software development(other object oriented language are also acceptable) At least 2-3 years of Azure Databricks Cloud experience in Data Engineering. Experience of Delta table, ADLS, DBFS, ADF. Deep level of understanding in distribution systems for data storage and processing (Eg Kafka, Pyspark , Azure cloud) Experience with Cloud based SQL Database, Azure, SQL Editor Excellent Software Engineering Skills( Eg i.e data structures, algorithums, software design) Excellent problem Solving, investigative and troubleshooting skills Experience with CI/CD tools such as Azure Devops Ability to work independently Soft Skills: Good Communication Skills Ability to Coach and Guide young Data Engineers Decent Level in English as Business Language

Should have a B.E./B.Tech/MCA/MBA in Finance, Information Systems, Computer Science or a related field 5-7 years of experience as a Data and Cloud architecture with client stakeholders Understand and review PowerShell (PS), SSIS, Batch Scripts, and C# (.NET 3.0) codebases for data processes. Assess complexity of trigger migration across Active Batch (AB), Synapse, ADF, and Azure Databricks (ADB). Evaluate the data governance framework and Power BI environment. Provide recommendations for enhancing data quality, and discoverability, and optimize Power BI performance. Define usage of Azure SQL DW, SQL DB, and Data Lake (DL) for various workloads, proposing transitions where beneficial. Analyze data patterns for optimization, including direct raw-to-consumption loading and zone elimination (e.g., stg/app zones). Understand requirements for external tables (Lakehouse) Excellent communication skills, both written and verbal Extremely strong organizational and analytical skills with strong attention to detail Strong track record of excellent results delivered to internal and external clients Able to work independently without the needs for close supervision and collaboratively as part of cross-team efforts Experience with delivering projects within an agile environment Experience in project management and team management

Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Microsoft Azure Data Services Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will design, build, and configure applications to meet business process and application requirements. You will be responsible for ensuring the smooth functioning of applications and providing solutions to work-related problems. A typical day in this role involves collaborating with team members, analyzing business requirements, and developing and implementing application solutions. You will also actively participate in team discussions and contribute to providing solutions to work-related problems, becoming a subject matter expert in your field. Roles & Responsibilities: Expected to perform independently and become an SME. Required active participation/contribution in team discussions. Contribute in providing solutions to work-related problems. Collaborate with team members to analyze business requirements. Design and develop applications based on business process and application requirements. Configure applications to ensure smooth functioning and optimal performance. Troubleshoot and debug application issues to ensure proper functionality. Collaborate with cross-functional teams to integrate applications with other systems. Stay updated with emerging technologies and industry trends to enhance application development processes. Professional & Technical Skills: Must To Have Skills:Proficiency in Microsoft Azure Data Services. Good To Have Skills:Experience with cloud-based application development. Strong understanding of data storage and management in Azure. Experience with Azure SQL Database, Azure Cosmos DB, and Azure Data Lake Storage. Hands-on experience with Azure Data Factory and Azure Databricks. Knowledge of Azure Functions and Azure Logic Apps for application integration. Additional Information: The candidate should have a minimum of 3 years of experience in Microsoft Azure Data Services. This position is based at our Bengaluru office. A 15 years full-time education is required. Qualifications 15 years full time education

What this job involves: JLL, an international real estate management company, is seeking an Data Engineer to join our JLL Technologies Team. We are seeking candidates that are self-starters to work in a diverse and fast-paced environment that can join our Enterprise Data team. We are looking for a candidate that is responsible for designing and developing of data solutions that are strategic for the business using the latest technologies Azure Databricks, Python, PySpark, SparkSQL, Azure functions, Delta Lake, Azure DevOps CI/CD. Responsibilities Design, Architect, and Develop solutions leveraging cloud big data technology to ingest, process and analyze large, disparate data sets to exceed business requirements. Design & develop data management and data persistence solutions for application use cases leveraging relational, non-relational databases and enhancing our data processing capabilities. Develop POCs to influence platform architects, product managers and software engineers to validate solution proposals and migrate. Develop data lake solution to store structured and unstructured data from internal and external sources and provide technical guidance to help migrate colleagues to modern technology platform. Contribute and adhere to CI/CD processes, development best practices and strengthen the discipline in Data Engineering Org. Develop systems that ingest, cleanse and normalize diverse datasets, develop data pipelines from various internal and external sources and build structure for previously unstructured data. Using PySpark and Spark SQL, extract, manipulate, and transform data from various sources, such as databases, data lakes, APIs, and files, to prepare it for analysis and modeling. Build and optimize ETL workflows using Azure Databricks and PySpark. This includes developing efficient data processing pipelines, data validation, error handling, and performance tuning. Perform the unit testing, system integration testing, regression testing and assist with user acceptance testing. Articulates business requirements in a technical solution that can be designed and engineered. Consults with the business to develop documentation and communication materials to ensure accurate usage and interpretation of JLL data. Implement data security best practices, including data encryption, access controls, and compliance with data protection regulations. Ensure data privacy, confidentiality, and integrity throughout the data engineering processes. Performs data analysis required to troubleshoot data related issues and assist in the resolution of data issues. Experience & Education Minimum of 4 years of experience as a data developer using Python, PySpark, Spark Sql, ETL knowledge, SQL Server, ETL Concepts. Bachelors degree in Information Science, Computer Science, Mathematics, Statistics or a quantitative discipline in science, business, or social science. Experience in Azure Cloud Platform, Databricks, Azure storage. Effective written and verbal communication skills, including technical writing. Excellent technical, analytical and organizational skills. Technical Skills & Competencies Experience handling un-structured, semi-structured data, working in a data lake environment, leveraging data streaming and developing data pipelines driven by events/queues Hands on Experience and knowledge on real time/near real time processing and ready to code Hands on Experience in PySpark, Databricks, and Spark Sql. Knowledge on json, Parquet and Other file format and work effectively with them No Sql Databases Knowledge like Hbase, Mongo, Cosmos etc. Preferred Cloud Experience on Azure or AWS Python-spark, Spark Streaming, Azure SQL Server, Cosmos DB/Mongo DB, Azure Event Hubs, Azure Data Lake Storage, Azure Search etc. Team player, Reliable, self-motivated, and self-disciplined individual capable of executing on multiple projects simultaneously within a fast-paced environment working with cross functional teams. What we can do for you: Youll join an entrepreneurial, inclusive culture. One where we succeed together across the desk and around the globe. Where like-minded people work naturally together to achieve great things. Our Total Rewards program reflects our commitment to helping you achieve your ambitions in career, recognition, well-being, benefits and pay. Join us to develop your strengths and enjoy a fulfilling career full of varied experiences. Keep those ambitions in sights and imagine where JLL can take you. Scheduled Weekly Hours: 40

Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Microsoft Azure Databricks Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : Any Btech Degree Summary :As an Application Developer, you will design, build, and configure applications to meet business process and application requirements. You will be responsible for creating efficient and scalable applications using Microsoft Azure Databricks. Your typical day will involve collaborating with the team to understand business requirements, designing and developing applications, and ensuring the applications meet quality standards and performance expectations. Roles & Responsibilities: Expected to perform independently and become an SME. Required active participation/contribution in team discussions. Contribute in providing solutions to work-related problems. Collaborate with the team to understand business requirements and translate them into technical specifications. Design, develop, and test applications using Microsoft Azure Databricks. Ensure the applications meet quality standards and performance expectations. Troubleshoot and debug applications to identify and resolve issues. Provide technical guidance and support to junior developers. Stay updated with the latest industry trends and technologies related to application development. Professional & Technical Skills: Must To Have Skills:Proficiency in Microsoft Azure Databricks. Strong understanding of statistical analysis and machine learning algorithms. Experience with data visualization tools such as Tableau or Power BI. Hands-on implementing various machine learning algorithms such as linear regression, logistic regression, decision trees, and clustering algorithms. Solid grasp of data munging techniques, including data cleaning, transformation, and normalization to ensure data quality and integrity. Additional Information: The candidate should have a minimum of 3 years of experience in Microsoft Azure Databricks. This position is based at our Hyderabad office. A Any Btech Degree is required. Qualification Any Btech Degree

Proficiency in SQL and other data query languages Experience with Azure data storage solutions such as Azure SQL Database, Azure Cosmos DB, and Azure Data Lake Storage Knowledge of data integration tools such as Azure Data Factory and Azure Databricks Understanding of data modeling and schema design principles Ability to work with large datasets and perform data analysis

Design and implement data solutions using Microsoft Azure and Databricks platforms. You will work with cloud-based tools for data engineering, analysis, and machine learning. Expertise in Azure, Databricks, and cloud data solutions is required.

Exp - 4 to 12 Years Role - Azure Data Engineer Position - Permanent FTE Company - Data Analytics MNC Locations - Pune, Hyderabad, Bengaluru Mode - Hybrid (2-3 days from office) MUST HAVE - - Very Strong Python Coding skills of atleast 3 years hands-on - Excellent SQL skills of atleast 3 years hands-on - Strong PySpark skills - In Depth hands-on experience in Azure Databricks & Data Factory - Strong knowledge of Datawarehouse Important Note - Candidates must have PF in all companies worked thought out career and under One UAN.

Skill & Experience Mandatory Skills: Azure Cloud Platform, Azure services including advanced knowledge of Azure Databricks, Hive Metastore, and Presto, Azure Kubernetes Service (AKS) Terraform, Ansible, Azure DevOps tools, Azure Databricks, GitHub Strong experience with Azure services, including advanced knowledge of Azure Databricks, Hive Metastore, and Presto. Basic understanding of Azure Kubernetes Service (AKS) is required. Proficiency in Terraform and Ansible for infrastructure management is a plus. 4+ years of experience in cloud technologies, including at least 3 years working with Azure Databricks and data management technologies. Demonstrated experience in managing and optimizing large-scale data processing environments. Excellent problem-solving skills with the ability to optimize and manage complex cloud environments. Proficiency in using Azure DevOps for CI/CD pipelines and GitHub for version control. Microsoft Certified: Azure Solutions Architect Expert (AZ-305) or equivalent advanced certification is preferred. Additional certifications in Azure Databricks or related data technologies are a plus. Azure Databricks Management Hive Metastore Management Presto Operations Automation & CI/CD Optimization & Performance Security & Compliance Documentation & Handoverto-date handover Knowledge Sharingtheir Stakeholder Communication Continuous Improvement

The Azure Data Factory role involves working with relevant technologies, ensuring smooth operations, and contributing to business objectives. Responsibilities include analysis, development, implementation, and troubleshooting within the Azure Data Factory domain.

The Azure Data Engineer With Azure Data bricks & Azure Data Factory role involves working with relevant technologies, ensuring smooth operations, and contributing to business objectives. Responsibilities include analysis, development, implementation, and troubleshooting within the Azure Data Engineer With Azure Data bricks & Azure Data Factory domain.

We have job opening for Azure Databricks with Tier 1 company.

We are seeking a skilled Azure Data Engineer to join our growing data engineering team. The ideal candidate will be responsible for designing, building, and maintaining scalable data Key Responsibilities: Design and develop robust, scalable, and high-performance data pipelines using Azure Data Factory , Python or pyspark , and Azure Databricks . Integrate data from various sources including APIs, flat files, and on-premises databases. Optimize data pipelines for performance, scalability, and cost-efficiency. Develop and enforce data quality, data governance, and security standards. Collaborate with cross-functional teams including data scientists, analysts, and business units to understand requirements and deliver data solutions. Monitor and troubleshoot production pipelines and ETL/ELT processes. Stay up to date with the latest trends and best practices in cloud data engineering and Azure services.

Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : Microsoft Azure Databricks Good to have skills : NAMinimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact. Your typical day will involve collaborating with various teams to ensure that application development aligns with business objectives, overseeing project timelines, and facilitating communication among stakeholders to drive project success. You will also engage in problem-solving activities, providing guidance and support to your team while ensuring that best practices are followed throughout the development process. Roles & Responsibilities:- Expected to be an SME.- Collaborate and manage the team to perform.- Responsible for team decisions.- Engage with multiple teams and contribute on key decisions.- Provide solutions to problems for their immediate team and across multiple teams.- Mentor junior team members to enhance their skills and knowledge.- Continuously assess and improve team processes to increase efficiency. Professional & Technical Skills: - Must To Have Skills: Proficiency in Microsoft Azure Databricks.- Strong understanding of cloud computing concepts and architecture.- Experience with data integration and ETL processes.- Familiarity with data analytics and visualization tools.- Ability to troubleshoot and optimize application performance. Additional Information:- The candidate should have minimum 7.5 years of experience in Microsoft Azure Databricks.- This position is based at our Bengaluru office.- A 15 years full time education is required. Qualification 15 years full time education

Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : Microsoft Azure Databricks Good to have skills : NAMinimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact. Your typical day will involve collaborating with various teams to ensure that application development aligns with business objectives, overseeing project timelines, and facilitating communication among stakeholders to drive project success. You will also engage in problem-solving activities, providing guidance and support to your team while ensuring that best practices are followed throughout the development process. Your role will be pivotal in ensuring that applications meet both functional and technical requirements, ultimately contributing to the overall success of the organization. Roles & Responsibilities:- Expected to be an SME.- Collaborate and manage the team to perform.- Responsible for team decisions.- Engage with multiple teams and contribute on key decisions.- Provide solutions to problems for their immediate team and across multiple teams.- Facilitate training and mentorship for junior team members to enhance their skills and knowledge.- Monitor project progress and implement necessary adjustments to ensure timely delivery. Professional & Technical Skills: - Must To Have Skills: Proficiency in Microsoft Azure Databricks.- Good To Have Skills: Experience with cloud computing platforms and services.- Strong understanding of application development methodologies.- Experience in managing application lifecycle and deployment processes.- Familiarity with data integration and ETL processes. Additional Information:- The candidate should have minimum 7.5 years of experience in Microsoft Azure Databricks.- This position is based at our Bengaluru office.- A 15 years full time education is required. Qualification 15 years full time education

Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : Microsoft Azure Databricks Good to have skills : NAMinimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact. You will be responsible for overseeing the application development process and ensuring successful project delivery. Roles & Responsibilities:- Expected to be an SME- Collaborate and manage the team to perform- Responsible for team decisions- Engage with multiple teams and contribute on key decisions- Provide solutions to problems for their immediate team and across multiple teams- Lead the application development process- Ensure successful project delivery Professional & Technical Skills: - Must To Have Skills: Proficiency in Microsoft Azure Databricks- Strong understanding of cloud computing concepts- Experience in designing and implementing scalable applications on Azure- Knowledge of data engineering and data processing techniques- Hands-on experience with big data technologies Additional Information:- The candidate should have a minimum of 5 years of experience in Microsoft Azure Databricks- This position is based at our Bengaluru office- A 15 years full-time education is required Qualification 15 years full time education

Mandatory Skills - Azure Databricks

Experience: 3-6 Years JD: The role will leverage & enhance existing technologies in the area of Data and analytics Solutions like Power BI, Azure data engineering technologies, Teradata/Snowflake, and other Azure services. The role will be responsible for developing and supporting IT products and solutions using these technologies and deploying them for business users Technical Requirements: 3 to 6 Years of IT & Azure Data engineering technologies experience Prior experience in ETL, data pipelines, and data flow techniques using Azure Data Services Working experience in Python, Py Spark, Azure Data Factory, Azure Data Lake Gen2, Databricks, Azure Synapse, and file formats like JSON & Parquet. Experience in creating ADF Pipelines to source and process data sets. Experience in creating Databricks notebooks to cleanse, transform, and enrich data sets. Development experience in the orchestration of pipelines Good understanding of SQL, Databases, and data warehouse systems, preferably Teradata Experience in deployment and monitoring techniques Working experience with Azure DevOps CI/CD pipelines to deploy Azure resources. Experience in handling operations/Integration with source repository Must have good knowledge of Data Warehouse concepts and Data Warehouse modelling. Working knowledge of SNO, M, S, including resolving incidents, handling Change requests /Service requests, and reporting on metrics to provide insights. Collaborate with the project team to understand tasks to model tables using data warehouse best practices and develop data pipelines to ensure the efficient delivery of data. Non-technical requirement: Work with project leaders to model tables using data warehouse best practices and develop data pipelines to ensure the efficient delivery of data. Think and work agile, from estimation to development, including testing, continuous integration, and deployment. Manage numerous project tasks concurrently and strategically, prioritizing when necessary. Proven ability to work as part of a virtual team of technical consultants working from different locations (including onsite) around project delivery goals. Technologies: Azure data factory Azure Data bricks Azure Synapse PySpark/SQL ADLS, BLOB Azure DevOps with CI/CD implementation. Nice to have skill sets: Business Intelligence tools (preferred Power BI) DP-203 Certified. Note: The budget is inclusive of GST 3 interview rounds

Hiring for Microsoft Azure Developer with experience range 2 years & above Mandatory Skills: Microsoft Azure Education: BE/B.Tech/MCA/M.Tech/MSc./MS Interview Mode-F2F

Hiring for Microsoft Azure Developer with experience range 2 years & above Mandatory Skills: Azure stack, Azure Data Factory, Azure Databricks, Azure Synapse, Azure Developer, Azure Education: BE/B.Tech/BCA/MCA/M.Tech/ME/BSC/MSC Location: PAN INDIA

JOB DESCRIPTION: 5+ Years of experience using Azure. Strong proficiency in Databricks. Experience with Pyspark. Proficiency in SQL or TSQL. Experience in Azure service components like Azure data factory, Azure data lake, Databricks, SQL DB SQL Server. Databricks Jobs for efficient data processing ETL tasks and report generation. Hands on experience with scripting languages such as Python for data processing and manipulation. Key responsibilities: Leverage Databricks to set up scalable data pipelines that integrate with a variety of data sources and cloud platforms Participate in code and design reviews to maintain high development standards. Optimize data querying layers to enhance performance and support analytical requirements. Should be able to develop end to end automations in Azure stack for ETL workflows data quality validations. Role & responsibilities Preferred candidate profile

Utilizes software engineering principles to deploy and maintain fully automated data transformation pipelines that combine a large variety of storage and computation technologies to handle a distribution of data types and volumes in support of data architecture design. A Senior Data Engineer designs and oversees the entire data infrastructure, data products and data pipelines that are resilient to change, modular, flexible, scalable, reusable, and cost effective. Key Responsibilities : Oversee the entire data infrastructure to ensure scalability, operation efficiency and resiliency. - Mentor junior data engineers within the organization. - Design, develop, and maintain data pipelines and ETL processes using Microsoft Azure services (e.g., Azure Data Factory, Azure Synapse, Azure Databricks, Azure Fabric). - Utilize Azure data storage accounts for organizing and maintaining data pipeline outputs. (e.g., Azure Data Lake Storage Gen 2 & Azure Blob storage). - Collaborate with data scientists, data analysts, data architects and other stakeholders to understand data requirements and deliver high-quality data solutions. - Optimize data pipelines in the Azure environment for performance, scalability, and reliability. - Ensure data quality and integrity through data validation techniques and frameworks. - Develop and maintain documentation for data processes, configurations, and best practices. - Monitor and troubleshoot data pipeline issues to ensure timely resolution. - Stay current with industry trends and emerging technologies to ensure our data solutions remain cutting-edge. - Manage the CI/CD process for deploying and maintaining data solutions. Keywords: ETL,Data Pipeline,Data Quality,Data Analytics,Data Modeling,Azure Databricks,Synapse Analytics,Azure Data Factory,Data Validation,Data Engineering*