2404 Azure Databricks Jobs - Page 45

Microsoft Silicon, Cloud Hardware, and Infrastructure Engineering (SCHIE) is the team responsible for powering Microsoft's expanding Cloud Infrastructure and driving the Intelligent Cloud mission. SCHIE plays a crucial role in delivering core infrastructure and foundational technologies for over 200 online businesses globally, including Bing, MSN, Office 365, Xbox Live, Teams, OneDrive, and the Microsoft Azure platform. As part of our team, you will contribute to server and data center infrastructure, security and compliance, operations, globalization, and manageability solutions. We are committed to smart growth, high efficiency, and providing a trusted experience to our customers and partn...

As a Cloud & AI Solution Engineer at Microsoft, you will be part of a dynamic team that is at the forefront of innovation in the realm of databases and analytics. Your role will involve working on cutting-edge projects that leverage the latest technologies to drive meaningful impact for commercial customers. If you are insatiably curious and deeply passionate about tackling complex challenges in the era of AI, this is the perfect opportunity for you. In this role, you will play a pivotal role in helping enterprises unlock the full potential of Microsoft's cloud database and analytics stack. You will collaborate closely with engineering leaders and platform teams to accelerate the Fabric Data...

As an integral part of American Airlines Tech Hub in Hyderabad, India, you will have the opportunity to contribute to the innovative and tech-driven environment that shapes the future of travel. Your role will involve collaborating with source data application teams and product owners to develop and support analytics solutions that provide valuable insights for informed decision-making. By leveraging Azure products and services such as Azure Data Lake Storage, Azure Data Factory, and Azure Databricks, you will be responsible for implementing data migration and engineering solutions to enhance the airline's digital capabilities. Your responsibilities will encompass various aspects of the deve...

You must have knowledge in Azure Datalake, Azure function, Azure Databricks, Azure Data Factory, and PostgreSQL. Working knowledge in Azure DevOps and Git flow would be an added advantage. Alternatively, you should have working knowledge in AWS Kinesis, AWS EMR, AWS Glue, AWS RDS, AWS Athena, and AWS RedShift. Demonstrable expertise in working with timeseries data is essential. Experience in delivering data engineering/data science projects in Industry 4.0 is an added advantage. Knowledge of Palantir is required. You must possess strong problem-solving skills with a focus on sustainable and reusable development. Proficiency in using statistical computer languages like Python/PySpark, Pandas,...

Build, learn analytics solutions & platforms, data lakes, platforms, fabric solutions, etc Big Data, Cloud tech data ingestion pipelines • Conceptualize, make data processing harmonization. • Schedule, orchestrate, validate pipelines. Required Candidate profile Have similar work exp, work in a fast pace enviroenment, keen to learn new technologies

Share resume to : sowmya.v@acesoftlabs.com Hiring: Data Engineer (36 Years Experience) External Position (Z2 Grade) Location : Bangalore Experience : 3–6 years Key Technologies : Azure Databricks, Snowflake, DBT, Azure Data Factory, Hadoop, Spark, SQL Role Overview We are looking for a skilled Data Engineer to design, build, and maintain scalable data pipelines and cloud data infrastructure. You'll play a key role in enabling data accessibility, quality, and insights across the organization using tools like Azure Databricks , Snowflake , and DBT . Key Responsibilities Develop and optimize scalable data pipelines using Azure Databricks , Snowflake , and DBT . Build and manage efficient data m...

Job Title : Senior-Level Data Engineer Healthcare Domain Location: Remote Option Experience: 5+ Years Employment Type: Full-Time About the Role We are looking for a Senior Data Engineer with extensive experience in healthcare data ecosystems and Databricks-based pipelines . The ideal candidate brings deep technical expertise in building large-scale data platforms, optimizing performance, and ensuring compliance with healthcare data standards (e.g., HIPAA, EDI, HCC). This role requires the ability to lead data initiatives, mentor junior engineers, and work cross-functionally with product, analytics, and compliance teams. Key Responsibilities Architect, develop, and manage large-scale, secure,...

Databricks Developer Primary Skill : Azure data factory, Azure databricks Secondary Skill: SQL,,Sqoop,Hadoop Experience: 5 to 9 years Location: Chennai, Bangalore ,Pune, Coimbatore Requirements: Cloud certified in one of these categories Azure Data Engineer Azure Data Factory , Azure Data bricks Spark (PySpark or scala), SQL, DATA Ingestion, Curation Semantic Modelling/ Optimization of data model to work within Rahona Experience in Azure ingestion from on-prem source, e.g. mainframe, SQL server, Oracle. Experience in Sqoop / Hadoop Microsoft Excel (for metadata files with requirements for ingestion) Any other certificate in Azure/AWS/GCP and data engineering hands-on experience in cloud Stro...

Role: Azure Specialist-CDM Smith Location:Bangalore Mode: Remote Education and Work Experience Requirements: Key Responsibilities: Databricks Platform: Act as a subject matter expert for the Databricks platform within the Digital Capital team, provide technical guidance, best practices, and innovative solutions. Databricks Workflows and Orchestration: Design and implement complex data pipelines using Azure Data Factory or Qlik replicate. End-to-End Data Pipeline Development: Design, develop, and implement highly scalable and efficient ETL/ELT processes using Databricks notebooks (Python/Spark or SQL) and other Databricks-native tools. Delta Lake Expertise: Utilize Delta Lake for building rel...

Role: Azure Specialist-DBT Location: Bangalore Mode: Remote Education and Work Experience Requirements: •Overall, 5 to 9 years of experience in IT Industry. Min 6 years of experience working on Data Engineering. Translate complex business requirements into analytical SQL views using DBT Support data ingestion pipelines using Airflow and Data Factory Develop DBT macros to enable scalable and reusable code automation Mandatory Skills: Strong experience with DBT (Data Build Tool)( (or strong SQL / relational DWH knowledge)-Must have Proficiency in SQL and strong understanding of relational data warehouse concept Hands-on experience with Databricks (primarily Databricks SQL) good to have Familia...

Data Engineer Job Summary: The Data Engineer responsible for implementing and managing the operational aspects of cloud-native and hybrid data platform solutions built with Azure Databricks. They ensure the efficient and effective functioning of the Azure Databricks environment, including monitoring and troubleshooting data pipelines, managing data storage and access, and optimizing performance. They work closely with data engineers, data scientists, and other stakeholders to understand data requirements, design solutions, and implement data integration and transformation processes. Key Responsibilities: Provide expertise and ownership of Azure Databricks development tasks within the scrum t...

Job Summary We are seeking a highly skilled Sr. Developer with 6 to 9 years of experience in Azure Databricks Azure Data Factory Azure ML Studio ML Ops Docker AI & ML Concepts Machine Learning Artificial Intelligence Kubernetes Terraform and Azure Machine Learning. The ideal candidate will work from our office during day shifts and will not be required to travel. This role is crucial in driving our AI and ML initiatives to enhance our business solutions and impact society positively. Responsibilities Develop and implement advanced machine learning models using Azure ML Studio to solve complex business problems. Design and manage data pipelines with Azure Data Factory to ensure efficient data...

We are seeking a skilled and proactive Data Engineer with 26 years of hands-on experience in building robust data solutions on the Azure platform. The ideal candidate will have expertise in Azure Data Factory, Azure Data Lake, Azure Databricks, SQL, and Python, with additional experience in Power BI or Tableau considered a plus. You will be instrumental in developing and maintaining scalable data pipelines and ensuring efficient data integration and transformation to drive business intelligence and analytics initiatives. Key Responsibilities Design, build, and manage data pipelines and data integration workflows using tools like Azure Data Factory and Azure Databricks. •Develop scalable ETL/...

Responsibilities Manage a team of data engineers and data analysts by delegating project responsibilities and managing their flow of work as well as empowering them to realize their full potential. Design, structure and store data into unified data models and link them together to make the data reusable for downstream products. Manage and scale data pipelines from internal and external data sources to support new product launches and drive data quality across data products. Create reusable accelerators and solutions to migrate data from legacy data warehouse platforms such as Teradata to Azure Databricks and Azure SQL. Enable and accelerate standards-based development prioritizing reuse of c...

Design, build, and optimize data pipelines and warehouses. Ensure data quality, collaborate with teams, and document processes. Proficient in Azure, Python, SQL, Spark. Mentor juniors, support pre-sales, and drive scalable data solutions.

ETL (IBM Datastage), Shell Python Scripting Database Expertise DevOps CI/CD Experience Mandatory Competencies Beh - Communication and collaboration ETL - ETL - Data Stage DevOps/Configuration Mgmt - DevOps/Configuration Mgmt - Basic Bash/Shell script writing Data Science and Machine Learning - Data Science and Machine Learning - Python Cloud - Azure - Azure Data Factory (ADF), Azure Databricks, Azure Data Lake Storage, Event Hubs, HDInsight Development Tools and Management - Development Tools and Management - CI/CD Database - Oracle - PL/SQL Packages Database - Sql Server - SQL Packages

Collaborate with business stakeholders and other technical team members to acquire data sources that are most relevant to business needs and goals. Demonstrate deep technical and domain knowledge of relational and non-relation databases, Data Warehouses, Data lakes among other structured and unstructured storage options. Determine solutions that are best suited to develop a pipeline for a particular data source. Develop data flow pipelines to extract, transform, and load data from various data sources in various forms, including custom ETL pipelines that enable model and product development. Write custom scripts to extract data from unstructured/semi-structured sources. Provide clear documen...

Interested candidates can share your resume to aweaz.pasha@wisseninfotech.com Power BI developer Total BI experience should be 5+ years Should have knowledge on data bricks Should be able to create the new reports on databricks Should be able to work on reports enhancement and cosmotic implementations Should be strong in troubleshooting of issues Should be strong in writing the queries (SQL) Should have knowledge on Python ADF experience is add-on Regards, Aweaz Pasha Trainee-Talent Acquisition M: 9738144394 E: aweaz.pasha@wisseninfotech.com W: www.wisseninfotech.com

Healthcare experience is Mandatory Position Overview : We are seeking an experienced Data Modeler/Lead with deep expertise in health plan data models and enterprise data warehousing to drive our healthcare analytics and reporting initiatives. The candidate should have hands-on experience with modern data platforms and a strong understanding of healthcare industry data standards. Key Responsibilities : Data Architecture & Modeling : - Design and implement comprehensive data models for health plan operations, including member enrollment, claims processing, provider networks, and medical management - Develop logical and physical data models that support analytical and regulatory reporting requi...

Job Location: Chennai, Bangalore, Pune, Mumbai Job Location WFO or Hybrid Hybrid Detailed Job Description:Azure Data Bricks, Azure Data Factory, SQL, ETL testing.They should have Testing / QA experience in these skills- Rate 1150/hr Must Required Skills in KEYWORDS: Strong experience in SQL along with performing Azure Data bricks Testing Shift Timings: 3:30 PM IST to 12:30 AM ISTAzure Data Bricks, Azure Data Factory, SQL, ETL testing.They should have Testing / QA experience in these skills- Rate 1150/hr

We are currently hiring for Senior Data Engineers, please find the below gist of the role. Interested candidates can share their profile to archana@skoruz.com Location: Bangalore Min 6+years of experience in Data Engineer Expertise in Microsoft Fabric and its components (e.g., Synapse, Data Factory, Azure Data Lake, Power BI). Strong proficiency in SQL, Python, and Spark, DataBricks or Snowflake. Experience with cloud platforms, particularly Microsoft Azure. Solid understanding of data modeling, data warehousing, and ETL/ELT best practices. Excellent problem-solving, communication, and project management skills. Preferred: Familiarity with other cloud platforms (e.g., AWS, GCP). Experience w...

As an experienced Data Engineer with 8+ years of industry experience, you will be responsible for developing robust, scalable Python-based applications that meet the company's requirements. Your key responsibilities will include integrating and implementing Generative AI models into business applications, designing, building, and maintaining data pipelines and data engineering solutions on Azure, and collaborating closely with cross-functional teams to define, design, and deploy innovative AI and data solutions. You will be required to build, test, and optimize AI pipelines, ensuring seamless integration with Azure-based data systems. Continuous research and evaluation of new AI and Azure da...

Dear Candidate, We have an urgent opening with one of Multinational Company for Bengaluru location. Interested candidate can share the resume on Deepaksharma@thehrsolutions.in OR WhatsApp on 8882505093 Experience : 5.5+ Years Profile : Mlops Notice period : Only immediate joiners OR Already serving. Please find the below job description : MLOPS Senior Engineer - Azure ML + Azure Databricks at BLR Location 5.5 years of experience in Al Domain & 3+ years in MLOPS (preferably in a large-scale enterprise) Mandatory Skill Experience in developing MLOps framework cutting ML lifecycle: model development, training, evaluation, deployment, monitoring including Model Governance Expert in Azure Databri...

Key Responsibilities: Requirement gathering and analysis Experience with different databases like Synapse, SQL DB, Snowflake etc. Design and implement data pipelines using Azure Data Factory, Databricks, Synapse Create and manage Azure SQL Data Warehouses and Azure Cosmos DB databases Extract, transform, and load (ETL) data from various sources into Azure Data Lake Storage Implement data security and governance measures Monitor and optimize data pipelines for performance and efficiency Troubleshoot and resolve data engineering issues Provide optimized solution for any problem related to data engineering Ability to work with a variety of sources like Relational DB, API, File System, Realtime ...

You are a highly skilled and strategic Data Architect with deep expertise in the Azure Data ecosystem. Your role will involve defining and driving the overall Azure-based data architecture strategy aligned with enterprise goals. You will architect and implement scalable data pipelines, data lakes, and data warehouses using Azure Data Lake, ADF, and Azure SQL/Synapse. Providing technical leadership on Azure Databricks for large-scale data processing and advanced analytics use cases is a crucial aspect of your responsibilities. Integrating AI/ML models into data pipelines and supporting the end-to-end ML lifecycle including training, deployment, and monitoring will be part of your day-to-day t...