Jobs
Interviews

1265 Azure Databricks Jobs - Page 13

Setup a job Alert
JobPe aggregates results for easy application access, but you actually apply on the job portal directly.

5.0 - 10.0 years

15 - 30 Lacs

Pune, Chennai

Work from Office

Exp- 5 to 10 Yrs Skill - Azure Databricks , Azure Data Factory , Python , Spark location - Pune ,Chennai

Posted 2 weeks ago

Apply

3.0 - 7.0 years

5 - 12 Lacs

Pune

Work from Office

As a Data Engineer Managed Services you will be expected to do: Understand new Azure technology developments & develop application of these to our customer scenarios. Act as a technical point of escalation for MS we deliver to our clients. Required Candidate profile Enterprise level cloud & infrastructure practices and an interest in application delivery An attention to detail and a focus on continual improvement Strong written and spoken English.

Posted 2 weeks ago

Apply

6.0 - 9.0 years

8 - 11 Lacs

Noida, India

Work from Office

Job Summary: We are seeking a detail-oriented and analytical Business Analyst to join our team. The Business Analyst will be responsible for business users interactions, identifying business needs and analyzing /Documenting the requirements. The ideal candidate has strong problem-solving skills, excellent communication abilities, and a deep understanding of business processes and technology. Key Responsibilities: Work with stakeholders to gather, analyze, and document business requirements. Translate business needs into functional specifications for IT teams or external vendors. Analyze business processes and identify opportunities for improvement or automation. Conduct market, competitor, and trend analysis to support strategic decisions. Create detailed reports and presentations to communicate findings and recommendations. Facilitate workshops, meetings, and presentations to stakeholders. Assist in project planning, monitoring, and execution to ensure alignment with business goals. Collaborate with cross-functional teams including IT, finance, operations, and marketing. Support the testing and implementation of new systems or enhancements. Qualifications: Education & Experience: Bachelors degree in Business Administration, Information Systems, Finance, or a related field. 6-9 years of experience as a Business Analyst or similar role. Experience with healthcare system and integration platform Skills: Strong analytical and critical thinking skills. Proficiency in Microsoft Office (Excel, Word, PowerPoint); experience with tools like SQL, Postman tool and Azure is a plus. Familiarity with Agile, Scrum, or Waterfall methodologies. Excellent written and verbal communication skills. Ability to work independently and in a team environment. Strong organizational skills and attention to detail. Preferred Qualifications: Experience in a Healthcare domain. Mandatory Competencies BA - BA - Requirement Gathering BA - SQL Agile - Agile - SCRUM Beh - Communication and collaboration Enterprise Applications - ERP - Microsoft Dynamics 365 Cloud - Azure - Azure Data Factory (ADF), Azure Databricks, Azure Data Lake Storage, Event Hubs, HDInsight

Posted 2 weeks ago

Apply

6.0 - 7.0 years

6 - 11 Lacs

Noida

Work from Office

Responsibilities Data Architecture: Develop and maintain the overall data architecture, ensuring scalability, performance, and data quality. AWS Data Services: Expertise in using AWS data services such as AWS Glue, S3, SNS, SES, Dynamo DB, Redshift, Cloud formation, Cloud watch, IAM, DMS, Event bridge scheduler etc. Data Warehousing: Design and implement data warehouses on AWS, leveraging AWS Redshift or other suitable options. Data Lakes: Build and manage data lakes on AWS using AWS S3 and other relevant services. Data Pipelines: Design and develop efficient data pipelines to extract, transform, and load data from various sources. Data Quality: Implement data quality frameworks and best practices to ensure data accuracy, completeness, and consistency. Cloud Optimization: Optimize data engineering solutions for performance, cost-efficiency, and scalability on the AWS cloud. Team Leadership: Mentor and guide data engineers, ensuring they adhere to best practices and meet project deadlines. Qualifications Bachelors degree in computer science, Engineering, or a related field. 6-7 years of experience in data engineering roles, with a focus on AWS cloud platforms. Strong understanding of data warehousing and data lake concepts. Proficiency in SQL and at least one programming language ( Python/Pyspark ). Good to have - Experience with any big data technologies like Hadoop, Spark, and Kafka. Knowledge of data modeling and data quality best practices. Excellent problem-solving, analytical, and communication skills. Ability to work independently and as part of a team. Preferred Qualifications Certifications in AWS Certified Data Analytics - Specialty or AWS Certified Solutions Architect - Data. Mandatory Competencies Big Data - Big Data - Pyspark Data on Cloud - Azure Data Lake (ADL) Beh - Communication and collaboration Cloud - AWS - AWS Lambda,AWS EventBridge, AWS Fargate Cloud - AWS - AWS S3, S3 glacier, AWS EBS Cloud - Azure - Azure Data Factory (ADF), Azure Databricks, Azure Data Lake Storage, Event Hubs, HDInsight Cloud - AWS - Tensorflow on AWS, AWS Glue, AWS EMR, Amazon Data Pipeline, AWS Redshift Database - Sql Server - SQL Packages Data Science and Machine Learning - Data Science and Machine Learning - Python

Posted 2 weeks ago

Apply

6.0 - 11.0 years

15 - 30 Lacs

Gurugram

Hybrid

About this role: Gartner's core asset is its people. Our people develop insights, share advice, and create experiences that help our clients be more successful. The People Analytics team derives actionable insight from data to recommend and implement better ways of attracting, developing, and retaining our talent so that we can drive higher sales, more productivity, and better client experiences. We drive impact on Gartner's Mission Critical Priorities by leveraging state of the art technology, analytics, and processes. Our goal is to increase our analytical capabilities and derive actionable insights into our critical business issues, as well as create a scalable data infrastructure and user-friendly reporting environment that can eectively support our growing company. The Associate Director, Engineering role is a strategic partner within the People Analytics Engineering team responsible for owning the strategy, planning, design, development, and support of our analytics platforms. We re looking for someone with at least 8 years of work experience, 5+ years in designing solutions, owning platforms, and driving development projects, and someone with 4+ years in team leadership and people management. What you'll do: Lead our People Analytics Engineering team. Engage with key stakeholders to help translate business needs into prioritized, technical requirements (user stories) for People Analytics Engineering team to deliver. Catalog current analytics and automation processes and recommend best practice methods for improvement and optimization. Partner with Head of People Analytics Engineering to create roadmaps and execute project plans in fast-paced agile development environment. Partner with the People Analytics Engineering team members to streamline data integration, maintain security and access best practices, and create end-to-end data analytics solutions. Initially manage and mentor a team of 2-3 associates supporting Gartner Analytics deliverables. Research and recommend technologies and processes to support rapid scale and future state growth initiatives. Prioritize Business Needs, Leadership Questions, and Ad Hoc Requests for on-time delivery. Manage team JIRA boards and Service Now queues to support team operations, leadership reporting, and continuous improvement initiatives. Support HR Analytics and Reporting Strategy Support the future state of People Analytics at Gartner, including the execution of our multi-year roadmap. Lead QA and Data Quality eorts to improve development timelines, reduce bugs, and maintain reliable analytics products. Support projects that improve our performance (e.g. Quality of Hire & Future of Work): aligning with product strategy and understanding stakeholder requirements. What you'll need: Strong analytics, automation, and data experience 8+ years of working experience preferably working in HR analytics, data engineering, data analytics and visualization, business intelligence, or analytical consulting. Experience and skill with data mining methods, data modeling, and working with data warehouses Proven ability to use data, analytics, and business knowledge to solve complex business problems. Strong experience developing in analytics platforms / visualization tools (PowerBI, etc.), Visier experience a plus Proven experience designing analytics and delivery methods to increase accuracy of reporting in an agile environment. Strong SQL skills, ability to perform effective querying involving multiple tables and subqueries. Preferred experience with Microsoft Azure, Azure Data Factory, Data Pipelining, Databricks, Data Transformation, and ETL or similar cloud engineering toolsets. Strategic thinker future forward visionary who can not only see where we need to be in 3 years, but who can also develop a compelling, practical approach to how we get there starting tomorrow. Ability to tell stories with data to senior leadership highlighting team dynamics, celebrating successes, and identifying opportunities for improvement. Collaboration and people leadership 2+ years of effectively managing a team of Engineers, Consultants or Analysts Ability to effectively engage and influence wide range of leaders (from the Operating Committee to Sales Managers) in the development of solutions for Gartner's most critical business initiatives Ability to translate strategic vision into actionable plans and make decisions with incomplete or imperfect information. Excellent verbal/written communication skills and effective presentation skills Execution focus experienced getting to a v0.5 solution, getting real world feedback, and then iterating to v1.0+ with a continuous improvement mindset Successful track record of superior service delivery and change management in a global environment What you will get: Competitive salary, generous paid time o policy, charity match program, Medical, Dental & Vision Plans, Parental Leave, Employee Assistance Program (EAP), 401K matching, and more!

Posted 2 weeks ago

Apply

2.0 - 5.0 years

4 - 8 Lacs

Kochi

Work from Office

Able to write complex SQL queries Having experience in Azure Databricks Required education Bachelor's Degree Preferred education Master's Degree Required technical and professional expertise Able to write complex SQL queries Having experience in Azure Databricks Preferred technical and professional experience Excellent communication and stakeholder management skills

Posted 2 weeks ago

Apply

5.0 - 9.0 years

15 - 25 Lacs

Pune, Chennai, Bengaluru

Hybrid

Databricks Developer Primary Skill : Azure data factory, Azure databricks Secondary Skill: SQL,,Sqoop,Hadoop Experience: 5 to 9 years Location: Chennai, Bangalore ,Pune, Coimbatore Requirements: Cloud certified in one of these categories Azure Data Engineer Azure Data Factory , Azure Data bricks Spark (PySpark or scala), SQL, DATA Ingestion, Curation Semantic Modelling/ Optimization of data model to work within Rahona Experience in Azure ingestion from on-prem source, e.g. mainframe, SQL server, Oracle. Experience in Sqoop / Hadoop Microsoft Excel (for metadata files with requirements for ingestion) Any other certificate in Azure/AWS/GCP and data engineering hands-on experience in cloud Strong Programming skills with at least one of Python, Scala, or Java

Posted 2 weeks ago

Apply

15.0 - 20.0 years

18 - 22 Lacs

Hyderabad

Work from Office

Project Role : Data Platform Architect Project Role Description : Architects the data platform blueprint and implements the design, encompassing the relevant data platform components. Collaborates with the Integration Architects and Data Architects to ensure cohesive integration between systems and data models. Must have skills : Microsoft Azure Data Services Good to have skills : Microsoft Azure Databricks, Python (Programming Language), Microsoft SQL ServerMinimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Platform Architect, you will be responsible for architecting the data platform blueprint and implementing the design, which includes various data platform components. Your typical day will involve collaborating with Integration Architects and Data Architects to ensure seamless integration between systems and data models, while also addressing any challenges that arise during the implementation process. You will engage in discussions with stakeholders to gather requirements and provide insights that drive the overall architecture of the data platform, ensuring it meets the needs of the organization effectively. Roles & Responsibilities:- Expected to be an SME.- Collaborate and manage the team to perform.- Responsible for team decisions.- Engage with multiple teams and contribute on key decisions.- Provide solutions to problems for their immediate team and across multiple teams.- Facilitate knowledge sharing sessions to enhance team capabilities.- Develop and maintain documentation related to data architecture and design. Professional & Technical Skills: - Must To Have Skills: Proficiency in Microsoft Azure Data Services.- Good To Have Skills: Experience with Microsoft Azure Databricks, Python (Programming Language), Microsoft SQL Server.- Strong understanding of data modeling techniques and best practices.- Experience with cloud-based data storage solutions and data processing frameworks.- Familiarity with data governance and compliance standards. Additional Information:- The candidate should have minimum 7.5 years of experience in Microsoft Azure Data Services.- This position is based at our Hyderabad office.- A 15 years full time education is required. Qualification 15 years full time education

Posted 2 weeks ago

Apply

1.0 - 2.0 years

7 - 9 Lacs

Pune, Chennai, Bengaluru

Work from Office

Job Title: Data Engineer Experience: 12 to 20 months Work Mode: Work from Office Locations: Bangalore, Chennai, Kolkata, Pune, Gurgaon About Tredence Tredence focuses on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science, and software engineering. The largest companies across industries are engaging with us and deploying their prediction and optimization solutions at scale. Headquartered in the San Francisco Bay Area, we serve clients in the US, Canada, Europe, and Southeast Asia. Tredence is an equal opportunity employer. We celebrate and support diversity and are committed to creating an inclusive environment for all employees. Visit our website for more details: https://www.tredence.com Role Overview We are seeking a driven and hands-on Data Engineer with 12 to 20 months of experience to support modern data pipeline development and transformation initiatives. The role requires solid technical skills in SQL , Python , and PySpark , with exposure to cloud platforms such as Azure or GCP . As a Data Engineer at Tredence, you will work on ingesting, processing, and modeling large-scale data, implementing scalable data pipelines, and applying foundational data warehousing principles. This role also includes direct collaboration with cross-functional teams and client stakeholders. Key Responsibilities Develop robust and scalable data pipelines using PySpark in cloud platforms like Azure Databricks or GCP Dataflow . Write optimized SQL queries for data transformation, analysis, and validation. Implement and support data warehouse models and principles, including: Fact and Dimension modeling Star and Snowflake schemas Slowly Changing Dimensions (SCD) Change Data Capture (CDC) Medallion Architecture Monitor, troubleshoot, and improve pipeline performance and data quality. Work with teams across analytics, business, and IT functions to deliver data-driven solutions. Communicate technical updates and contribute to sprint-level delivery. Mandatory Skills Strong hands-on experience with SQL and Python Working knowledge of PySpark for data transformation Exposure to at least one cloud platform: Azure or GCP . Good understanding of data engineering and warehousing fundamentals Excellent debugging and problem-solving skills Strong written and verbal communication skills Preferred Skills Experience working with Databricks Community Edition or enterprise version Familiarity with data orchestration tools like Airflow or Azure Data Factory Exposure to CI/CD processes and version control (e.g., Git) Understanding of Agile/Scrum methodology and collaborative development Basic knowledge of handling structured and semi-structured data (JSON, Parquet, etc.)

Posted 2 weeks ago

Apply

6.0 - 10.0 years

9 - 13 Lacs

Ahmedabad

Work from Office

The Azure Data Bricks Engineer plays a critical role in establishing and maintaining an efficient data ecosystem within an organization. This position is integral to the development of data solutions leveraging the capabilities of Microsoft Azure Data Bricks. The engineer will work closely with data scientists and analytics teams to facilitate the transformation of raw data into actionable insights. With increasing reliance on big data technologies and cloud-based solutions, having an expert on board is vital for driving data-driven decision-making processes. The Azure Data Bricks Engineer will also be responsible for optimizing data workflows, ensuring data quality, and deploying scalable data solutions that align with organizational goals. This role requires not only technical expertise in handling large volumes of data but also the ability to collaborate across various functional teams to enhance operational efficiency. - Design and implement scalable data pipelines using Azure Data Bricks. - Develop ETL processes to efficiently extract, transform, and load data. - Collaborate with data scientists and analysts to define and refine data requirements. - Optimize Spark jobs for performance and efficiency. - Monitor and troubleshoot production workflows and jobs. - Implement data quality checks and validation processes. - Create and maintain technical documentation related to data architecture. - Conduct code reviews to ensure best practices are followed. - Work on integrating data from various sources including databases, APIs, and third-party services. - Utilize SQL and Python for data manipulation and analysis. - Collaborate with DevOps teams to deploy and maintain data solutions. - Stay updated with the latest trends and updates in Azure Data Bricks and related technologies. - Facilitate data visualization initiatives for better data-driven insights. - Provide training and support to team members on data tools and practices. - Participate in cross-functional projects to enhance data sharing and access. - Bachelor's degree in Computer Science, Information Technology, or a related field. - Minimum of 6 years of experience in data engineering or a related domain. - Strong expertise in Azure Data Bricks and data lake concepts. - Proficiency with SQL, Python, and Spark. - Solid understanding of data warehousing concepts. - Experience with ETL tools and frameworks. - Familiarity with cloud platforms such as Azure, AWS, or Google Cloud. - Excellent problem-solving and analytical skills. - Ability to work collaboratively in a diverse team environment. - Experience with data visualization tools such as Power BI or Tableau. - Strong communication skills with the ability to convey technical concepts to non-technical stakeholders. - Knowledge of data governance and data quality best practices. - Hands-on experience with big data technologies and frameworks. - A relevant certification in Azure is a plus. - Ability to adapt to changing technologies and evolving business requirements.

Posted 2 weeks ago

Apply

5.0 - 8.0 years

8 - 12 Lacs

Hyderabad

Work from Office

We are looking for a highly experienced Senior Data Engineer to lead our data migration projects from On-Premise systems to Azure Cloud, utilizing Azure Databricks, PySpark, SQL , and Python. The successful candidate will be responsible for designing and implementing robust, scalable cloud data solutions to enhance business operations and decision-making processes. Responsibilities: Design and implement end-to-end data solutions using Azure Databricks, PySpark, MS SQL Server, and Python for data migration from on-premise to Azure Cloud. Develop architectural blueprints and detailed documentation for data migration strategies and execution plans. Construct, test, and maintain optimal data pipeline architectures across multiple sources and destinations within Azure Cloud environments. Leverage PySpark within Azure Databricks to perform complex data transformations, aggregations, and optimizations. Ensure seamless migration of large-scale databases from on-premise systems to Azure Cloud, maintaining data integrity and compliance. Good hands on exp. on python and SQL Handle technical escalations through effective diagnosis and troubleshooting of client queries Manage and resolve technical roadblocks/ escalations as per SLA and quality requirements If unable to resolve the issues, timely escalate the issues to TA & SES Provide product support and resolution to clients by performing a question diagnosis while guiding users through step-by-step solutions Troubleshoot all client queries in a user-friendly, courteous and professional manner Offer alternative solutions to clients (where appropriate) with the objective of retaining customers and clients business Organize ideas and effectively communicate oral messages appropriate to listeners and situations Follow up and make scheduled call backs to customers to record feedback and ensure compliance to contract SLAs Mandatory Skills: Talend Big Data. Experience: 5-8 Years.

Posted 2 weeks ago

Apply

5.0 - 8.0 years

7 - 10 Lacs

Bengaluru

Work from Office

Must-have skills Cloud certified in one of these categories Azure Data Engineer Azure Data Factory , Azure Data bricks Spark (PySpark or scala), SQL, DATA Ingestion, Curation Semantic Modelling/ Optimization of data model to work within Rahona Experience in Azure ingestion from on-prem source, e.g. mainframe, SQL server, Oracle. Experience in Sqoop / Hadoop Microsoft Excel (for metadata files with requirements for ingestion) Any other certificate in Azure/AWS/GCP and data engineering hands-on experience in cloud Strong Programming skills with at least one of Python, Scala or Java Mandatory Skills: DataBricks - Data Engineering . Experience: 5-8 Years .

Posted 2 weeks ago

Apply

1.0 - 5.0 years

3 - 7 Lacs

Pune

Work from Office

Role Purpose The purpose of the role is to support process delivery by ensuring daily performance of the Production Specialists, resolve technical escalations and develop technical capability within the Production Specialists. Key skills Azure Data Factory (primary) , Azure Data bricks Spark (PySpark, SQL) Must-have skills Cloud certified in one of these categories Azure Data Engineer Azure Data Factory , Azure Data bricks Spark (PySpark or scala), SQL, DATA Ingestion, Curation Semantic Modelling/ Optimization of data model to work within Rahona Experience in Azure ingestion from on-prem source, e.g. mainframe, SQL server, Oracle. Experience in Sqoop / Hadoop Microsoft Excel (for metadata files with requirements for ingestion) Any other certificate in Azure/AWS/GCP and data engineering hands-on experience in cloud Strong Programming skills with at least one of Python, Scala or Java Strong SQL skills ( T-SQL or PL-SQL) Data files movement via mailbox Source-code versioning/promotion tools, e.g. Git/Jenkins Orchestration tools, e.g. Autosys, Oozie Source-code versioning with Git Nice-to-have skills Experience working with mainframe files Experience in Agile environment, JIRA/Confluence tool Key skills Azure Data Factory (primary) , Azure Data bricks Spark (PySpark, SQL) Experience - 5 to 10 Years Must-have skills Cloud certified in one of these categories Azure Data Engineer Azure Data Factory , Azure Data bricks Spark (PySpark or scala), SQL, DATA Ingestion, Curation Semantic Modelling/ Optimization of data model to work within Rahona Experience in Azure ingestion from on-prem source, e.g. mainframe, SQL server, Oracle. Experience in Sqoop / Hadoop Microsoft Excel (for metadata files with requirements for ingestion) Any other certificate in Azure/AWS/GCP and data engineering hands-on experience in cloud Strong Programming skills with at least one of Python, Scala or Java Strong SQL skills ( T-SQL or PL-SQL) Data files movement via mailbox Source-code versioning/promotion tools, e.g. Git/Jenkins Orchestration tools, e.g. Autosys, Oozie Source-code versioning with Git. Nice-to-have skills Experience working with mainframe files Experience in Agile environment, JIRA/Confluence to

Posted 2 weeks ago

Apply

4.0 - 9.0 years

24 - 30 Lacs

Pune

Work from Office

Data Engineer Expert in Databricks, Azure, Java, SQL, PySpark, Dashboarding (Splunk/Power BI/Grafana/Tableau), Data Pipelines, Data Modeling (JSON/XML/Avro), Docker, Kubernetes, Kafka, Data Quality Monitoring, Agile/Scrum, Deployment Automation

Posted 3 weeks ago

Apply

1.0 - 5.0 years

0 Lacs

hyderabad, telangana

On-site

As an American Airlines team member in the Tech Hub in Hyderabad, India, you will have the opportunity to be part of a diverse, high-performing team dedicated to technical excellence. Your primary focus will be on delivering unrivaled digital products that drive a more reliable and profitable airline. The Data Domain you'll be working in is centered around managing and leveraging data as a strategic asset, including data management, storage, integration, and governance, with a strong emphasis on Machine Learning, AI, Data Science, and Business Intelligence. In this role, you will work closely with source data application teams and product owners to design, implement, and support analytics solutions that provide valuable insights for better decision-making. You will be responsible for implementing data migration and data engineering solutions using Azure products and services such as Azure Data Lake Storage, Azure Data Factory, Azure Functions, Event Hub, Azure Stream Analytics, Azure Databricks, and more, as well as traditional data warehouse tools. Your responsibilities will include various aspects of the development lifecycle, such as design, cloud engineering, data modeling, testing, performance tuning, deployments, BI, alerting, and production support. You will collaborate within a team environment and independently to develop technical solutions. As part of a DevOps team, you will have ownership and support for the product you work on, implementing both batch and streaming data pipelines using cloud technologies. To be successful in this role, you should have a Bachelor's degree in Computer Science, Computer Engineering, Technology, Information Systems, or a related technical discipline, or equivalent experience. You should have at least 1+ years of software solution development experience using agile, DevOps, and data analytics experience using SQL. Experience with cloud development and data lake technologies, particularly in Microsoft Azure, is preferred. Preferred qualifications include additional years of experience in software solution development, data analytics, full-stack development, and specific experience with Azure technologies. Skills in scripting languages like Python, Spark, Unix, SQL, as well as expertise with the Azure Technology stack and various data platforms and BI Analytics tools are highly valued. Certifications such as Azure Development Track and Spark are preferred. Effective communication skills are essential for this role, as you will need to collaborate with team members at all levels within the organization. Physical abilities are also necessary to perform the essential functions of the position safely. American Airlines values inclusion and diversity, providing a supportive environment for all team members to reach their full potential. If you are ready to be part of a dynamic, tech-driven environment where your creativity and strengths are celebrated, join American Airlines in Hyderabad and immerse yourself in the exciting world of technological innovation. Feel free to be yourself and contribute to keeping the largest airline in the world running smoothly as we care for people on life's journey.,

Posted 3 weeks ago

Apply

5.0 - 10.0 years

15 - 25 Lacs

Hyderabad, Chennai, Bengaluru

Hybrid

We are seeking a highly driven and experienced data engineering professional with strong expertise in Microsoft Azure, Databricks, FHIR, HL7, and AI/ML technologies.

Posted 3 weeks ago

Apply

10.0 - 14.0 years

0 Lacs

karnataka

On-site

You are a highly skilled and experienced Azure Data Architect & Senior Data Engineer who will be responsible for designing, implementing, and maintaining robust data solutions that support the business objectives. You have a deep understanding of data engineering principles, cloud technologies, and the Azure platform. You possess expertise in data modeling, integration, design, and data management. You can produce relevant data models and design the organization's data flow. You have experience with Azure cloud solutions related to data acquisition, transformation, storage, analysis, and loading, including SQL application data and unstructured data. Your proficiency extends to various SQL database languages such as T-SQL, Databricks, PL/SQL, and MySQL. You understand the advantages and drawbacks of each and can set them up effectively and securely across different data platforms and environments. You excel in building and maintaining data pipelines and workflows using tools like Azure Data Factory, Azure Functions, and others. You develop ETL/ELT processes to extract, transform, and load data from various sources into data warehouses and data lakes. Implementing data integration solutions using Azure Synapse Analytics, Azure SQL Database, and other Azure data storage options is also within your skillset. In addition, you develop and maintain comprehensive data architecture blueprints and roadmaps aligned with the business strategy. You assess and optimize existing data systems and processes for efficiency and scalability. Designing and implementing data governance frameworks to ensure data quality and integrity is part of your responsibilities. You have strong proficiency in Azure data services, including Azure Data Factory, Azure Synapse Analytics, Azure SQL Database, Azure Data Lake Storage, Azure Cosmos DB, and Azure Databricks. You are an expert in data modeling, data warehousing, and data lake concepts. Your knowledge also extends to data engineering tools and technologies, such as ETL/ELT tools, data integration frameworks, and data quality tools. Programming languages like Python, SQL, and Scala are familiar to you, and you have an understanding of data governance and compliance frameworks such as GDPR and CCPA. You hold a Bachelor's degree in Computer Science, Engineering, or a related field, with 10+ years of experience in data engineering and data architecture roles. You have at least 5+ years of hands-on experience with Azure data services like Azure Synapse, Azure SQL Database, Azure Cosmos DB, Azure Data Lake, Azure Data Factory, and Azure Databricks, or related services. Proven experience working with Azure cloud technologies, strong analytical and problem-solving skills, excellent communication and interpersonal skills, and the ability to work independently and as part of a team are some of your key qualifications. Additionally, certifications related to Azure data technologies, such as Azure Certified Data Engineer, are considered a plus.,

Posted 3 weeks ago

Apply

3.0 - 7.0 years

0 Lacs

karnataka

On-site

As a Data Engineer with 3-5 years of experience in BI/Data Engineering, you will be responsible for designing, developing, and maintaining Azure Analysis Service and Power BI solutions. Working in Bangalore, you will collaborate with cross-functional teams to gather and analyze business requirements and implement data modeling, ETL processes, and data visualization using Azure-based tools and technologies. Your role will involve optimizing and enhancing existing data pipelines and reporting dashboards for performance and scalability, as well as troubleshooting and resolving data-related issues while providing technical guidance to stakeholders. It is essential to stay updated on the latest Azure and Power BI developments and best practices to ensure efficient and effective solutions. To excel in this role, you must have proven experience as a Data Engineer with a focus on Azure Analysis Service and Power BI. Proficiency in SQL, Data Modeling, ETL, and data visualization is required, along with a strong understanding of Azure Data Factory, Azure SQL Database, and other Azure data services. Experience with DAX, M, and Power Query for data manipulation and transformation is necessary. Strong problem-solving skills, the ability to work in a fast-paced environment, and Microsoft Azure certifications (e.g., DP-200, DP-201) are advantageous. Moreover, you should possess strong knowledge of Azure Databricks, Azure Data Lake, and Azure Analysis Services, as well as expertise in Power BI, including Data Modeling, Tabular Model design, writing complex DAX formulas, and DAX optimization. Familiarity with DWBI with SQL, experience in On-premise/cloud BI solution implementation, and knowledge of Power Automate are beneficial skills for this role. If you join UST, a global digital transformation solutions provider, you will work alongside the world's best companies to drive real impact through transformation. With over 30,000 employees in 30 countries, UST is committed to partnering with clients from design to operation, embedding innovation and agility into organizations to create boundless impact and touch billions of lives in the process.,

Posted 3 weeks ago

Apply

6.0 - 10.0 years

0 Lacs

noida, uttar pradesh

On-site

FCM is one of the world's largest travel management companies and a trusted partner for national and multinational organizations. With a 24/7 reach in 97 countries, FCM's flexible technology anticipates and resolves client needs, backed by experts offering in-depth local knowledge and a commitment to duty of care. As part of the ASX-listed Flight Centre Travel Group, FCM delivers the best market-wide rates, unique added-value benefits, and exclusive solutions. A leader in the travel tech space, FCM offers proprietary client solutions and provides specialist services through FCM Consulting and FCM Meetings & Events. We are seeking a skilled Azure Data Engineer to join our dynamic team. The ideal candidate will have extensive experience in data engineering, working with Azure cloud services, and designing and implementing scalable data solutions. You will play a crucial role in developing, optimizing, and maintaining data pipelines and architectures, ensuring data quality and availability across various platforms. Key Responsibilities: - Design, develop, and maintain data pipelines and ETL processes using Azure Data Factory, Azure Databricks, and Azure Synapse Analytics. - Build and optimize data storage solutions using Azure Data Lake, Azure SQL Database, and Azure Cosmos DB. - Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver solutions. - Implement data quality checks, data governance, and security best practices across data platforms. - Monitor, troubleshoot, and optimize data workflows for performance and scalability. - Develop and maintain data models, data cataloging, and metadata management. - Automate data integration and transformation processes using Azure DevOps and CI/CD pipelines. - Stay up-to-date with emerging Azure technologies and data engineering trends. Qualifications: - Bachelor's degree in Computer Science, Information Technology, or a related field. - 6+ years of experience in data engineering with a focus on Azure cloud services. - Proficiency in Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and Azure SQL Database. - Strong experience with SQL, Python, or other scripting languages. - Familiarity with data modeling, ETL design, and big data tools such as Hadoop or Spark. - Experience with data warehousing concepts, data lakes, and data pipelines. - Understanding of data governance, data quality, and security best practices. - Excellent problem-solving skills and ability to work in a fast-paced, collaborative environment. Preferred Skills: - Azure certification (e.g., Microsoft Certified: Azure Data Engineer Associate) is a plus. - Experience with Azure Logic Apps, Azure Functions, and API Management. - Knowledge of Power BI, Tableau, or other data visualization tools.,

Posted 3 weeks ago

Apply

8.0 - 13.0 years

25 - 40 Lacs

Gurugram, Mumbai (All Areas)

Work from Office

About the role In this role, we are seeking an experienced, hands-on, and innovative Data Architect with expertise in the Azure Cloud platform to design, implement, and optimize scalable data solutions. The ideal candidate will have deep expertise in data architecture, cloud solutions, and experience with healthcare and benefits data systems. They will work closely with a cross functional team of Data, DevOps, and Analytics engineers to architect a robust data platform for H&B, ensure efficient data management, and support enterprise-level decision making process. The Role - Partner with other architecture resources to lead the end-to-end architecture of the health and benefits data platform using Azure services, ensuring scalability, flexibility, and reliability. Develop broad understanding of the data lake architecture, including the impact of changes on a whole system, the onboarding of clients and the security implications of the solution. Design a new or improve upon existing architecture including data ingestion, storage, transformation and consumption layers. Define data models, schemas, and database structures optimized for H&B use cases including claims, census, placement, broking and finance sources. Designing solutions for seamless integration of diverse health and benefits data sources. Implement data governance and security best practices in compliance with industry standards and regulations using Microsoft Purview. Evaluate data lake architecture to understand how technical decisions may impact business outcomes and suggest new solutions/technologies that better align to the Health and Benefits Data strategy. Draw on internal and external practices to establish data lake architecture best practices and standards within the team and ensure that they are shared and understood. Continuously develop technical knowledge and be recognised as a key resource across the global team. Collaborate with other specialists and/or technical experts to ensure H&B Data Platform is delivering to the highest possible standards and that solutions support stakeholder needs and business requirements. Initiate practices that will increase code quality, performance and security. Develop recommendations for continuous improvements initiatives, applying deep subject matter knowledge to provide guidance at all levels on the potential implications of changes. Build the teams technical expertise/capabilities/skills through the delivery of regular feedback, knowledge sharing, and coaching. Analyze existing data design and suggest improvements that promote performance, stability and interoperability. Work with product management and business subject matter experts to translate business requirements into good data lake design. Maintain the governance model on the data lake architecture through training, design reviews, code reviews, and progress reviews. Participate in the development of Data lake Architecture and Roadmaps in support of business strategies

Posted 3 weeks ago

Apply

5.0 - 8.0 years

9 - 14 Lacs

Bengaluru

Work from Office

Role Purpose The purpose of the role is to support process delivery by ensuring daily performance of the Production Specialists, resolve technical escalations and develop technical capability within the Production Specialists. Do Oversee and support process by reviewing daily transactions on performance parameters Review performance dashboard and the scores for the team Support the team in improving performance parameters by providing technical support and process guidance Record, track, and document all queries received, problem-solving steps taken and total successful and unsuccessful resolutions Ensure standard processes and procedures are followed to resolve all client queries Resolve client queries as per the SLAs defined in the contract Develop understanding of process/ product for the team members to facilitate better client interaction and troubleshooting Document and analyze call logs to spot most occurring trends to prevent future problems Identify red flags and escalate serious client issues to Team leader in cases of untimely resolution Ensure all product information and disclosures are given to clients before and after the call/email requests Avoids legal challenges by monitoring compliance with service agreements Handle technical escalations through effective diagnosis and troubleshooting of client queries Manage and resolve technical roadblocks/ escalations as per SLA and quality requirements If unable to resolve the issues, timely escalate the issues to TA & SES Provide product support and resolution to clients by performing a question diagnosis while guiding users through step-by-step solutions Troubleshoot all client queries in a user-friendly, courteous and professional manner Offer alternative solutions to clients (where appropriate) with the objective of retaining customers and clients business Organize ideas and effectively communicate oral messages appropriate to listeners and situations Follow up and make scheduled call backs to customers to record feedback and ensure compliance to contract SLAs Build people capability to ensure operational excellence and maintain superior customer service levels of the existing account/client Mentor and guide Production Specialists on improving technical knowledge Collate trainings to be conducted as triage to bridge the skill gaps identified through interviews with the Production Specialist Develop and conduct trainings (Triages) within products for production specialist as per target Inform client about the triages being conducted Undertake product trainings to stay current with product features, changes and updates Enroll in product specific and any other trainings per client requirements/recommendations Identify and document most common problems and recommend appropriate resolutions to the team Update job knowledge by participating in self learning opportunities and maintaining personal networks Mandatory Skills: Azure Synapse Analytics. Experience:5-8 Years.

Posted 3 weeks ago

Apply

3.0 - 5.0 years

5 - 7 Lacs

Hyderabad

Work from Office

Key Responsibilities: Provide expert-level support for Azure Machine Learning, OpenAI, Cognitive Services, Synapse, and Data Factory . Troubleshoot real-time data integration pipelines, model deployments, inference performance, and security configurations. Guide customers in implementing Responsible AI , security governance, and model versioning best practices. Collaborate with engineering teams to resolve service issues and release platform updates. Proactively identify patterns in customer challenges and build reusable diagnostics or automations. Work with cross-functional teams (Product, Engineering, Customer Success) to improve support processes and tooling. Skillset: Strong foundation in Azure ML , OpenAI API , and Cognitive Services (Text, Vision, Language) . Experience with Synapse Analytics , Azure Data Factory , and Azure Databricks . Data engineering proficiency: SQL, PySpark, Power BI , data ingestion & transformation. Hands-on with Cosmos DB , Azure Storage Gen2, and secure data lake architecture. Machine learning pipeline troubleshooting and model monitoring techniques. Knowledge of Python, TensorFlow, PyTorch , and security practices in AI deployment. Proven experience with cloud deployment and development tools (i.e. PowerShell, CLI, REST API, Visual Studio, .NET, SDK, JSON, ARM/Bicep templates). Mandatory Skills: : MS Azure MLOPs Experience: 3-5 Years

Posted 3 weeks ago

Apply

7.0 - 12.0 years

20 - 35 Lacs

Hyderabad

Work from Office

About Client Hiring for One of the top most MNC!! Job Description Job Title : Azure Data Engineer Qualification : Any Graduate or Above Relevant Experience : 6 to 15 Years MAIN SKILL 5+ years of experience in data modeling, with a strong focus on cloud-based environments (preferably Azure). Strong proficiency in SQL and experience working with Spark, Python, and other data processing languages. Proven experience with Azure Databricks, Azure Data Lake, and other Azure data services Strong experience in migrating data from Salesforce, Oracle, and SQL Server-based applications into cloud environments, specifically Azure. Expertise in designing and optimizing relational and dimensional data models (star/snowflake schemas, normalization/denormalization, etc.). In-depth understanding of ETL processes, data integration, and pipeline optimization. Familiarity with data governance, security policies, and compliance standards in cloud environments. Excellent communication and collaboration skills, with the ability to work effectively with cross-functional teams. Ability to translate business requirements into scalable and optimized data models. Strong problem-solving and analytical skills to troubleshoot and optimize complex data modeling issues. Key Responsibilities: Design, implement, and optimize data models in Azure Databricks to support large-scale data migration projects from Salesforce, Oracle, and SQL Server-based applications. Collaborate with business stakeholders, data architects, and data engineers to understand data requirements and translate them into scalable, high-performance data models. Develop conceptual, logical, and physical data models to ensure data consistency, integrity, and optimal performance in the Azure cloud environment. Work closely with the data engineering team to ensure smooth integration of data from Salesforce, Oracle, and SQL Server into Azure Databricks using ETL pipelines. Optimize and fine-tune data models for large datasets, focusing on performance, scalability, and cost efficiency within the Azure platform. Ensure data governance, security, and compliance standards are met when designing and implementing data models and pipelines. Develop and maintain documentation for data models, including relationships, entities, transformations, and business rules. Implement best practices for data modeling, including naming conventions, data types, and normalization/denormalization strategies. Collaborate with data scientists and analysts to ensure the data models support business intelligence, reporting, and machine learning initiatives. Conduct data quality assessments and validate the accuracy of migrated data. Troubleshoot, resolve, and optimize data model-related performance and data quality issues across the migration process. Location : Mumbai/Chennai/Bangalore/Hyderabad/Pune CTC Range : 20 LPA TO 35 LPA Notice period : ANY Shift Timing : N/A Mode of Interview : VIRTUAL Mode of Work : WORK FROM OFFICE Vardhani IT Staffing Analyst Black and White Business solutions PVT Ltd Bangalore, Karnataka, INDIA. 8686127477 I vardhani@blackwhite.in I www.blackwhite.in

Posted 3 weeks ago

Apply

4.0 - 8.0 years

35 - 40 Lacs

Bengaluru

Work from Office

Project Code TBD Approx Start Date 7/14/2025 (Immediate) Number of Openings 1 Brief details about the Project (Share Few Key Words only) Sr Data Engineer Duration 6 months Total Yrs. of Experience 5-8 years Relevant Yrs. of experience 4-5 years Detailed JD (Roles and Responsibilities) Key Responsibilities: 1. 5 - 8 yrs experience in Azure ( Databricks , PySpark,) 2. Good to have knowledge in Azure Data factory. 3. Good communication skills 4. Experience in leading a team and handling project deliverables. Mandatory skills Blend of Technical skills, Business understanding, and strong communication and Project Management abilities Desired/ Secondary skills Databricks , PySpark Domain Client Vendor Rate (INR/Day) Rs.12-13 K per day Work Location Any Location (Preferred HYD) Is it complete WFO or Hybrid model (specify the days) Any Location (Preferred HYD) BG Check (Before OR After onboarding) In Parallel Is there any working in shifts from standard Daylight (to avoid confusions post onboarding) YES/ NO No

Posted 3 weeks ago

Apply

3.0 - 6.0 years

11 - 15 Lacs

Bengaluru

Work from Office

Project description A DevOps Support Engineer will perform tasks related to data pipeline work and monitor and support related to job execution, data movement, and on-call support. In addition, deployed pipeline implementations will be tested for production validation. Responsibilities Provide production support for 1st tier, after hours and on call support. The candidate will eventually develop into more data engineering within the Network Operations team. The selected resource will learn the Telecommunications domain while also developing data learning skills. Skills Must have ETL pipeline, data engineering, data movement/monitoring Azure Databricks Watchtower Automation tools Testing Nice to have Data Engineering

Posted 3 weeks ago

Apply
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Featured Companies