2404 Azure Databricks Jobs - Page 40

As a Senior Data Engineer (Azure) at Fractal, you will be an integral part of large-scale client business development and delivery engagements. You will have the opportunity to develop the software and systems needed for end-to-end execution on large projects, working across all phases of SDLC and utilizing Software Engineering principles to build scaled solutions. Your role will involve building the knowledge base required to deliver increasingly complex technology projects. To be successful in this role, you should hold a bachelor's degree in Computer Science or a related field with 5-10 years of technology experience. You should have strong experience in System Integration, Application De...

You will be responsible for architecting data warehousing and business intelligence solutions to address cross-functional business challenges. This will involve interacting with business stakeholders to gather requirements and deliver comprehensive Data Engineering, Data Warehousing, and analytics solutions. Additionally, you will collaborate with other technology teams to extract, transform, and load data from diverse sources. You should have a minimum of 5-8 years of end-to-end Data Engineering Development experience, preferably across industries such as Retail, FMCG, Manufacturing, Finance, Oil & Gas. Experience in functional domains like Sales, Procurement, Cost Control, Business Develop...

You will be responsible for designing high-performance data models optimized for reporting purposes using Power BI and SSRS, while ensuring compliance with enterprise architecture and data governance standards. Your expertise will be crucial in all stages of project life cycles, including design, analysis, implementation, and testing. You will be required to research technical issues, analyze business requirements, evaluate design alternatives, and develop technical processes to meet these requirements. Additionally, estimating and documenting the necessary work effort for implementing new technical processes/changes will be part of your responsibilities. Collaboration with data engineers to...

As a Data Engineer, you will be responsible for designing, developing, and delivering ADF pipelines for the Accounting & Reporting Stream. Your role will involve creating and maintaining scalable data pipelines using PySpark and ETL workflows in Azure Databricks and Azure Data Factory. You will also work on data modeling and architecture to optimize data structures for analytics and business requirements. Your responsibilities will include monitoring, tuning, and troubleshooting pipeline performance for efficiency and reliability. Collaboration with business analysts and stakeholders is key to understanding data needs and delivering actionable insights. Implementing data governance practices...

Genpact is a global professional services and solutions firm committed to shaping the future. With a workforce of over 125,000 individuals in more than 30 countries, we are dedicated to creating lasting value for our clients through our innate curiosity, entrepreneurial agility, and deep industry knowledge. At Genpact, we serve and transform leading enterprises, including the Fortune Global 500, by leveraging our expertise in digital operations services, data, technology, and AI. We are currently seeking applications for the position of Principal Consultant, Dot Net Developer. In this role, you will play a crucial part in coding, testing, and delivering high-quality deliverables. Additionall...

As an Azure Databricks Professional at YASH Technologies, you will be utilizing your 6-8 years of experience to work with cutting-edge technologies in Azure services and data bricks. Your role will involve a strong understanding of medallion architecture, as well as proficiency in Python and Pyspark. YASH Technologies is a leading technology integrator that focuses on helping clients reimagine operating models, enhance competitiveness, optimize costs, foster exceptional stakeholder experiences, and drive business transformation. Our team is comprised of bright individuals who are dedicated to making real positive changes in an increasingly virtual world. Working at YASH, you will have the op...

As a Tosca Automation Engineer with 6-8 years of experience, you will be responsible for conducting functional and ETL testing across various systems to ensure accuracy and data integrity. Your primary focus will be on automation, ETL testing, SQL proficiency, and hands-on experience with Azure Databricks (ADB). You should have excellent skills in developing automation frameworks using Tosca and a solid understanding of Tosca's tools and architecture. Your key responsibilities will include developing and maintaining automation frameworks for GUI and API testing using Tosca, working on Tosca TDM/TDS for test data management, conducting hands-on testing with Azure Databricks, and creating cust...

As a Databricks Engineer specializing in the Azure Data Platform, you will be responsible for designing, developing, and optimizing scalable data pipelines within the Azure ecosystem. You should have hands-on experience with Python-based ETL development, Lakehouse architecture, and building Databricks workflows utilizing the bronze-silver-gold data modeling approach. Your key responsibilities will include developing and maintaining ETL pipelines using Python and Apache Spark in Azure Databricks, implementing and managing bronze-silver-gold data lake layers using Delta Lake, and working with various Azure services such as Azure Data Lake Storage (ADLS), Azure Data Factory (ADF), and Azure Syn...

At EY, you'll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And we're counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all. Our Technology team builds innovative digital solutions rapidly and at scale to deliver the next generation of Financial and Non-Financial services across the globe. The Position is a senior technical, hands-on delivery role, requiring knowledge of data engineering, cloud infrastructure and platform engineering, platform operations, and produ...

Key responsibilities Responsibilities often include designing and implementing data science workflows using Azure Databricks, collaborating on data pipelines, optimizing PySpark jobs, and developing/deploying scalable ML and AI models, including Generative AI and LLMs. Data scientists also drive MLOps practices, analyze data for trends and models, translate requirements into data models, present findings, and stay updated on research. Required qualifications typically include relevant experience in applied data science, AI, and machine learning, with experience in developing ML models and hands-on experience with LLMs and Generative AI. Technical skills often needed are advanced Python progr...

We are seeking a skilled Site Reliability Engineer to support the administration of Azure Kubernetes Service (AKS) clusters running critical, always-on middleware that processes thousands of transactions per second (TPS). The ideal candidate will operate with a mindset aligned to achieving 99.999% (five-nines) availability. Key Responsibilities: Own and manage AKS cluster deployments, cutovers, base image updates, and daily operational tasks. Test and implement Infrastructure as Code (IaC) changes using best practices. Apply software engineering principles to IT operations for maintaining scalable and reliable production environments. Write and maintain IaC as well as automation code for: Mo...

Job Title:- Sr. Python Data Engineer Location:- Chennai & Bangalore (REMOTE) Job Type:- Permanent Employee Experience :- 8 to 12 Years Shift: 2 11 PM Responsibilities Design and develop data pipelines and ETL processes. Collaborate with data scientists and analysts to understand data needs. Maintain and optimize data warehousing solutions. Ensure data quality and integrity throughout the data lifecycle. Develop and implement data validation and cleansing routines. Work with large datasets from various sources. Automate repetitive data tasks and processes. Monitor data systems and troubleshoot issues as they arise. Qualifications Bachelor’s degree in Computer Science, Information Technology, ...

Enterprise Systems Administrator - Azure JOB_DESCRIPTION.SHARE.HTML CAROUSEL_PARAGRAPH JOB_DESCRIPTION.SHARE.HTML Pune, India India Enterprise IT - 22752 about our diversity, equity, and inclusion efforts and the networks ZS supports to assist our ZSers in cultivating community spaces, obtaining the resources they need to thrive, and sharing the messages they are passionate about. What you'll do: Assist in deploying, managing, and troubleshooting Azure resources, including virtual machines, networking, and storage. Monitor and respond to alerts to ensure optimal performance and availability of Azure services. Manage Azure networking services such as private endpoints, load balancers, Applica...

Mandatory skill- Azure Databricks, Datafactory, Pyspark, SQL Experience- 5 to 8 years Location- Mumbai/Bangalore/Pune/Chennai/Hyderabad/Indore/Kolkata/Noida/Coimbatore/Bhuvaneswar Key Responsibilities: Design and build data pipelines and ETL/ELT workflows using Azure Databricks and Azure Data Factory Ingest, clean, transform, and process large datasets from diverse sources (structured and unstructured) Implement Delta Lake solutions and optimize Spark jobs for performance and reliability Integrate Azure Databricks with other Azure services including Data Lake Storage, Synapse Analytics, and Event Hubs Interested candidates share your CV at himani.girnar@alikethoughts.com with below details C...

Roles and Responsibility The Senior Tech Lead - Databricks leads the design, development, and implementation of advanced data solutions. Has To have extensive experience in Databricks, cloud platforms, and data engineering, with a proven ability to lead teams and deliver complex projects. Responsibilities: Lead the design and implementation of Databricks-based data solutions. Architect and optimize data pipelines for batch and streaming data. Provide technical leadership and mentorship to a team of data engineers. Collaborate with stakeholders to define project requirements and deliverables. Ensure best practices in data security, governance, and compliance. Troubleshoot and resolve complex ...

Please apply only if your notice period is less the 15 days Years of exp: 5+ Years Location: Bangalore Data Engineer Job Summary: The Data Engineer responsible for implementing and managing the operational aspects of cloud-native and hybrid data platform solutions built with Azure Databricks. They ensure the efficient and effective functioning of the Azure Databricks environment, including monitoring and troubleshooting data pipelines, managing data storage and access, and optimizing performance. They work closely with data engineers, data scientists, and other stakeholders to understand data requirements, design solutions, and implement data integration and transformation processes. Key Res...

We are seeking a talented and experienced Senior Data Engineer to join our team and contribute to building a robust data platform on Azure Cloud. The ideal candidate will have hands-on experience designing and managing data pipelines, ensuring data quality, and leveraging cloud technologies for scalable and efficient data processing. The Data Engineer will design, develop, and maintain scalable data pipelines and systems to support the ingestion, transformation, and analysis of large datasets. The role requires a deep understanding of data workflows, cloud platforms (Azure), and strong problem-solving skills to ensure efficient and reliable data delivery. Key Responsibilities Data Ingestion ...

At EY, you will have the opportunity to shape a career that is as unique as you are, leveraging the global reach, support, inclusive environment, and cutting-edge technology to unleash your full potential. Your distinctive voice and perspective are crucial in our journey towards continuous improvement at EY. By joining us, you will not only craft an exceptional experience for yourself but also contribute to creating a better working world for all. The mission of EY's GDS Tax Technology team is to design, implement, and integrate technology solutions that enhance client service and support engagement teams. As a member of EY's core Tax practice, you will deepen your tax technical expertise wh...

As a Cloud Platform Engineer at Healthcare Intelligence within Providence, you will be responsible for the Azure Administration to ensure the availability and operational efficiency of the cloud platform. Your role will involve managing critical applications hosted on Azure Infrastructure, including AzureSQL, ADF, AKS, Azure VM, and more. Your primary focus will be on maintaining platform availability, reliability, and performance of the Azure Cloud Infrastructure. In the position of Sr. Cloud Engineer, you will play a crucial role in Azure Infrastructure administration, ensuring a highly available and stable environment with sustained performance. Your responsibilities will include working ...

Birlasoft is a powerhouse that brings together domain expertise, enterprise solutions, and digital technologies to redefine business processes. With a consultative and design thinking approach, we drive societal progress by enabling our customers to run businesses with efficiency and innovation. As part of the CK Birla Group, a multibillion-dollar enterprise, we have a team of 12,500+ professionals dedicated to upholding the Group's 162-year legacy. Our core values prioritize Diversity, Equity, and Inclusion (DEI) initiatives, along with Corporate Sustainable Responsibility (CSR) activities, demonstrating our commitment to building inclusive and sustainable communities. Join us in shaping a ...

As a skilled professional, you will be responsible for designing, developing, and implementing data pipelines utilizing Azure Data Factory. Your primary focus will be on efficiently extracting, transforming, and loading data from diverse sources into Azure Data Lake Storage (ADLS). In addition to the mandatory skills mentioned above, it will be beneficial to have knowledge and experience in utilizing Azure Databricks, as well as proficiency in Python and PySpark. Your expertise in these areas will be crucial in ensuring the seamless flow of data and maintaining the integrity of the data pipelines within the Azure environment. Your contributions will play a key role in the successful manageme...

The Testing Specialist will collaborate closely with the Business and Delivery teams to implement the test strategy and fulfill identified business requirements, ensuring the delivery of business value. With 8 to 10 years of experience in Quality Assurance and ETL testing, you will lead the Quality Engineering and Assurance (QEA) team, responsible for ensuring the quality and reliability of software and data products within the Databricks environment. Your responsibilities will include developing and overseeing the quality assurance strategy and test planning for Databricks" products and solutions. You should possess a good understanding of efficient data pipelines utilizing Azure Databricks...

As a Data Engineer, you will be responsible for designing, building, and maintaining data pipelines on the Microsoft Azure cloud platform. Your primary focus will be on utilizing technologies such as Azure Data Factory, Azure Synapse Analytics, PySpark, and Python to handle complex data processing tasks efficiently. Your key responsibilities will include designing and implementing data pipelines using Azure Data Factory or other orchestration tools, writing SQL queries for ETL processes, and collaborating with data analysts to meet data requirements and ensure data quality. You will also need to implement data governance practices for security and compliance, monitor and optimize data pipeli...

You are an experienced Azure Databricks Engineer who will be responsible for designing, developing, and maintaining scalable data pipelines and supporting data infrastructure in an Azure cloud environment. Your key responsibilities will include designing ETL pipelines using Azure Databricks, building robust data architectures on Azure, collaborating with stakeholders to define data requirements, optimizing data pipelines for performance and reliability, implementing data transformations and cleansing processes, managing Databricks clusters, and leveraging Azure services for data orchestration and storage. You must possess 5-10 years of experience in data engineering or a related field with e...

Job Title: ETL Lead Job Type: Fulltime Location: Hyderabad / Work from office Experience: 8+ Years No of positions: 1 Job Summary: We are looking for an experienced ETL Lead to manage and deliver enterprise-grade data integration solutions using Azure Data Factory (ADF), SSIS, SQL Querying, Azure SQL, Azure Data Lake, and preferably Azure Databricks. The role includes leading a team, building scalable ETL pipelines, and ensuring data quality and performance through efficient CI/CD practices. Key Responsibilities: Lead a team of engineers and manage ETL project lifecycles. Design, develop, and optimize ETL workflows using ADF and SSIS. Write complex SQL queries and perform performance tuning....