166 Event Hub Jobs - Page 3

Role Overview We are looking for a Data Engineer with strong hands-on Databricks experience who will design and optimize scalable data pipelines, work with Delta Lakehouse architectures, and enable advanced analytics across Azure or AWS platforms. Key Responsibilities Develop ETL/ELT pipelines in Databricks using PySpark, Spark SQL, Delta Lake . Use Delta Live Tables for simplified pipeline orchestration. Implement Databricks Auto Loader for real-time/batch data ingestion. Build Databricks SQL dashboards and queries for reporting and analytics. Manage Databricks clusters, jobs, and workflows ensuring cost efficiency. Work with cloud-native services ( ADF, Synapse, ADLS or AWS Glue, S3, Redsh...

Identifying business problems, understand the customer issue and fix the issue. Evaluating reoccurring issues and work on for permanent solution Focus on service improvement. Troubleshooting technical issues and design flaws Required education Bachelor's Degree Preferred education Master's Degree Required technical and professional expertise BE / B Tech in any stream, M.Sc. (Computer Science/IT) / M.C.A, with Minimum 3-5 years of experience Azure IAAS, PASS & SAAS services expert and Handson experience on these and below all services. VM, Storage account, Load Balancer, Application Gateway, VNET, Route Table, Azure Bastion, Disaster Recovery, Backup, NSG, Azure update manager, Key Vault etc....

Requirements 6+ years of IT experience with hands-on experience using .NET full stack including React, C#, .NET Core, MVC, REST API, Entity Framework, SQL Server, Azure services. 4+ years of experience with design & development Azure Services such as Azure API Manager, Service Bus, Azure Functions, Event Hub, Event Grid, LogicApp, Azure DevOps pipelines, and Azure monitoring solutions, Application Insights, Storage, Azure AD and Azure SQL Database. Prior experience conducting unit testing, integration testing, and performance testing of .NET applications. Prior experience ensuring adherence to coding standards, code reviews, and quality assurance processes. Prior experience proposing archite...

As a Dotnet Developer(Azure) with over 6 years of experience, you will be responsible for developing and maintaining .NET applications with a focus on Azure cloud services. Your role will involve working with various technologies and tools to ensure the scalability, security, and performance of the applications. You should have a strong background in .NET development, including proficiency in C#, ASP.NET Core, and the latest versions of .NET framework. Hands-on experience with Azure cloud services such as Azure App Services, Azure Functions, Azure Logic Apps, and Azure Kubernetes Service (AKS) is essential for this role. In this position, you will be involved in designing and developing micr...

As a Fullstack Developer, you will be responsible for designing, developing, and maintaining enterprise integration solutions using Azure services. Your expertise in API Integration, Messaging, Azure Function listeners, SQL Server databases, and Object-Oriented Programming, Design Patterns, and modern application architecture will be key in this role. Your primary tasks will include maintenance and improvements for the Carrier Portal website (SQL/C# back-end, Angular/Typescript front-end) and developing new Carrier Gateway adaptors for sending and receiving messages from carrier APIs while transforming their contents to fit our internal data model. Working within a small team, you will desig...

As a Data Engineer in our team, you will be responsible for assessing complex new data sources and quickly turning these into business insights. You will also support the implementation and integration of these new data sources into our Azure Data platform. You are detailed in reviewing and analyzing structured, semi-structured, and unstructured data sources for quality, completeness, and business value. Your role involves designing, architecting, implementing, and testing rapid prototypes that demonstrate the value of the data and presenting them to diverse audiences. Additionally, you will participate in early-stage design and feature definition activities. Your responsibilities include im...

Architect and manage Databricks workspaces, clusters, and jobs for scalable data processing and ML workloads. Implement secure data lakehouse architectures with Delta Lake, Unity Catalog, and workspace isolation. Optimize performance and cost-efficiency of Databricks deployments across cloud providers. Implement centralized logging, monitoring, and alerting for Databricks and cloud resources. Ensure auditability and traceability of data access and transformations. Support governance frameworks with metadata management and data cataloging. Mandatory Competencies Cloud - Azure - Azure Data Factory (ADF), Azure Databricks, Azure Data Lake Storage, Event Hubs, HDInsight Data Science and Machine ...

Create Solution Outline and Macro Design to describe end to end product implementation in Data Platforms including, System integration, Data ingestion, Data processing, Serving layer, Design Patterns, Platform Architecture Principles for Data platform Contribute to pre-sales, sales support through RfP responses, Solution Architecture, Planning and Estimation Contribute to reusable components / asset / accelerator development to support capability development Participate in Customer presentations as Platform Architects / Subject Matter Experts on Big Data, Azure Cloud and related technologies Participate in customer PoCs to deliver the outcomes Participate in delivery reviews / product review...

- Building and operationalizing large scale enterprise data solutions and applications using one or more of AZURE data and analytics services in combination with custom solutions - Azure Synapse/Azure SQL DWH, Azure Data Lake, Azure Blob Storage, Spark, HDInsights, Databricks, CosmosDB, EventHub/IOTHub. - Experience in migrating on-premise data warehouses to data platforms on AZURE cloud. - Designing and implementing data engineering, ingestion, and transformation functions - Azure Synapse or Azure SQL data warehouse - Spark on Azure is available in HD insights and data bricks - Good customer communication. - Good Analytical skill

- Building and operationalizing large scale enterprise data solutions and applications using one or more of AZURE data and analytics services in combination with custom solutions - Azure Synapse/Azure SQL DWH, Azure Data Lake, Azure Blob Storage, Spark, HDInsights, Databricks, CosmosDB, EventHub/IOTHub. - Experience in migrating on-premise data warehouses to data platforms on AZURE cloud. - Designing and implementing data engineering, ingestion, and transformation functions - Azure Synapse or Azure SQL data warehouse - Spark on Azure is available in HD insights and data bricks - Good customer communication. - Good Analytical skill

Provides overall architectural leadership to ensure secure, and scalable cloud platform design with observability for Azure and GCP along. Define strategy for workloads cloud migration/setup path and patterns Design and Implementation lead to ensure secure, scalable, and observable cloud platform design, help theimplementation team to provide guidance and review Design and implement secure cloud foundations with network, IAM, encryption, and logging architectures following enterprise governance and compliance standards (ECB, DORA) Design and Implement secure CI/CD, infrastructure-as-code, and policy enforcement frameworks for both foundational infrastructure and containerized GenAI deploymen...

We Are Hiring Databricks Data Architect | Navi Mumbai (Onsite) Are you passionate about designing scalable, enterprise-grade data platforms? Join Celebal Technologies and work on cutting-edge Azure Databricks solutions in the manufacturing and energy sectors! Role: Databricks Data Architect Experience: 10+ Years Location: Navi Mumbai (Onsite) Notice Period: Immediate to 30 Days Preferred About the Role We are looking for an experienced Databricks Data Architect with strong expertise in Azure Databricks, data modeling, and big data solutions. Youll be responsible for architecting scalable, cloud-native data platforms, enabling real-time and batch processing for advanced analytics and AI-drive...

Exp - 5 to 8 yrs Loc - Hyderabad Posi - Permanent FTE Must have skills - Java, Spring boot, Microservices, Hibernate, Angular, Rest API (good to have)

We are seeking an experienced Data Engineer to join our innovative data team data team and help build scalable data infrastructure, software consultancy, and development services that powers business intelligence, analytics, and machine learning initiatives. The ideal candidate will design, develop, and maintain robust high-performance data pipelines and solutions while ensuring data quality, reliability, and accessibility across the organization working with cutting-edge technologies like Python, Microsoft Fabric, Snowflake, Dataiku, SQL Server, Oracle, PostgreSQL, etc. Required Qualifications 7+ years of experience in Data engineering role. Programming Languages: Proficiency in Python Clou...

As a Senior Security Engineer with over 4 years of experience, you will be responsible for administering, managing, and supporting various enterprise security platforms. This includes but is not limited to SIEM, SASE, SIRP, Mobile Device Management, Data Loss Prevention, Multi-Factor Authentication, Vulnerability Scanners, Public Key Infrastructure, Cloud Security, End Point Protection, and Network Traffic Analysis tools. You will collaborate with IT operations and Security Operations teams to ensure the effective functioning of security platforms. Your primary duties will involve providing guidance on logging configurations for systems and applications, creating SIEM Use Cases, Playbooks, a...

As a skilled Technical Consultant with proven experience in Infor M3, MEC/ION, and integrating external systems (third-party platforms), your primary responsibility will involve analyzing technical requirements for integrating M3 with third-party systems through APIs, XML, EDI, etc. You will be expected to design, develop, and test integrations using tools like Infor ION, IEC, web services, mashups, and custom logic. Additionally, you will install, configure, and maintain Infor Localization Services Platform (LSP) to ensure compliance with regional fiscal and legal requirements, particularly in Mexico. Ensuring proper communication between M3 and tax authorities or PACs (authorized certifica...

As an Azure Integration Lead (iPaaS) in Sydney, you will be responsible for designing interfaces using Microsoft Application Integration Suite including Logic Apps, Functions, Service Bus, APIM, Azure Data Factory, Event Grid, and Event Hub. You will have a strong understanding of API development using technologies such as .NET, C#, and Python. Additionally, you will be experienced in hosting APIs using Azure Functions, Azure App Services, Docker Containers, and AKS. In this role, your leadership skills will be essential for guiding and directing the integration projects. You should possess a deep understanding of the .NET Framework versions 3.5, 4.0, and 4.5. Knowledge of end-to-end automat...

As an Azure - Development Consultant/Senior Consultant/Specialist at Hitachi Solutions India Pvt Ltd, you will be responsible for leveraging your 3 to 8 years of experience to work with Microsoft Azure Stack IoT Hub, Event Hub, Azure Functions, Azure Logic Apps, Azure Data Factory, Cosmos DB, Azure data bricks, Azure ML, IoT Edge, Docker, and Python. You will utilize your expertise in Serverless Functions (Using Java/Python), App services, Azure Kubernetes services, and more to configure, monitor, and handle scale scenarios for Network Service Components on Azure. Your experience in implementing Azure security, authentication, and single sign-on will be beneficial for the role. In addition t...

The job is based in Hyderabad/Bangalore/Chennai and at Gramener, you will find a welcoming work environment with diverse colleagues, a clear career path, and ample opportunities for growth and innovation. The company aims to develop a range of easily configurable data applications focused on storytelling for both public and private use. As part of your role, you will be involved in various impactful customer technical data platform projects, taking the lead on strategic initiatives that cover the design, development, and deployment of cutting-edge solutions. Collaboration with platform engineering teams will be key in implementing Data Brick services effectively within the company's infrastr...

We are seeking a Data Architect / Sr. Data and Pr. Data Architects to join our team. In this role, you will be involved in a combination of hands-on contribution, customer engagement, and technical team management. As a Data Architect, your responsibilities will include designing, architecting, deploying, and maintaining solutions on the MS Azure platform using various Cloud & Big Data Technologies. You will be managing the full life-cycle of Data Lake / Big Data solutions, starting from requirement gathering and analysis to platform selection, architecture design, and deployment. It will be your responsibility to implement scalable solutions on the Cloud and collaborate with a team of busin...

Job Title: Data Engineer Azure Stack Locations: Chennai, Hyderabad, Bengaluru, Gurugram, Jaipur, Bhopal, Pune (Hybrid 3 days/week in office) Experience: 5+ Years Type: Full-time Apply: Share your resume with the details listed below to vijay.s@xebia.com Availability: Immediate joiners or max 2 weeks' notice period only About the Role Xebia is hiring a Data Engineer (Azure) to design and deliver scalable data pipelines using Microsofts cloud ecosystem. In this role, youll work on modernizing enterprise data platforms with Azure services, build streaming and batch data pipelines, and contribute to end-to-end data transformations across varied data sources. Key Responsibilities Design and devel...

As a highly skilled and proactive Tech Lead, you will be responsible for designing and architecting enterprise-grade application integration solutions using the Microsoft Azure technology stack. Your role will involve leading the development of event-driven architectures and microservices-based solutions, ensuring seamless integration across various systems and services. You will collaborate with stakeholders to understand business requirements and translate them into technical solutions. Additionally, you will guide and mentor team members to promote best practices in architecture, design, and coding, ensuring effective delivery of solutions. To excel in this role, you must have a strong un...

As the Director of Data Engineering, you will play a strategic leadership role in overseeing the architecture, development, and maintenance of our company's data infrastructure. Your responsibilities will include leading a team of data engineers to design, build, and scale data systems and processes to ensure data quality, accessibility, and reliability. Collaboration with data scientists, analysts, and other stakeholders will be crucial to drive data-driven decision-making across the organization. You will lead and manage a team of 50+ members, including architects and engineers, to ensure high performance and engagement. Designing and implementing end-to-end Azure solutions, maintaining da...

As an Azure Integration Developer (AIS Dev) in Perth, you will be expected to possess expertise in Microsoft Azure Integration, including Azure Integration Service, Logic Apps, and API Management. Your role will involve working on a Cloud platform and demonstrating a very good understanding of Enterprise Integration patterns, applying design patterns based on application integration scenarios. Furthermore, your responsibilities will include having an in-depth understanding of cloud computing, PaaS, and cloud application design patterns. You should have deep expertise in Cloud and API/Services Oriented Architectures, with a proven ability to provide consulting and solution roadmaps for large ...

As an Azure Technical Project Manager, you will be responsible for managing data and analytics projects in the cloud environment. With a minimum of 12 years of IT experience, including at least 3 years in technical project management, you will bring a strong background in overseeing data engineering and data analytics initiatives. Your primary responsibilities will include overseeing migration projects, working with Azure, AWS, and managing data lake implementations. You will need to have hands-on experience in managing data science, analytics, and data engineering projects. Additionally, you should have a good understanding of Micro Service architecture and experience working as a scrum mas...