170 Azure Hdinsight Jobs - Page 5

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and Azure Cloud Data Platform Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark and Hive, Hbase or other NoSQL databases on Azure Cloud Data Platform or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developing streaming pipelines Exp...

Python backend developer with experience in creating web applications. Good at fast API framework, async processing with redis cache, unit test the code, production log code, docker, micro-services, mongo DB, blob storage

Design, build, and maintain ETL/ELT pipelines using Azure Data Factory, Synapse, and Databricks. Develop, optimize data models for reporting and analytics in Power BI. Create and maintain dashboards and reports to support business decision-making. Required Candidate profile Strong experience with Azure Data Factory, Synapse Analytics, and Databricks, Power BI (data modeling, DAX, visualization best practices). Strong SQL for querying, transformation, and optimization.

Skills: Dot Net, Azure, Angular, SQL Mandatory Technical skills Object Oriented SOLID Principles and Design Patterns. .Net Core, API with ASP.Net Core, Microservices with ASP.Net Core, C# Experience in SQL server, SSRS Frontend experience in HTML, CSS, Angular 4+/ React JS Design Principles and Design Pattern Azure API Management, Azure App Insights and Monitoring Continuous Delivery and DevOps with Azure DevOps Automated Unit Testing using Mock Frameworks Responsibilities: - Working within a globally diverse team across different time zones. Working closely with technology and business teams within an Agile/Scrum model Understanding Sprint requirements and participating in sprint planning. ...

Skills: Dot Net, Azure, Angular, SQL Mandatory Technical skills Object Oriented SOLID Principles and Design Patterns. .Net Core, API with ASP.Net Core, Microservices with ASP.Net Core, C# Experience in SQL server, SSRS Frontend experience in HTML, CSS, Angular 4+/ React JS Design Principles and Design Pattern Azure API Management, Azure App Insights and Monitoring Continuous Delivery and DevOps with Azure DevOps Automated Unit Testing using Mock Frameworks Responsibilities: - Working within a globally diverse team across different time zones. Working closely with technology and business teams within an Agile/Scrum model Understanding Sprint requirements and participating in sprint planning. ...

Skills: Dot Net, Azure, Angular, SQL Mandatory Technical skills Object Oriented SOLID Principles and Design Patterns. .Net Core, API with ASP.Net Core, Microservices with ASP.Net Core, C# Experience in SQL server, SSRS Frontend experience in HTML, CSS, Angular 4+/ React JS Design Principles and Design Pattern Azure API Management, Azure App Insights and Monitoring Continuous Delivery and DevOps with Azure DevOps Automated Unit Testing using Mock Frameworks Responsibilities: - Working within a globally diverse team across different time zones. Working closely with technology and business teams within an Agile/Scrum model Understanding Sprint requirements and participating in sprint planning. ...

Architect and manage Databricks workspaces, clusters, and jobs for scalable data processing and ML workloads. Implement secure data lakehouse architectures with Delta Lake, Unity Catalog, and workspace isolation. Optimize performance and cost-efficiency of Databricks deployments across cloud providers. Implement centralized logging, monitoring, and alerting for Databricks and cloud resources. Ensure auditability and traceability of data access and transformations. Support governance frameworks with metadata management and data cataloging. Mandatory Competencies Cloud - Azure - Azure Data Factory (ADF), Azure Databricks, Azure Data Lake Storage, Event Hubs, HDInsight Data Science and Machine ...

- Building and operationalizing large scale enterprise data solutions and applications using one or more of AZURE data and analytics services in combination with custom solutions - Azure Synapse/Azure SQL DWH, Azure Data Lake, Azure Blob Storage, Spark, HDInsights, Databricks, CosmosDB, EventHub/IOTHub. - Experience in migrating on-premise data warehouses to data platforms on AZURE cloud. - Designing and implementing data engineering, ingestion, and transformation functions - Azure Synapse or Azure SQL data warehouse - Spark on Azure is available in HD insights and data bricks - Good customer communication. - Good Analytical skill

- Building and operationalizing large scale enterprise data solutions and applications using one or more of AZURE data and analytics services in combination with custom solutions - Azure Synapse/Azure SQL DWH, Azure Data Lake, Azure Blob Storage, Spark, HDInsights, Databricks, CosmosDB, EventHub/IOTHub. - Experience in migrating on-premise data warehouses to data platforms on AZURE cloud. - Designing and implementing data engineering, ingestion, and transformation functions - Azure Synapse or Azure SQL data warehouse - Spark on Azure is available in HD insights and data bricks - Good customer communication. - Good Analytical skill

- Building and operationalizing large scale enterprise data solutions and applications using one or more of AZURE data and analytics services in combination with custom solutions - Azure Synapse/Azure SQL DWH, Azure Data Lake, Azure Blob Storage, Spark, HDInsights, Databricks, CosmosDB, EventHub/IOTHub. - Experience in migrating on-premise data warehouses to data platforms on AZURE cloud. - Designing and implementing data engineering, ingestion, and transformation functions - Azure Synapse or Azure SQL data warehouse - Spark on Azure is available in HD insights and data bricks - Good customer communication. - Good Analytical skill

Provides overall architectural leadership to ensure secure, and scalable cloud platform design with observability for Azure and GCP along. Define strategy for workloads cloud migration/setup path and patterns Design and Implementation lead to ensure secure, scalable, and observable cloud platform design, help theimplementation team to provide guidance and review Design and implement secure cloud foundations with network, IAM, encryption, and logging architectures following enterprise governance and compliance standards (ECB, DORA) Design and Implement secure CI/CD, infrastructure-as-code, and policy enforcement frameworks for both foundational infrastructure and containerized GenAI deploymen...

The Developer will form part of our existing development team, and the candidate will have expertise in C#, .NET Core, Microsoft SQL and Azure API development. This role is focused , and maintaining interfaces between systems, ensuring seamless data exchange and integration across platforms. The ideal candidate will have strong experience in , cloud-, and software integrations. The successful applicant will work with international and project project teams. Experience working with Agile and DevOps methodologies would be preferable. Job Specification In this context the successful candidate will: Design, develop, and maintain robust, scalable APIs using C#, .NET Core Develop and implement Azu...

We currently hold fund and securitisation structures with a total value of $260 billion. This is mainly allocated to alternative investments, including real estate, private equity, private debt and renewable energies & infrastructure (as of March 31, 2024). For the avoidance of doubt we do not deal with retail clients. We neither offer any securities (bonds, shares, notes etc.) nor do we act on behalf of any other financial institution to offer such securities to any clients. Job Specification Develop, implement, and maintain interfaces between enterprise systems using C#, .NET Core, and Azure API services. Design and optimize RESTful APIs and microservices for seamless system communication....

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and Azure Cloud Data Platform Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark and Hive, Hbase or other NoSQL databases on Azure Cloud Data Platform or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developing streaming pipelines Exp...

Role: Azure Specialist-DBT Location: Bangalore Mode: Remote Education and Work Experience Requirements: •Overall, 5 to 9 years of experience in IT Industry. Min 6 years of experience working on Data Engineering. Translate complex business requirements into analytical SQL views using DBT Support data ingestion pipelines using Airflow and Data Factory Develop DBT macros to enable scalable and reusable code automation Mandatory Skills: Strong experience with DBT (Data Build Tool)( (or strong SQL / relational DWH knowledge)-Must have Proficiency in SQL and strong understanding of relational data warehouse concept Hands-on experience with Databricks (primarily Databricks SQL) good to have Familia...

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and Azure Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark and Hive, Hbase or other NoSQL databases on Azure Cloud Data Platform or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developing strea...

Azure, Linux OS. Work on advanced technical principles, theories, and concepts. 2. Work closely with geo aligned Tower leads, SMEs and Build managers depending on the stage of opportunity. 3. Work on Azure Expertise: IaaS, PaaS, VM Migrations, V Net, Traffic Manager, Azure Cloud Services, SQL Azure, Active Directory, ADFS, Data Factory, Data Lake, HD Insights, ExpressRoute, Power Shell, OMS, Security Center, Service bus, blob storages. 4. Work on MS Servers: Windows 2000/ 2003/ 2008/ 2012, MOSS 2007, SharePoint 2010/2013, Office 365, Windows Cluster Server, SQL Server, IIS Server, File Server, Proxy Server, Exchange Server, SMS server, Terminal Server. 5. Work on Networking: LB, TCP/ IP Conf...

Key Responsibilities: Design, architect, and implement end-to-end big data solutions using MapR , Apache Hadoop , and associated ecosystem tools (e.g., Hive, HBase, Spark, Kafka). Lead data platform modernization efforts including architecture reviews, platform upgrades, and migrations. Collaborate with data engineers, data scientists, and application teams to gather requirements and build scalable, secure data pipelines. Define data governance, security, and access control strategies in the MapR ecosystem. Optimize performance of distributed systems, including storage and compute workloads. Guide teams on best practices in big data development, deployment, and maintenance. Conduct code revi...

Job Summary: We are seeking a detail-oriented and analytical Business Analyst to join our team. The Business Analyst will be responsible for business users interactions, identifying business needs and analyzing /Documenting the requirements. The ideal candidate has strong problem-solving skills, excellent communication abilities, and a deep understanding of business processes and technology. Key Responsibilities: Work with stakeholders to gather, analyze, and document business requirements. Translate business needs into functional specifications for IT teams or external vendors. Analyze business processes and identify opportunities for improvement or automation. Conduct market, competitor, a...

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and Azure Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark and Hive, Hbase or other NoSQL databases on Azure Cloud Data Platform or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developing strea...

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and Azure Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark and Hive, Hbase or other NoSQL databases on Azure Cloud Data Platform or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developing strea...

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and Azure Cloud Data Platform Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark and Hive, Hbase or other NoSQL databases on Azure Cloud Data Platform or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developing streaming pipelines Exp...

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and Azure Cloud Data Platform Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark and Hive, Hbase or other NoSQL databases on Azure Cloud Data Platform or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developing streaming pipelines Exp...

company name=Apptad Technologies Pvt Ltd., industry=Employment Firms/Recruitment Services Firms, experience=8 to 12 , jd= Full stack Net Azure ReactJS Skill set ASP Net ASP NET MVC strong in C OOPS Concepts WCF ASP NET Web API Ajax HTML HTML 5 CSS jQuery JavaScript SQL Server Automated Unit Testing Applying Design Patterns Performance Tuning C and SQL Third party web controls Agile SAFe React Redux Microsoft Azure PAAS Services ASPNET Core Web API Azure Functions Logic Apps Azure AD OAuth Open ID Connect Azure API Management Agile development environment especially SCRUM Ability to work on bigger teams Develop support and maintain applications and technology solutions Ensure that all develop...

The Developer will form part of our existing development team, and the candidate will have expertise in C#, .NET Core, Microsoft SQL and Azure API development. This role is focused , and maintaining interfaces between systems, ensuring seamless data exchange and integration across platforms. The ideal candidate will have strong experience in , cloud-, and software integrations. The successful applicant will work with international and project project teams. Experience working with Agile and DevOps methodologies would be preferable. Job Specification In this context the successful candidate will: Design, develop, and maintain robust, scalable APIs using C#, .NET Core Develop and implement Azu...