21 Hdinsight Jobs

Designation: Data Architect Location: Pune Experience: 10-15 years Skills Azure Expertise: The architect should have experience in architecting large scale analytics solutions using native services such as Azure Synapse, Data Lake, Data Factory, HDInsight, Databricks, Azure Cognitive Services, Azure ML, Azure Event Hub. Architecture Creation: Assist with creation of a robust, sustainable architecture that supports requirements and provides for expansion with secured access. BFSI Experience: Experience in building/running large data environment for BFSI clients. Collaboration: Work with customers, end users, technical architects, and application designers to define the data requirements and d...

Proven experience as a MS Fabric Data Architect Comfortable developing and implementing a delivery plan with key milestones based on requirements Strong working knowledge of Microsoft Fabric core features, including setup, configuration, and use of: Azure Data Lake (OneLake) for Big Data storage. Azure Synapse Data Warehouse for database management. Azure Synapse Data Engineering and Data Factory for data integration. Microsoft Purview (preview for Fabric) for data governance. Azure Data Science for analytics and AI workloads. Event stream and Data Activator for real time data flows. Strong understanding of data modelling, including relational and NoSQL data models. Ability to interpret an o...

Gurgaon/Bangalore, India AXA XL offers risk transfer and risk management solutions to clients globally. We offer worldwide capacity, flexible underwriting solutions, a wide variety of client-focused loss prevention services and a team-based account management approach. AXA XL recognizes data and information as critical business assets, both in terms of managing risk and enabling new business opportunities. This data should not only be high quality, but also actionable - enabling AXA XL's executive leadership team to maximize benefits and facilitate sustained dynamic advantage. Our Innovation, Data and Analytics (IDA) organization is focused on driving innovation through optimizing how we lev...

In this role at Zaloni, you will be a part of the Engineering team responsible for architecting, designing, and building Zaloni's flagship product - Arena. Your key responsibilities will include: - Taking technical ownership for the development and delivery of product features as a member of an agile team, involving design, code, test, technical documentation, technical training, and stakeholder presentations. - Providing subject matter expertise on multiple functional areas, collaborating with developers, testers, architects, documentation, and product managers to ensure high-quality feature deliverables. - Working on a Scrum Team using Agile principles, participating in backlog grooming, t...

Enterprise Partner Solutions, part of Microsoft's Industry & Partner Sales (IPS) organization, is accountable for building and co-selling innovative Microsoft Cloud & AI solutions and services, with our global Enterprise partners. Our Enterprise partner portfolio includes global systems integrators, advisories, high-value management consultancies (SI), independent software vendors (ISV) and software development companies - working together to empower people and organizations to achieve more. As a Cloud Solution Architect, you will guide the development of business solutions, provide deep technical insights, and accelerate the growth of Microsoft Tech priorities. Join our team as a Cloud Solu...

As a Data Engineer, your role involves designing and developing business-critical backend systems using stream processors and high-quality data pipelines. Your responsibilities will include: - Assembling large, complex data sets that meet functional / non-functional business requirements. - Building the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and Azure "big data" technologies. - Creating a cloud-native, real-time stream processing & data lake platform that scales into the Zettabytes and beyond. - Developing a data pipeline to provide actionable insights into customer acquisition, operational efficiency,...

As an Azure Databricks+ MS Fabrics+ Python Data Engineer at PWC AC, you will play a crucial role in designing and implementing scalable ETL/ELT pipelines using Databricks and Apache Spark. Your responsibilities will include: - Proficiency with Azure Data Services, Databricks, and Snowflake - Deep understanding of traditional and modern data architecture and processing concepts - Hands-on experience with Snowflake utilities, SnowSQL, SnowPipe, ETL data pipelines, and Big Data model techniques using Python / Java - Building stream-processing systems using solutions such as Storm or Spark-Streaming - Experience with Big Data ML toolkits like Mahout, SparkML, or H2O - Knowledge in Python and cer...

Why Join Iris Are you ready to do the best work of your career at one of India's Top 25 Best Workplaces in IT industry Do you want to grow in an award-winning culture that truly values your talent and ambitions Join Iris Software - one of the fastest-growing IT services companies - where you own and shape your success story . About Us At Iris Software, our vision is to be our client's most trusted technology partner, and the first choice for the industry's top professionals to realize their full potential. With over 4,300 associates across India, U.S.A, and Canada, we help our enterprise clients thrive with technology-enabled transformation across financial services, healthcare, transportati...

As a Lead Data Engineer, you will be responsible for the following: - Multi-year work experience as a Platform Lead, Delivery Leader, or similar role. - Good working knowledge of AWS Services, Python, Pyspark, data modeling. - Knowledge of columnar and NoSQL databases, predictive analytics, data visualization, and unstructured data. - Knowledge of ETL, data mining, Data Warehousing, and segmentation techniques. - Knowledge of databases (Azure SQL, MSQL), data lakes (e.g., Azure Data Lake/Delta lakes), Processing tools (e.g., Databricks/HDInsight), and BI and Reporting tools (e.g., Power BI, Tableau) or similar technologies. - Experience working with advanced data management, data processing,...

Job Description : YASH Technologies is a leading technology integrator specializing in helping clients reimagine operating models, enhance competitiveness, optimize costs, foster exceptional stakeholder experiences, and drive business transformation. At YASH, we're a cluster of the brightest stars working with cutting-edge technologies. Our purpose is anchored in a single truth - bringing real positive changes in an increasingly virtual world and it drives us beyond generational gaps and disruptions of the future. We are looking forward to hireAzure Data Factory (ADF) Professionals in the following areas : Design and build complex data pipelines and dataflows using Azure Data Factory. Integr...

Role Overview: As an AWS Senior Developer at PwC - AC, you will collaborate with the Offshore Manager and Onsite Business Analyst to comprehend the requirements and take charge of implementing end-to-end Cloud data engineering solutions such as Enterprise Data Lake and Data hub in AWS. Your role will involve showcasing strong proficiency in AWS cloud technology, exceptional planning and organizational skills, and the ability to work as a cloud developer/lead in an agile team to deliver automated cloud solutions. Key Responsibilities: - Proficient in Azure Data Services, Databricks, and Snowflake - Deep understanding of traditional and modern data architecture and processing concepts - Profic...

Why Join Us Are you inspired to grow your career at one of India's Top 25 Best Workplaces in IT industry Do you want to do the best work of your life at one of the fastest growing IT services companies Do you aspire to thrive in an award-winning work culture that values your talent and career aspirations It's happening right here at Iris Software. About Iris Software At Iris Software, our vision is to be our client's most trusted technology partner, and the first choice for the industry's top professionals to realize their full potential. With over 4,300 associates across India, U.S.A, and Canada, we help our enterprise clients thrive with technology-enabled transformation across financial s...

Why Join Us Are you inspired to grow your career at one of India's Top 25 Best Workplaces in IT industry Do you want to do the best work of your life at one of the fastest growing IT services companies Do you aspire to thrive in an award-winning work culture that values your talent and career aspirations It's happening right here at Iris Software. About Iris Software At Iris Software, our vision is to be our client's most trusted technology partner, and the first choice for the industry's top professionals to realize their full potential. With over 4,300 associates across India, U.S.A, and Canada, we help our enterprise clients thrive with technology-enabled transformation across financial s...

We are seeking an experienced PySpark Developer / Data Engineer to design, develop, and optimize big data processing pipelines using Apache Spark and Python (PySpark). The ideal candidate should have expertise in distributed computing, ETL workflows, data lake architectures, and cloud-based big data solutions. Key Responsibilities: Develop and optimize ETL/ELT data pipelines using PySpark on distributed computing platforms (Hadoop, Databricks, EMR, HDInsight). Work with structured and unstructured data to perform data transformation, cleansing, and aggregation. Implement data lake and data warehouse solutions on AWS (S3, Glue, Redshift), Azure (ADLS, Synapse), or GCP (BigQuery, Dataflow). Op...

Why Join Us Are you inspired to grow your career at one of Indias Top 25 Best Workplaces in IT industry Do you want to do the best work of your life at one of the fastest growing IT services companies Do you aspire to thrive in an award-winning work culture that values your talent and career aspirations Its happening right here at Iris Software. About Iris Software At Iris Software, our vision is to be our clients most trusted technology partner, and the first choice for the industrys top professionals to realize their full potential. With over 4,300 associates across India, U.S.A, and Canada, we help our enterprise clients thrive with technology-enabled transformation across financial servi...

DXFactor is a US-based tech company working with customers across the globe. We are a Great place to work with certified company. We are looking for candidates for Data Engineer (4 to 6 Yrs exp) We have our presence in: US India (Ahmedabad, Bangalore) Location : Ahmedabad Website : www.DXFactor.com Designation: Data Engineer (Expertise in SnowFlake, AWS & Python) Key Responsibilities Design, develop, and maintain scalable data pipelines for batch and streaming workflows Implement robust ETL/ELT processes to extract data from various sources and load into data warehouses Build and optimize database schemas following best practices in normalization and indexing Create and maintain documentatio...

A career in the Advisory Acceleration Centre at PwC is an opportunity to leverage PwC's global delivery capabilities and provide premium, cost-effective, and high-quality services to support client engagements. As an Azure Senior Developer at PwC - AC, you will collaborate with the Offshore Manager and Onsite Business Analyst to grasp the project requirements and take charge of the complete implementation of Cloud data engineering solutions. Your role will involve utilizing your expertise in Azure cloud services such as Storage services (Blob, ADLS, PaaS SQL), Azure Data Factory, and Azure Synapse. You should excel in planning, organization, and have the ability to lead as a cloud developer ...

As a part of the data and analytics engineering team at PwC, your focus will be on utilizing advanced technologies and techniques to create robust data solutions for clients. Your role will involve transforming raw data into actionable insights, enabling informed decision-making, and contributing to business growth. Specifically in data engineering at PwC, you will be responsible for designing and constructing data infrastructure and systems that facilitate efficient data processing and analysis. This will include the development and implementation of data pipelines, data integration, and data transformation solutions. At PwC - AC, we are seeking an Azure Manager specializing in Data & AI, w...

You are an integral part of Zaloni's Engineering team, responsible for contributing to the development and delivery of features for the Arena product. Your expertise will be crucial in enabling customers to effectively manage their data lake infrastructure and derive valuable insights from the data. As a Zaloni engineer, you will be involved in various responsibilities including technical ownership of product features, providing subject matter expertise in multiple functional areas, and working collaboratively in an agile environment. Your role will also entail fixing complex bugs, identifying technical debt areas, and staying updated with the latest technologies to enhance the product. Addi...

Working with data on a day-to-day basis excites you, and you are interested in building robust data architecture to identify data patterns and optimize data consumption for customers who will forecast and predict actions based on data. If this excites you, then working in our intelligent automation team at Schneider AI Hub is the perfect fit for you. As a Lead Data Engineer at Schneider AI Hub, you will play a crucial role in the AI transformation of Schneider Electric by developing AI-powered solutions. Your responsibilities will include expanding and optimizing data and data pipeline architecture, ensuring optimal data flow and collection for cross-functional teams, and supporting software...

We are seeking an experienced PySpark Developer / Data Engineer to design, develop, and optimize big data processing pipelines using Apache Spark and Python (PySpark). The ideal candidate should have expertise in distributed computing, ETL workflows, data lake architectures, and cloud-based big data solutions. Key Responsibilities: Develop and optimize ETL/ELT data pipelines using PySpark on distributed computing platforms (Hadoop, Databricks, EMR, HDInsight). Work with structured and unstructured data to perform data transformation, cleansing, and aggregation. Implement data lake and data warehouse solutions on AWS (S3, Glue, Redshift), Azure (ADLS, Synapse), or GCP (BigQuery, Dataflow). Op...