29 Hdinsight Jobs

As a Azure Databricks+ Ms Fabrics+ Python Data Engineer at PWC AC, you will play a crucial role in leveraging your 4-16 years of experience to contribute to the team. Your primary responsibilities will include: - Proficient with Azure Data Services, MS Fabrics, Snowflake, and Python. - Deep understanding in traditional and modern data architecture and processing concepts. - Experience in relational databases like SQL Server, MySQL, PostgreSQL, Data warehousing, big data, NoSQL, and business analytics. - Hands-on experience with Azure services such as ADLS, Data Bricks, Data Flows, HDInsight, and Azure Analysis services. - Working knowledge of Snowflake utilities, SnowSQL, SnowPipe, ETL data ...

As a Lead Data Engineer with 7+ years of experience, your role will involve the following responsibilities: - Multi-year work experience as a Platform Lead, Delivery Leader, or similar role. - Good working knowledge of AWS services, Python, PySpark, and data modeling. - Familiarity with columnar and NoSQL databases, predictive analytics, data visualization, and unstructured data. - Proficiency in ETL, data mining, data warehousing, and segmentation techniques. - Knowledge of databases such as Azure SQL, MSQL, data lakes like Azure Data Lake/Delta lakes, processing tools like Databricks/HDInsight, and BI and reporting tools such as Power BI, Tableau, or similar technologies. - Experience in a...

Job Title: - Azure Databricks with PYSPARK Location: - AIA Coimbatore Job Type 3 days from office (Hybrid) Minimum 6 To 13 Years Of Experience Mandatory Skills: Azure Databricks with PYSPARK At least 4 years of experience in Big DataDistributed computing implementation as a developer. Working knowledge of Data Warehousing concepts and design. Solution/technical design in the Azure Cloud. Big Data/Database Management in the Cloud. Familiarity with the Technology stack available in the industry for data management data ingestion capture processing and curation using Databricks Delta tables Pyspark Scala.6. Roles & Responsibilities Design and develop data processing components using Databricks ...

Why Join Iris Are you ready to do the best work of your career at one of India's Top 25 Best Workplaces in IT industry Do you want to grow in an award-winning culture that truly values your talent and ambitions Join Iris Software - one of the fastest-growing IT services companies - where you own and shape your success story . About Us At Iris Software, our vision is to be our client's most trusted technology partner, and the first choice for the industry's top professionals to realize their full potential. With over 4,300 associates across India, U.S.A, and Canada, we help our enterprise clients thrive with technology-enabled transformation across financial services, healthcare, transportati...

As an Azure Senior Developer at PwC - AC, you will be responsible for interacting with the Offshore Manager/ Onsite Business Analyst to understand requirements and implementing end-to-end Cloud data engineering solutions. You should have strong experience in Azure cloud using Storage services (Blob, ADLS, PaaS SQL), Azure Data factory, and Azure Synapse. Your planning and organization skills should be strong, allowing you to work as a cloud developer/lead on an agile team and provide automated cloud solutions. **Key Responsibilities:** - Proficient with Azure cloud computing, including big data technologies. - Experience with deep understanding in both traditional and modern data architectur...

As an Azure Senior Developer at PwC - AC, your role involves collaborating with Offshore Manager/Onsite Business Analyst to comprehend requirements and taking charge of end-to-end execution of Cloud data engineering solutions. Your responsibilities include leveraging Azure cloud expertise, particularly in Storage services (Blob, ADLS, PaaS SQL), Azure Data factory, and Azure Synapse. You are expected to excel in planning and organization, functioning as a cloud developer/lead in an agile team, delivering automated cloud solutions. **Key Responsibilities:** - Proficient in Azure cloud computing, encompassing big data technologies. - Deep understanding of traditional and modern data architectu...

Role: Data Engineer Experience Range: 8+ Years Job location: Bangalore, Pune Notice Period: Immediate to 30 Days Job Description: Must-Have Skills: Previous experience as a data engineer or in a similar role Must have experience with MS Azure services such as Data Lake Storage, Data Factory, Databricks, HDInsight, Azure SQL Database, Azure Synapse Analytics, Functions, Pyspark, Python Technical expertise with data models, data mining, analytics and segmentation techniques Knowledge of programming languages and environments such as Python, Java, Scala, R Hands-on experience with SQL database design Great numerical and analytical skills Degree in Computer Science, IT, or similar field; a Maste...

Why Join Us Are you inspired to grow your career at one of India's Top 25 Best Workplaces in IT industry Do you want to do the best work of your life at one of the fastest growing IT services companies Do you aspire to thrive in an award-winning work culture that values your talent and career aspirations It's happening right here at Iris Software. About Iris Software At Iris Software, our vision is to be our client's most trusted technology partner, and the first choice for the industry's top professionals to realize their full potential. With over 4,300 associates across India, U.S.A, and Canada, we help our enterprise clients thrive with technology-enabled transformation across financial s...

Designation: Data Architect Location: Pune Experience: 10-15 years Skills Azure Expertise: The architect should have experience in architecting large scale analytics solutions using native services such as Azure Synapse, Data Lake, Data Factory, HDInsight, Databricks, Azure Cognitive Services, Azure ML, Azure Event Hub. Architecture Creation: Assist with creation of a robust, sustainable architecture that supports requirements and provides for expansion with secured access. BFSI Experience: Experience in building/running large data environment for BFSI clients. Collaboration: Work with customers, end users, technical architects, and application designers to define the data requirements and d...

Proven experience as a MS Fabric Data Architect Comfortable developing and implementing a delivery plan with key milestones based on requirements Strong working knowledge of Microsoft Fabric core features, including setup, configuration, and use of: Azure Data Lake (OneLake) for Big Data storage. Azure Synapse Data Warehouse for database management. Azure Synapse Data Engineering and Data Factory for data integration. Microsoft Purview (preview for Fabric) for data governance. Azure Data Science for analytics and AI workloads. Event stream and Data Activator for real time data flows. Strong understanding of data modelling, including relational and NoSQL data models. Ability to interpret an o...

Gurgaon/Bangalore, India AXA XL offers risk transfer and risk management solutions to clients globally. We offer worldwide capacity, flexible underwriting solutions, a wide variety of client-focused loss prevention services and a team-based account management approach. AXA XL recognizes data and information as critical business assets, both in terms of managing risk and enabling new business opportunities. This data should not only be high quality, but also actionable - enabling AXA XL's executive leadership team to maximize benefits and facilitate sustained dynamic advantage. Our Innovation, Data and Analytics (IDA) organization is focused on driving innovation through optimizing how we lev...

In this role at Zaloni, you will be a part of the Engineering team responsible for architecting, designing, and building Zaloni's flagship product - Arena. Your key responsibilities will include: - Taking technical ownership for the development and delivery of product features as a member of an agile team, involving design, code, test, technical documentation, technical training, and stakeholder presentations. - Providing subject matter expertise on multiple functional areas, collaborating with developers, testers, architects, documentation, and product managers to ensure high-quality feature deliverables. - Working on a Scrum Team using Agile principles, participating in backlog grooming, t...

Enterprise Partner Solutions, part of Microsoft's Industry & Partner Sales (IPS) organization, is accountable for building and co-selling innovative Microsoft Cloud & AI solutions and services, with our global Enterprise partners. Our Enterprise partner portfolio includes global systems integrators, advisories, high-value management consultancies (SI), independent software vendors (ISV) and software development companies - working together to empower people and organizations to achieve more. As a Cloud Solution Architect, you will guide the development of business solutions, provide deep technical insights, and accelerate the growth of Microsoft Tech priorities. Join our team as a Cloud Solu...

As a Data Engineer, your role involves designing and developing business-critical backend systems using stream processors and high-quality data pipelines. Your responsibilities will include: - Assembling large, complex data sets that meet functional / non-functional business requirements. - Building the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and Azure "big data" technologies. - Creating a cloud-native, real-time stream processing & data lake platform that scales into the Zettabytes and beyond. - Developing a data pipeline to provide actionable insights into customer acquisition, operational efficiency,...

As an Azure Databricks+ MS Fabrics+ Python Data Engineer at PWC AC, you will play a crucial role in designing and implementing scalable ETL/ELT pipelines using Databricks and Apache Spark. Your responsibilities will include: - Proficiency with Azure Data Services, Databricks, and Snowflake - Deep understanding of traditional and modern data architecture and processing concepts - Hands-on experience with Snowflake utilities, SnowSQL, SnowPipe, ETL data pipelines, and Big Data model techniques using Python / Java - Building stream-processing systems using solutions such as Storm or Spark-Streaming - Experience with Big Data ML toolkits like Mahout, SparkML, or H2O - Knowledge in Python and cer...

Why Join Iris Are you ready to do the best work of your career at one of India's Top 25 Best Workplaces in IT industry Do you want to grow in an award-winning culture that truly values your talent and ambitions Join Iris Software - one of the fastest-growing IT services companies - where you own and shape your success story . About Us At Iris Software, our vision is to be our client's most trusted technology partner, and the first choice for the industry's top professionals to realize their full potential. With over 4,300 associates across India, U.S.A, and Canada, we help our enterprise clients thrive with technology-enabled transformation across financial services, healthcare, transportati...

As a Lead Data Engineer, you will be responsible for the following: - Multi-year work experience as a Platform Lead, Delivery Leader, or similar role. - Good working knowledge of AWS Services, Python, Pyspark, data modeling. - Knowledge of columnar and NoSQL databases, predictive analytics, data visualization, and unstructured data. - Knowledge of ETL, data mining, Data Warehousing, and segmentation techniques. - Knowledge of databases (Azure SQL, MSQL), data lakes (e.g., Azure Data Lake/Delta lakes), Processing tools (e.g., Databricks/HDInsight), and BI and Reporting tools (e.g., Power BI, Tableau) or similar technologies. - Experience working with advanced data management, data processing,...

Job Description : YASH Technologies is a leading technology integrator specializing in helping clients reimagine operating models, enhance competitiveness, optimize costs, foster exceptional stakeholder experiences, and drive business transformation. At YASH, we're a cluster of the brightest stars working with cutting-edge technologies. Our purpose is anchored in a single truth - bringing real positive changes in an increasingly virtual world and it drives us beyond generational gaps and disruptions of the future. We are looking forward to hireAzure Data Factory (ADF) Professionals in the following areas : Design and build complex data pipelines and dataflows using Azure Data Factory. Integr...

Role Overview: As an AWS Senior Developer at PwC - AC, you will collaborate with the Offshore Manager and Onsite Business Analyst to comprehend the requirements and take charge of implementing end-to-end Cloud data engineering solutions such as Enterprise Data Lake and Data hub in AWS. Your role will involve showcasing strong proficiency in AWS cloud technology, exceptional planning and organizational skills, and the ability to work as a cloud developer/lead in an agile team to deliver automated cloud solutions. Key Responsibilities: - Proficient in Azure Data Services, Databricks, and Snowflake - Deep understanding of traditional and modern data architecture and processing concepts - Profic...

Why Join Us Are you inspired to grow your career at one of India's Top 25 Best Workplaces in IT industry Do you want to do the best work of your life at one of the fastest growing IT services companies Do you aspire to thrive in an award-winning work culture that values your talent and career aspirations It's happening right here at Iris Software. About Iris Software At Iris Software, our vision is to be our client's most trusted technology partner, and the first choice for the industry's top professionals to realize their full potential. With over 4,300 associates across India, U.S.A, and Canada, we help our enterprise clients thrive with technology-enabled transformation across financial s...

Why Join Us Are you inspired to grow your career at one of India's Top 25 Best Workplaces in IT industry Do you want to do the best work of your life at one of the fastest growing IT services companies Do you aspire to thrive in an award-winning work culture that values your talent and career aspirations It's happening right here at Iris Software. About Iris Software At Iris Software, our vision is to be our client's most trusted technology partner, and the first choice for the industry's top professionals to realize their full potential. With over 4,300 associates across India, U.S.A, and Canada, we help our enterprise clients thrive with technology-enabled transformation across financial s...

We are seeking an experienced PySpark Developer / Data Engineer to design, develop, and optimize big data processing pipelines using Apache Spark and Python (PySpark). The ideal candidate should have expertise in distributed computing, ETL workflows, data lake architectures, and cloud-based big data solutions. Key Responsibilities: Develop and optimize ETL/ELT data pipelines using PySpark on distributed computing platforms (Hadoop, Databricks, EMR, HDInsight). Work with structured and unstructured data to perform data transformation, cleansing, and aggregation. Implement data lake and data warehouse solutions on AWS (S3, Glue, Redshift), Azure (ADLS, Synapse), or GCP (BigQuery, Dataflow). Op...

Why Join Us Are you inspired to grow your career at one of Indias Top 25 Best Workplaces in IT industry Do you want to do the best work of your life at one of the fastest growing IT services companies Do you aspire to thrive in an award-winning work culture that values your talent and career aspirations Its happening right here at Iris Software. About Iris Software At Iris Software, our vision is to be our clients most trusted technology partner, and the first choice for the industrys top professionals to realize their full potential. With over 4,300 associates across India, U.S.A, and Canada, we help our enterprise clients thrive with technology-enabled transformation across financial servi...

DXFactor is a US-based tech company working with customers across the globe. We are a Great place to work with certified company. We are looking for candidates for Data Engineer (4 to 6 Yrs exp) We have our presence in: US India (Ahmedabad, Bangalore) Location : Ahmedabad Website : www.DXFactor.com Designation: Data Engineer (Expertise in SnowFlake, AWS & Python) Key Responsibilities Design, develop, and maintain scalable data pipelines for batch and streaming workflows Implement robust ETL/ELT processes to extract data from various sources and load into data warehouses Build and optimize database schemas following best practices in normalization and indexing Create and maintain documentatio...

A career in the Advisory Acceleration Centre at PwC is an opportunity to leverage PwC's global delivery capabilities and provide premium, cost-effective, and high-quality services to support client engagements. As an Azure Senior Developer at PwC - AC, you will collaborate with the Offshore Manager and Onsite Business Analyst to grasp the project requirements and take charge of the complete implementation of Cloud data engineering solutions. Your role will involve utilizing your expertise in Azure cloud services such as Storage services (Blob, ADLS, PaaS SQL), Azure Data Factory, and Azure Synapse. You should excel in planning, organization, and have the ability to lead as a cloud developer ...