317 Datafactory Jobs - Page 13

Sr Data Engineer SR DE-II Highly skilledDataEngineerwith minimum 6+ years of relevant experience in SQL, PySpark, ETL,DataLakes and Azure Tech Stack. Responsibilities 4+ years of experience in buildingdataPipelines with Python/PySpark. 5+ years of experience in Azure ETL stack ( eg. Blog Storage,DataLake,DataFactory, Synapse). 4+ years of experience with SQL. Proficient understanding of code versioning tools such as Git and PM tool like Jira. Should have Experience in Leading the Team Qualifications Excellent verbal and written communication skills. UG: B.Sc in Any Specialization, BCA in Any Specialization, B.Tech/B.E. in Any Specialization. A good internet connection is a must. Azure certifications will be a bonus

Role & responsibilities Bachelors or Master’s degree in Computer Science, Information Systems, Engineering. 7+ years of relevant experience in Data architecture, Design, engineering, or related roles with overall 15+ years of experience. Proven experience designing data solutions in cloud environments (AWS, Azure, or GCP). Hands-on experience with Data modeling, Data warehousing, and Big data technologies. Expertise in SQL and Data modeling techniques. Proficiency in tools such as Apache Spark, Kafka, Airflow, Informatica, Talend, or similar. Strong understanding of security, compliance, and governance in data architecture. Familiarity with BI and analytics tools (PowerBI, Tableau, etc.) Strong communication and stakeholder management skills.

Position : Data Engineer Senior Consultant Location : Hyderabad (Work From Office) Shift : Night Shifts(08:30 PM to 05:30 AM) Two way cab provided Overall 12+ years of experience with at least 5+ years of experience in working with SQL on MySQL and PostgreSQL databases. Must be skilled in working with advanced SQL functions such as CTEs, window functions, procedural SQL, stored procedures, triggers etc. Significant experience in setting up, securing, and administering databases on premise or cloud (MS Azure). Demonstrated experience in managing data and related infrastructure on MS Azure. Demonstrated experience in building and orchestrating performant, secure, and cost-effective data pipelines. Experience in building BI reports using MS Power BI (DAX and Power Query) is required. Advanced knowledge of ETL tools such as MS Data factory, Airflow etc. Demonstrated experience in working with a variety of data sources such as databases (SQL/NoSQL), APIs, data lakes, spreadsheets etc. is required. Experience with MS Fabric and related technologies is an asset. Experience with MS Purview is an asset. Experience in developing data models, schema and architecture of data warehouse or a data lake is required. Demonstrated programming skills in Python and Spark for data engineering/processing tasks. Strong analytical, problem solving and data analysis skills. Ability to manage multiple concurrent tasks and competing demands under tight deadlines. Ability to ensure data privacy and confidentiality. Familiarity with working in an agile environment.

We are looking for a skilled and experienced Microsoft Fabric Data Engineer Lead with strong experience in designing, implementing, and managing data engineering solutions using Microsoft Fabrica unified platform for data integration, analytics, and governance Role Overview Architect scalable data solutions using Fabric components like Lake houses, Pipelines, and Dataflows Lead data ingestion and transformation using tools such as Azure Data Factory, PySpark, SQL, and Kusto Query Language (KQL) Ensure data quality and governance across Bronze (raw), Silver (cleansed), and Gold (curated) layers Collaborate with cross-functional teams including analytics engineers, architects, and business stakeholders Optimize performance and scalability of the data platform through monitoring and tuning Mentor junior engineers and guide best practices in data engineering Design and implement data models and schemas to support business requirements. Ensure data accuracy, consistency, and reliability. Optimize data structures for performance and scalability. Good experience on Azure Purview integrating data pipelines with Purview for Data lineage, experience with Microsoft Fabric, migrating the application from Azure Data Factory and Azure Synapse to Microsoft Fabric Implement robust data security measures, including encryption, access control, and data masking. Ensure compliance with data privacy regulations and company policies. Monitor and optimize data pipelines and queries for performance and efficiency. Implement caching, partitioning, and indexing strategies. Troubleshoot and resolve performance issues. Establish and enforce data quality standards. Implement data governance practices, metadata management, and data lineage tracking. Ensure data quality through validation and cleansing processes. Collaborate with business stakeholders to understand data requirements and deliver. Create and maintain comprehensive technical documentation, including system architecture, design documents, and deployment procedures. Ensure knowledge sharing within the team. Implement Lean daily management and Lean continuous improvement concepts in Application development and operations. Required Qualifications Bachelor's or master's degree in computer science, Information Technology, or a related field. Proven experience in Data integration and orchestration using Microsoft Fabric tools, Cloud platforms, especially Azure (Data Factory, Synapse, Power BI) and ETL/ELT pipelines, lakehouse architecture, and real-time analytics Strong foundation in SQL, PySpark, and Kusto Query Language (KQL) Excellent problem-solving skills and attention to detail, Strong communication and leadership skills. Relevant certifications (Microsoft Certified: Fabric Data Engineer Associate) are a plus. Preferred Qualifications Effective Communicator: Possess the ability to articulate complex technical concepts in a clear and concise manner, facilitating understanding across a wide range of audiences. Solution-Oriented Mindset: Demonstrated ability to approach challenges with a solutions-first attitude, proactively identifying and addressing potential obstacles. Change Advocate: Capable of spearheading and implementing change, showcasing a proactive approach to driving improvements and leading teams towards new initiatives. Leadership Qualities: Show a strong capacity to lead, influence, and guide teams, fostering a collaborative and productive work environment. Technical Translator: Excel at translating and breaking down intricate technical topics, ensuring that stakeholders at all levels have a clear understanding of the subject matter. Analytical Thinker: Possess an analytical and detail-oriented mindset, critically evaluating information derived from multiple sources and drawing meaningful conclusions. Team Player: Exhibit a strong willingness to collaborate and work cohesively with colleagues, understanding the importance of collective growth and knowledge sharing. Adaptability: Demonstrate resilience and adaptability in an ever-changing environment, staying updated with the latest technological advancements and best practices in the field of database administration.

#Employment Type: Contract Skills Azure Data Factory SQL Azure Blob Azure Logic Apps

As a Software Developer you'll participate in many aspects of the software development lifecycle, such as design, code implementation, testing, and support. You will create software that enables your clients' hybrid-cloud and AI journeys. Your primary responsibilities include: Comprehensive Feature Development and Issue ResolutionWorking on the end to end feature development and solving challenges faced in the implementation. Stakeholder Collaboration and Issue ResolutionCollaborate with key stakeholders, internal and external, to understand the problems, issues with the product and features and solve the issues as per SLAs defined. Continuous Learning and Technology IntegrationBeing eager to learn new technologies and implementing the same in feature development. Required education Bachelor's Degree Preferred education Master's Degree Required technical and professional expertise Proficient in .Net Core with React or Angular Experience in Agile teams applying the best architectural, design, unit testing patterns & practices with an eye for code quality and standards. AZURE FUNCTION, AZURE SERVICE BUS, AZURE STORAGE ACCOUNT- MANDATORY AZURE DURABLE FUNCTIONS AZURE DATA FACTORY, AZURE SQL OR COSMOS DB(DATABASE)Required Ability to write calculation rules and configurable consolidation rules. Preferred technical and professional experience Excellent written and verbal interpersonal skills for coordinating across teams. Should have at least 2 end to end implementation experience. Ability to write and update the rules of historical overrides.

Project description We are seeking an experienced Azure Cloud Support Engineer skilled in cloud architecture and Microsoft Azure. The ideal candidate will have advanced knowledge of Azure Cloud services, Configuration Management, knowledge on DevOps Deployment & Delivery methodologies. This role involves maintaining the A infrastructure and applications. Responsibilities Technical Support: Provide technical assistance and resolve issues related to Azure services, including system outages and performance slowdowns Troubleshooting: Diagnose and fix problems with cloud-based servers, storage, and networking Client Collaboration: Work closely with clients to understand their cloud computing needs and recommend suitable Azure solutions System Monitoring: Monitor system performance to ensure all elements of the Azure platform are functioning as expected Security Implementation: Implement security measures and ensure compliance with data protection regulations Documentation: Document technical issues and solutions in the support ticket system for future reference Training: Keep up-to-date with the latest Azure products and features and provide training to clients or internal teams when necessary Skills Must have Senior with more than 7 to 8 years of experience on the belowSkills and Experience: Experience with Microsoft Azure involving design, deployment, configuration, and optimization. Technical Skills: Proficiency in IaaS and PaaS solutions, scripting (Perl, Python, PowerShell), and infrastructure as code (IaC) tools like Terraform, Azure CLI, Puppet, and Ansible.Expertise & Hands-on Exposure on App Service Components:-Container Instances, Key Vault, Storage accounts, Batch accounts, Application Insights-Database for PostgreSQL, Data Factory, Service Bus, Analysis Services, Stream Analytics-Cosmos DB, Event Grid, Log Analytics, Availability Sets, Event Hubs, Load Balancer, -API Management Services, Logic Apps, Databricks, Function apps, SQL Database(Azure SQL and SQL Managed Instance), IoT Hub, Cognitive Services, Kubernetes Service Container Registry, Compute, Machine Learning, SignalR Service, Automation Accounts Application Gateway, Private endpoints

Key Responsibilities Design, develop, and maintain scalable ETL pipelines using Azure Data Factory , Azure Databricks , and other Azure services. Implement data ingestion, transformation, and integration workflows from multiple structured/unstructured sources. Work with Azure Data Lake Storage , Azure SQL Database , and Azure Synapse Analytics for data warehousing and analytics. Perform data modeling (star/snowflake schemas), database management, and query optimization. Ensure data security and compliance within Azure environments. Collaborate with cross-functional teams to align data solutions with business needs. Participate in DevOps practices for CI/CD deployment of data engineering solutions. Required Skills & Qualifications Bachelors degree in Computer Science, Information Systems, or a related field. Microsoft Certified: Azure Data Engineer Associate (mandatory). Strong expertise in Azure Data Factory, Azure Databricks, Azure SQL Database . Proficient in T-SQL, Python (or equivalent). Experience in data modeling, data warehousing, ETL development . Knowledge of Azure Data Lake Storage, Synapse Analytics . Familiarity with DevOps CI/CD pipelines for data solutions. Excellent problem-solving, analytical, and communication skills. Domain knowledge in Real Estate & Construction will be an added advantage. Good to Have Experience in big data frameworks like Spark, PySpark. Exposure to performance tuning, partitioning strategies, and cost optimization in Azure.

Project description A project is intended migrate a global application covering multiple workflows of a top Insurance company into Azure, develop a cloud native application from scratch. Application serves global and North American markets. Responsibilities Drive the development team towards the goal by integrating skills and experiences. Design, develop, test, deploy, maintain and improve the software. Work with QA, product management, and operations in an Agile environment. Develop and support data-driven product decisions in a high energy high-impact team. Develop features that will drive our business through real-time feedback loops. Skills Must have 5 to 6 years of hands-on Azure development expertise on the below .Net development experience is a must AZ App Services, Az Web Jobs, Az Functions, Az Logic Apps, ADF, Key Vault, Az Connectors; Nice to have .Net experience Location: Pune,Mumbai,Chennai,banagalore

Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : SAP Information Lifecycle management ILM Good to have skills : NAMinimum 7.5 year(s) of experience is required Educational Qualification : BE Summary :As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact. You will be responsible for overseeing the application development process and ensuring successful project delivery. Roles & Responsibilities:- Expected to be an SME- Collaborate and manage the team to perform- Responsible for team decisions- Engage with multiple teams and contribute on key decisions- Provide solutions to problems for their immediate team and across multiple teams- Lead the application development process- Ensure timely project delivery- Provide guidance and support to team members Professional & Technical Skills: - Must To Have Skills: Proficiency in SAP Information Lifecycle management ILM- Strong understanding of data lifecycle management- Experience in data archiving and retention policies- Knowledge of SAP data management solutions- Hands-on experience in SAP data migration- Experience in SAP data governance Additional Information:- The candidate should have a minimum of 7.5 years of experience in SAP Information Lifecycle management ILM- This position is based at our Hyderabad office- A BE degree is required Qualification BE

A proven and credible practitioner, your deep solution experience will help you lead a team of go-to subject matter experts. Fostering a culture of candour, collaboration, and growth-mindedness, you'll ensure co-creation across IBM Sales and client teams that drive investment in, and adoption of IBM's strategic platforms. Overseeing your teams' fusion of innovative solutions with modern IT architectures, integrated solutions, and offerings, you'll ensure they're helping to solve some of their clients most complex business challenges. We're committed to success. In this role, your achievements will drive your career, team, and clients to thrive. A typical day may involve: Strategic Team Leadership: Leading a team of technical sales experts to co-create innovative solutions with clients. Partnership and Prototype Excellence: Collaborating with IBM and partners to deliver compelling prototypes. Optimizing Resource Utilization: Promoting maximum use of IBM's Technology Sales resources. Required education Bachelor's Degree Preferred education Master's Degree Required technical and professional expertise Proficient in .Net Core with React or Angular Experience in Agile teams applying the best architectural, design, unit testing patterns & practices with an eye for code quality and standards. AZURE FUNCTION, AZURE SERVICE BUS, AZURE STORAGE ACCOUNT- MANDATORY AZURE DURABLE FUNCTIONS AZURE DATA FACTORY, AZURE SQL OR COSMOS DB(DATABASE)Required Ability to write calculation rules and configurable consolidation rules Preferred technical and professional experience Excellent written and verbal interpersonal skills for coordinating across teams. Should have at least 2 end to end implementation experience. Ability to write and update the rules of historical overrides

A proven and credible practitioner, your deep solution experience will help you lead a team of go-to subject matter experts. Fostering a culture of candour, collaboration, and growth-mindedness, you'll ensure co-creation across IBM Sales and client teams that drive investment in, and adoption of IBM's strategic platforms. Overseeing your teams' fusion of innovative solutions with modern IT architectures, integrated solutions, and offerings, you'll ensure they're helping to solve some of their clients most complex business challenges. We're committed to success. In this role, your achievements will drive your career, team, and clients to thrive. A typical day may involve: Strategic Team Leadership: Leading a team of technical sales experts to co-create innovative solutions with clients. Partnership and Prototype Excellence: Collaborating with IBM and partners to deliver compelling prototypes. Optimizing Resource Utilization: Promoting maximum use of IBM's Technology Sales resources. Required education Bachelor's Degree Preferred education Master's Degree Required technical and professional expertise Proficient in .Net Core with React or Angular Experience in Agile teams applying the best architectural, design, unit testing patterns & practices with an eye for code quality and standards. AZURE FUNCTION, AZURE SERVICE BUS, AZURE STORAGE ACCOUNT- MANDATORY AZURE DURABLE FUNCTIONS AZURE DATA FACTORY, AZURE SQL OR COSMOS DB(DATABASE)Required Ability to write calculation rules and configurable consolidation rules Preferred technical and professional experience Excellent written and verbal interpersonal skills for coordinating across teams. Should have at least 2 end to end implementation experience. Ability to write and update the rules of historical overrides

Create Solution Outline and Macro Design to describe end to end product implementation in Data Platforms including, System integration, Data ingestion, Data processing, Serving layer, Design Patterns, Platform Architecture Principles for Data platform Contribute to pre-sales, sales support through RfP responses, Solution Architecture, Planning and Estimation Contribute to reusable components / asset / accelerator development to support capability development Participate in Customer presentations as Platform Architects / Subject Matter Experts on Big Data, Azure Cloud and related technologies Participate in customer PoCs to deliver the outcomes Participate in delivery reviews / product reviews, quality assurance and work as design authority Required education Bachelor's Degree Preferred education Master's Degree Required technical and professional expertise Experience in designing of data products providing descriptive, prescriptive, and predictive analytics to end users or other systems Experience in data engineering and architecting data platforms Experience in architecting and implementing Data Platforms Azure Cloud Platform Experience on Azure cloud is mandatory (ADLS Gen 1 / Gen2, Data Factory, Databricks, Synapse Analytics, Azure SQL, Cosmos DB, Event hub, Snowflake), Azure Purview, Microsoft Fabric, Kubernetes, Terraform, Airflow Experience in Big Data stack (Hadoop ecosystem Hive, HBase, Kafka, Spark, Scala PySpark, Python etc.) with Cloudera or Hortonworks Preferred technical and professional experience Experience in architecting complex data platforms on Azure Cloud Platform and On-Prem Experience and exposure to implementation of Data Fabric and Data Mesh concepts and solutions like Microsoft Fabric or Starburst or Denodo or IBM Data Virtualisation or Talend or Tibco Data Fabric Exposure to Data Cataloging and Governance solutions like Collibra, Alation, Watson Knowledge Catalog, dataBricks unity Catalog, Apache Atlas, Snowflake Data Glossary etc

Job description Expirence - 5+ Years Location - Hyderabad / Chennai / Bangalore / Pune - Anylocation Mandatory skills* React, .Net Core and Azure Role & responsibilities Professional with Microsoft Web development using ASP.NET, MVC and WebAPI, should be hands-on and Microsoft Azure. Hands on experience on.NET Core 5+ Must have experience in development using client-side scripting using Typescript with ReactJS 18+. Good knowledge and understanding of Microsoft Azure PaaS features. Hands on experience on Functions and Web Apps, Logic Apps, SQL DB, Azure Storage, Data Factory etc. Experience creating Tables, writing stored procedures and queries in SQL Server. Working knowledge of Entity Framework or equivalent frameworks Creating, deploying, configuring applications on Azure PaaS Experience with Azure DevOps Experience with client interaction, requirement gathering, architecture planning, designing solution approach, individual contributor/developer. Preferred candidate profile If you feel JD suits your profile kindly share me your update CV for below email id -Kavyacn@radiants.com

Capgemini Invent Capgemini Invent is the digital innovation, consulting and transformation brand of the Capgemini Group, a global business line that combines market leading expertise in strategy, technology, data science and creative design, to help CxOs envision and build whats next for their businesses. Your role Develop and maintain data pipelines tailored to Azure environments, ensuring security and compliance with client data standards. Collaborate with cross-functional teams to gather data requirements, translate them into technical specifications, and develop data models. Leverage Python libraries for data handling, enhancing processing efficiency and robustness. Ensure SQL workflows meet client performance standards and handle large data volumes effectively. Build and maintain reliable ETL pipelines, supporting full and incremental loads and ensuring data integrity and scalability in ETL processes. Implement CI/CD pipelines for automated deployment and testing of data solutions. Optimize and tune data workflows and processes to ensure high performance and reliability. Monitor, troubleshoot, and optimize data processes for performance and reliability. Document data infrastructure, workflows, and maintain industry knowledge in data engineering and cloud tech. Your Profile Bachelors degree in computer science, Information Systems, or a related field 4+ years of data engineering experience with a strong focus on Azure data services for client-centric solutions. Extensive expertise in Azure Synapse, Data Lake Storage, Data Factory, Databricks, and Blob Storage, ensuring secure, compliant data handling for clients. Good interpersonal communication skills Skilled in designing and maintaining scalable data pipelines tailored to client needs in Azure environments. Proficient in SQL and PL/SQL for complex data processing and client-specific analytics. What you will love about working here We recognize the significance of flexible work arrangements to provide support. Be it remote work, or flexible work hours, you will get an environment to maintain healthy work life balance. At the heart of our mission is your career growth. Our array of career growth programs and diverse professions are crafted to support you in exploring a world of opportunities. Equip yourself with valuable certifications in the latest technologies such as Generative AI. About Capgemini Capgemini is a global business and technology transformation partner, helping organizations to accelerate their dual transition to a digital and sustainable world, while creating tangible impact for enterprises and society. It is a responsible and diverse group of 340,000 team members in more than 50 countries. With its strong over 55-year heritage, Capgemini is trusted by its clients to unlock the value of technology to address the entire breadth of their business needs. It delivers end-to-end services and solutions leveraging strengths from strategy and design to engineering, all fueled by its market leading capabilities in AI, cloud and data, combined with its deep industry expertise and partner ecosystem. The Group reported 2023 global revenues of 22.5 billion.

Capgemini Invent Capgemini Invent is the digital innovation, consulting and transformation brand of the Capgemini Group, a global business line that combines market leading expertise in strategy, technology, data science and creative design, to help CxOs envision and build whats next for their businesses. Your role Develop and maintain data pipelines tailored to Azure environments, ensuring security and compliance with client data standards. Collaborate with cross-functional teams to gather data requirements, translate them into technical specifications, and develop data models. Leverage Python libraries for data handling, enhancing processing efficiency and robustness. Ensure SQL workflows meet client performance standards and handle large data volumes effectively. Build and maintain reliable ETL pipelines, supporting full and incremental loads and ensuring data integrity and scalability in ETL processes. Implement CI/CD pipelines for automated deployment and testing of data solutions. Optimize and tune data workflows and processes to ensure high performance and reliability. Monitor, troubleshoot, and optimize data processes for performance and reliability. Document data infrastructure, workflows, and maintain industry knowledge in data engineering and cloud tech. Your Profile Bachelors degree in computer science, Information Systems, or a related field 4+ years of data engineering experience with a strong focus on Azure data services for client-centric solutions. Extensive expertise in Azure Synapse, Data Lake Storage, Data Factory, Databricks, and Blob Storage, ensuring secure, compliant data handling for clients. Good interpersonal communication skills Skilled in designing and maintaining scalable data pipelines tailored to client needs in Azure environments. Proficient in SQL and PL/SQL for complex data processing and client-specific analytics. What you will love about working here We recognize the significance of flexible work arrangements to provide support. Be it remote work, or flexible work hours, you will get an environment to maintain healthy work life balance. At the heart of our mission is your career growth. Our array of career growth programs and diverse professions are crafted to support you in exploring a world of opportunities. Equip yourself with valuable certifications in the latest technologies such as Generative AI. About Capgemini Capgemini is a global business and technology transformation partner, helping organizations to accelerate their dual transition to a digital and sustainable world, while creating tangible impact for enterprises and society. It is a responsible and diverse group of 340,000 team members in more than 50 countries. With its strong over 55-year heritage, Capgemini is trusted by its clients to unlock the value of technology to address the entire breadth of their business needs. It delivers end-to-end services and solutions leveraging strengths from strategy and design to engineering, all fueled by its market leading capabilities in AI, cloud and data, combined with its deep industry expertise and partner ecosystem. The Group reported 2023 global revenues of 22.5 billion.

Active Directory,Synapse,Data Factory,Databricks,Vnet,Storage Account,Virtual Machine,Key Vault,Defender,ExpressRoute,PowerBi ,VPN Gateway, Integration Runtime, Custom role creation, Billing&cost optimization, Documentation