506 Datafactory Jobs - Page 9

We are looking for a Strategic thinker, have ability grasp new technologies, innovate, develop, and nurture new solutions. a self-starter to work in a diverse and fast-paced environment to support, maintain and advance the capabilities of the unified data platform. This a global role that requires partnering with the broader JLLT team at the country, regional and global level by utilizing in-depth knowledge of cloud infrastructure technologies and platform engineering experience. Responsibilities Developing ETL/ELT pipelines using Synapse pipelines and data flows Integrating Synapse with other Azure data services (Data Lake Storage, Data Factory, etc.) Building and maintaining data warehousi...

About The Role Skill required: Tech for Operations - Structured Query Language (SQL) Designation: App Automation Eng Senior Analyst Qualifications: Undergraduate - Diploma in Any Discipline Years of Experience: 5 to 8 years What would you do? "Accenture is one of the foremost global professional services company that helps the worlds leading businesses, governments and other organizations build their digital core, optimize their operations, accelerate revenue growth and enhance citizen servicescreating tangible value at speed and scale. We are a talent- and innovation-led company with approximately 743,000 people serving clients in more than 120 countries. In our Service Supply Chain offerin...

Contractual Hiring manager :- My profile :- linkedin.com/in/yashsharma1608 Payroll of :- https://www.nyxtech.in/ 1. AZURE DATA ENGINEER WITH FABRIC The Role : Lead Data Engineer PAYROLL Client - Brillio About Role: Experience 6 to 8yrs Location- Bangalore , Hyderabad , Pune , Chennai , Gurgaon (Hyderabad is preferred) Notice- 15 days / 30 days. Budget -15 LPA AZURE FABRIC EXP MANDATE Skills : Azure Onelake, datapipeline , Apache Spark , ETL , Datafactory , Azure Fabric , SQL , Python/Scala. Key Responsibilities: Data Pipeline Development: Lead the design, development, and deployment of data pipelines using Azure OneLake, Azure Data Factory, and Apache Spark, ensuring efficient, scalable, and...

This is a remote position. 1. Python & PySpark 2. Azure Cloud Services such Synapse & Data Bricks & Data Factory (Data Bricks is mandatory) 3. OOPS Concept 4. Data Modelling with scalability Assure that data is cleansed, mapped, transformed, and otherwise optimised for storage and use according to business and technical requirements Solution design using Microsoft Azure services and other tools The ability to automate tasks and deploy production standard code (with unit testing, continuous integration, versioning etc.) Load transformed data into storage and reporting structures in destinations including data warehouse, high speed indexes, real-time reporting systems and analytics application...

Senior Solution Architect: RoleOverview Experienced Senior Solution Architect Data to lead the design and governance ofenterprise-wide data platforms and analytics solutions. Lead design andoptimisation of the data ecosystem for a large engineering enterprise with adiverse application landscape that includes multiple ERPs (Baan, Oracle, SAP), cloud platforms, and SaaS solutions. Demonstratedtechnical expertise with strong architectural leadership is a must for therole. Key Responsibilities Define and govern the enterprise data architecture, ensuring alignment with business strategy and IT standards. Design end-to-end data solutions across ingestion, storage, modelling, analytics, and governa...

Job Description ABOUT THIS JOB Measuring what consumers buy is at the core of Nielsen. We track consumer behavior for more than 250,000 households in 25 countries through our industry-leading consumer panel, which is a part of the Consumer Intelligence business. We also work with clients across the FMCG industry on research & analytic projects to unlock growth opportunities for their brands. This will be responsible for implementing these projects on modernized Business Intelligence infrastructure, supporting clients across North America, Europe and Asia Pacific. You are part of a 40-person team dedicated to producing and delivering data coming from Ad ’hoc consumer panel analysis. Your focu...

Job Description: Python, SQL, ADF, Databricks ( PySpark, DLT, Unity Catalog, Performance Tuning, Cost Optimization ) along with leadership(self driven, responsible, accountable, Ownership and soft skill (communication, good mindset and behavioural attitude Databricks Associate or professional Certification.

Job Description ABOUT THIS JOB Measuring what consumers buy is at the core of Nielsen. We track consumer behavior for more than 250,000 households in 25 countries through our industry-leading consumer panel, which is a part of the Consumer Intelligence business. We also work with clients across the FMCG industry on research & analytic projects to unlock growth opportunities for their brands. This will be responsible for implementing these projects on modernized Business Intelligence infrastructure, supporting clients across North America, Europe and Asia Pacific. You are part of a 40-person team dedicated to producing and delivering data coming from Ad ’hoc consumer panel analysis. Your focu...

Mandate Skills: Databricks, Datafactory, Pyspark, SQL Responsibility: 5+ Years of experience using Azure. Strong proficiency in Databricks. Experience with Pyspark. Proficiency in SQL or TSQL. Experience in Azure service components like Azure data factory, Azure data lake, Databricks, SQL DB SQL Server. Databricks Jobs for efficient data processing ETL tasks and report generation.

Mandate Skills: Databricks, Datafactory, Pyspark, SQL Responsibility: 5+ Years of experience using Azure. Strong proficiency in Databricks. Experience with Pyspark. Proficiency in SQL or TSQL. Experience in Azure service components like Azure data factory, Azure data lake, Databricks, SQL DB SQL Server. Databricks Jobs for efficient data processing ETL tasks and report generation.

Mandate Skills: Databricks, Datafactory, Pyspark, SQL Responsibility: 5+ Years of experience using Azure. Strong proficiency in Databricks. Experience with Pyspark. Proficiency in SQL or TSQL. Experience in Azure service components like Azure data factory, Azure data lake, Databricks, SQL DB SQL Server. Databricks Jobs for efficient data processing ETL tasks and report generation.

Mandate Skills: Databricks, Datafactory, Pyspark, SQL Responsibility: 5+ Years of experience using Azure. Strong proficiency in Databricks. Experience with Pyspark. Proficiency in SQL or TSQL. Experience in Azure service components like Azure data factory, Azure data lake, Databricks, SQL DB SQL Server. Databricks Jobs for efficient data processing ETL tasks and report generation.

Mandate Skills: Databricks, Datafactory, Pyspark, SQL Responsibility: 5+ Years of experience using Azure. Strong proficiency in Databricks. Experience with Pyspark. Proficiency in SQL or TSQL. Experience in Azure service components like Azure data factory, Azure data lake, Databricks, SQL DB SQL Server. Databricks Jobs for efficient data processing ETL tasks and report generation.

Mandate Skills: Databricks, Datafactory, Pyspark, SQL Responsibility: 5+ Years of experience using Azure. Strong proficiency in Databricks. Experience with Pyspark. Proficiency in SQL or TSQL. Experience in Azure service components like Azure data factory, Azure data lake, Databricks, SQL DB SQL Server. Databricks Jobs for efficient data processing ETL tasks and report generation.

This is a remote position. 1. Python PySpark 2. Azure Cloud Services such Synapse Data Bricks Data Factory (Data Bricks is mandatory) 3. OOPS Concept 4. Data Modelling with scalability Key Responsibilities: Design, develop, and maintain scalable and robust data pipelines to support data processing and analysis. Collaborate with cross-functional teams to understand data requirements and implement effective solutions. Perform data modeling and design to ensure the integrity, availability, and performance of data systems. Implement and optimize ETL processes for extracting, transforming, and loading data from various sources into our data warehouse. Identify and troubleshoot data-related issues...

Create Solution Outline and Macro Design to describe end to end product implementation in Data Platforms including, System integration, Data ingestion, Data processing, Serving layer, Design Patterns, Platform Architecture Principles for Data platform Contribute to pre-sales, sales support through RfP responses, Solution Architecture, Planning and Estimation Contribute to reusable components / asset / accelerator development to support capability development Participate in Customer presentations as Platform Architects / Subject Matter Experts on Big Data, Azure Cloud and related technologies Participate in customer PoCs to deliver the outcomes Participate in delivery reviews / product review...

About The Role Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : SAP Information Lifecycle management ILM Good to have skills : NA Minimum 7.5 year(s) of experience is required Educational Qualification : BE Summary :As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact. You will be responsible for overseeing the application development process and ensuring successful project delivery. Roles & Responsibilities:- Expected to be an SME- Collaborate and manage the team to perform- Responsi...

Create Solution Outline and Macro Design to describe end to end product implementation in Data Platforms including, System integration, Data ingestion, Data processing, Serving layer, Design Patterns, Platform Architecture Principles for Data platform Contribute to pre-sales, sales support through RfP responses, Solution Architecture, Planning and Estimation Contribute to reusable components / asset / accelerator development to support capability development Participate in Customer presentations as Platform Architects / Subject Matter Experts on Big Data, Azure Cloud and related technologies Participate in customer PoCs to deliver the outcomes Participate in delivery reviews / product review...

Responsibilities: * Design, implement & optimize Azure infrastructure solutions. * Collaborate with cross-functional teams on project delivery. * Manage Azure networks, VMs, storage, DAF, DBs & data pipelines. *Azure Data Migration Food allowance Health insurance Provident fund Annual bonus

Job Requirements Perform statistical analysis, identify trends, patterns, and anomalies within datasets using Python libraries such as NumPy, SciPy, and Scikit-learn. Develop and implement predictive models or machine learning algorithms to address specific business problems.Looking for a lead engineer for a data anawith good knowledge in Python Programming ,Experience in working with core data analytics libraries in Python (Pandas, Numpy). He / she should have Experience Web Frameworks & APIs (Flask, FastApi) and containerization , Docker. Experienced and having knowledge in building ETL pipelines, data engineering workflows and Data Visualization (spark, plotly, Dash, SQL) Experience in wo...

Design Databases & Data Warehouses, Power BI Solutions, Support Enterprise Business Intelligence, Strong Team Player & Contributor, Continuous Improvement Experience in SQL, Oracle, SSIS/SSRS, Azure, ADF, CI/CD, Power BI, DAX, Microsoft Fabric Required Candidate profile Source system data structures, data extraction, data transformation, warehousing, DB administration, query development, and Power BI. Develop WORK FROM HOME

We are looking for a skilled and experienced Data Engineer with experience in building scalable data solutions on the Microsoft Azure ecosystem . The ideal candidate must have strong hands-on experience with Azure Databricks , along with Spark , Python and SQL expertise. Familiarity with Data Lake , Data Warehouse concepts, and end-to-end data pipelines is essential. Key Responsibilities: Lead the design end-to-end data engineering solutions across cloud platforms. Develop and oversee robust data pipelines and ETL workflows using Python and Apache Spark. Implement scalable Delta Lake solutions for structured and semi-structured data. Orchestrate complex workflows using Databricks Workflows o...

Data engineering emphasis supports the ongoing digital transformation and modernization of internal audit's risk assessment, automation efforts, and risk monitoring activities. This position is responsible for supporting Internal Audit engagements with scalable, end-to-end ETL and analytic processes. Additionally, the role is responsible for working closely with data analytics teams to create robust scripted data solutions, develop and support business monitoring tools, and support existing data systems and analytic reports. This includes identifying and integrating data sources, assessing data quality, and developing and executing data analytic tools/languages to support enterprise analytic...

Responsibilities: * Collaborate with cross-functional teams on project delivery. * Design, implement & optimize Azure solutions using certified expertise. * Ensure compliance, security & scalability standards met. Food allowance Health insurance Provident fund Annual bonus

As an ETL Test Engineer, you will play a crucial role in performing manual and automation testing to validate data sources, extract data, apply transformation logic, and load data into target tables. Your primary responsibility will involve closely collaborating with Data Engineering teams to gather requirements, understand data needs, and translate them into effective test cases. Additionally, you will design, build, and maintain test plans and cases specifically tailored for ETL and data testing processes. Your day-to-day tasks will include conducting data validation and testing to ensure the accuracy, consistency, and compliance of data. You will be responsible for executing both manual a...