505 Datafactory Jobs - Page 4

Data Engineer having good experience on Azure Databricks and Python Must Have Databricks Python Azure Good to have ADF Candidate must be proficient in Databricks

Data Engineer having good experience on Azure Databricks and Python Must Have Databricks Python Azure Good to have ADF Candidate must be proficient in Databricks

Data Engineer having good experience on Azure Databricks and Python Must Have Databricks Python Azure Good to have ADF Candidate must be proficient in Databricks

Data Engineer having good experience on Azure Databricks and Python Must Have Databricks Python Azure Good to have ADF Candidate must be proficient in Databricks

Responsibilities: We are looking for a highly skilled Databricks & Azure Senior Data Engineer with at least 6 to 10 years of experience to join our vibrant Data & Analytics team. The ideal candidate should have strong background in Azure data services, including Databricks, Synapse Analytics, Microsoft Fabric, PySpark and SQL. He/She will be responsible for designing, building, and maintaining scalable data solutions that meet business requirements and align with industry best practices. What is expected out of you? 6+ years of experience as a Databricks & Data Engineer, building Azure-based data solutions using Data Factory, Synapse, Databricks. Expertise in Python, SQL (SparkSQL, TSQL, PLS...

Role & responsibilities Senior Azure Data Engineer ( Microsoft Azure Data Bricks Certificate and BPO Background mandatory) zure SQL Experience: Azure SQL Database or server Database design and optimization Query optimization Data transformation processes Data management in Azure Azure Data Factory Expertise: Azure Data Factory (ADF) ETL pipelines Data orchestration Automating data workflows Data integration (including REST APIs) ADF connectors Python and Pandas Skills: Python programming Pandas for data manipulation Spark (for large data processing) Data transformation and cleaning Optimized code for data processing Handling large datasets Azure Functions for Data Processing: Azure Functions...

Skill: Databricks Experience: 6 to 13 years Location: Bhubaneswar Job description Responsibilities: Designing, building, and deploying data pipelines and workflows using Databricks. Developing and optimizing Apache Spark applications for data processing and analytics. Integrating Databricks with various data sources and platforms. Implementing data quality checks and monitoring processes. Managing and configuring the Databricks environment, including clusters and notebooks. Troubleshooting and resolving issues related to Databricks performance and functionality. Collaborating with data scientists and analysts to implement machine learning models. Staying up-to-date with the latest Databricks...

Skill: Databricks Experience: 6 to 13 years Location: Bhubaneswar Job description Responsibilities: Designing, building, and deploying data pipelines and workflows using Databricks. Developing and optimizing Apache Spark applications for data processing and analytics. Integrating Databricks with various data sources and platforms. Implementing data quality checks and monitoring processes. Managing and configuring the Databricks environment, including clusters and notebooks. Troubleshooting and resolving issues related to Databricks performance and functionality. Collaborating with data scientists and analysts to implement machine learning models. Staying up-to-date with the latest Databricks...

Minimum of 15+ years overall IT industry experience Must Have- Extensive experience on Infrastructure and Terraform Azure Certification is highly preferred 5-8 years'' experience in Azure Cloud Infra and Platform architecture, design and implementation of high-volume web apps like Ecommerce Microservices, Data Transformation Solutions, Event Driven Architecture Solutions Sound experience in working with Azure Platforms enabling Microservices Architecture preferably in Ecommerce or High-volume web apps Hands-on experience in ARM templates and Terraform IaC to provision and configure Azure resources across Network, Storage, PaaS Platforms like AKS, Cosmos, Service Bus (or similar platforms) et...

Bachelor's degree in Computer Science, Information Technology, or a related field. A master's degree is a plus. Proven experience as a Data Engineer or in a similar role, with a focus on ETL processes and database management. Proficiency in the Microsoft Azure data management suite (MSSQL, Azure Databricks , PowerBI , Data factories, Azure cloud monitoring, etc.) and Python scripting. Strong knowledge of SQL and experience with database management systems Strong development skills in python and pyspark . Experience with data warehousing solutions and data mart creation. Familiarity with big data technologies (e.g., Hadoop, Spark) is a plus. Strong problem-solving skills and attention to deta...

As a Software Developer you'll participate in many aspects of the software development lifecycle, such as design, code implementation, testing, and support. You will create software that enables your clients' hybrid-cloud and AI journeys. Your primary responsibilities include: Comprehensive Feature Development and Issue ResolutionWorking on the end to end feature development and solving challenges faced in the implementation. Stakeholder Collaboration and Issue ResolutionCollaborate with key stakeholders, internal and external, to understand the problems, issues with the product and features and solve the issues as per SLAs defined. Continuous Learning and Technology IntegrationBeing eager t...

Create Solution Outline and Macro Design to describe end to end product implementation in Data Platforms including, System integration, Data ingestion, Data processing, Serving layer, Design Patterns, Platform Architecture Principles for Data platform Contribute to pre-sales, sales support through RfP responses, Solution Architecture, Planning and Estimation Contribute to reusable components / asset / accelerator development to support capability development Participate in Customer presentations as Platform Architects / Subject Matter Experts on Big Data, Azure Cloud and related technologies Participate in customer PoCs to deliver the outcomes Participate in delivery reviews / product review...

About The Role Skill required: Tech for Operations - Structured Query Language (SQL) Designation: App Automation Eng Senior Analyst Qualifications: Undergraduate - Diploma in Any Discipline Years of Experience: 5 to 8 years What would you do? "Accenture is one of the foremost global professional services company that helps the worlds leading businesses, governments and other organizations build their digital core, optimize their operations, accelerate revenue growth and enhance citizen servicescreating tangible value at speed and scale. We are a talent- and innovation-led company with approximately 743,000 people serving clients in more than 120 countries.In our Service Supply Chain offering...

We are seeking an experienced Data Engineer skilled in Azure Databricks, ADLS, ADF, PySpark/Spark, & SQL with strong expertise in Azure data solutions, distributed data processing. Design, develop & optimize large-scale data pipelines in Data bricks.

You will play a pivotal role in thedevelopment and maintenance of interactive client, investor and operational team facing dashboards using Tableau, Power BI and other visual analytics tools. You will work closely with clients and senior stakeholders to capture their BI requirements, conduct data analysis using SQL, Python (orother open-source languages), and visualise the insights in an impactful manner. What you'll do You'll demonstrate expert-level proficiency in Analytics and BI, applying advanced knowledge of conceptual and physical BI implementations, dimensional data modeling, and real-time analytics solutions across various platforms. You'll interact confidently with external clients...

Position : Data Engineer Senior Consultant Location : Hyderabad (Work From Office) Shift : Night Shifts(08:30 PM to 05:30 AM) Two way cab provided Overall 12+ years of experience with at least 5+ years of experience in working with SQL on MySQL and PostgreSQL databases. Must be skilled in working with advanced SQL functions such as CTEs, window functions, procedural SQL, stored procedures, triggers etc. Significant experience in setting up, securing, and administering databases on premise or cloud (MS Azure). Demonstrated experience in managing data and related infrastructure on MS Azure. Demonstrated experience in building and orchestrating performant, secure, and cost-effective data pipeli...

Senior Solution Architect: RoleOverview Experienced Senior Solution Architect Data to lead the design and governance ofenterprise-wide data platforms and analytics solutions. Lead design andoptimisation of the data ecosystem for a large engineering enterprise with adiverse application landscape that includes multiple ERPs (Baan, Oracle, SAP), cloud platforms, and SaaS solutions. Demonstratedtechnical expertise with strong architectural leadership is a must for therole. Key Responsibilities Define and govern the enterprise data architecture, ensuring alignment with business strategy and IT standards. Design end-to-end data solutions across ingestion, storage, modelling, analytics, and governa...

As a Software Developer you'll participate in many aspects of the software development lifecycle, such as design, code implementation, testing, and support. You will create software that enables your clients' hybrid-cloud and AI journeys. Your primary responsibilities include: Comprehensive Feature Development and Issue ResolutionWorking on the end to end feature development and solving challenges faced in the implementation. Stakeholder Collaboration and Issue ResolutionCollaborate with key stakeholders, internal and external, to understand the problems, issues with the product and features and solve the issues as per SLAs defined. Continuous Learning and Technology IntegrationBeing eager t...

Create Solution Outline and Macro Design to describe end to end product implementation in Data Platforms including, System integration, Data ingestion, Data processing, Serving layer, Design Patterns, Platform Architecture Principles for Data platform Contribute to pre-sales, sales support through RfP responses, Solution Architecture, Planning and Estimation Contribute to reusable components / asset / accelerator development to support capability development Participate in Customer presentations as Platform Architects / Subject Matter Experts on Big Data, Azure Cloud and related technologies Participate in customer PoCs to deliver the outcomes Participate in delivery reviews / product review...

As a Software Developer you'll participate in many aspects of the software development lifecycle, such as design, code implementation, testing, and support. You will create software that enables your clients' hybrid-cloud and AI journeys. Your primary responsibilities include: Comprehensive Feature Development and Issue ResolutionWorking on the end to end feature development and solving challenges faced in the implementation. Stakeholder Collaboration and Issue ResolutionCollaborate with key stakeholders, internal and external, to understand the problems, issues with the product and features and solve the issues as per SLAs defined. Continuous Learning and Technology IntegrationBeing eager t...

SQL and scripting for data validation Experience with Python or PySpark for automated data testing Hands-on experience testing in Databricks, Snowflake, and Fabric environments Required Candidate profile Prior experience with automation tools and testing frameworks like Great Expectations and dbt tests Knowledge of Azure Data Factory is a plus

8+ years of overall IT experience with minimum 5 years leading a small team of Azure Data Engineers 5+ years of experience with Database Development and Data Integration initiatives 5+ years of experience building ETL/ELT solutions using Azure data integration tools such as Azure Data Factory, Azure Functions, Logic Apps and Databricks Highly experienced with DLTs, Unity Catalog, Databricks SQL and Workflows. Hands-on experience in Azure Databricks & Pyspark to develop ETL pipelines, Strong experience reading and writing queries in Azure or any relational database is required. Prior knowledge of best practices in SDLC and use of source control management tool preferably Azure DevOps to GitHu...

Name of Position: Databricks Lead No. of Positions : 1 Company Name: Whiteblue Cloud Services Location: Chennai, Tamil Nadu Job Description Role Overview: We are looking for an experienced Databricks Lead to design, develop, and optimize large-scale data solutions leveraging Azure Databricks, Azure Data Factory, and PySpark . The ideal candidate will have strong leadership skills, hands-on technical expertise, and a passion for driving cloud-based data modernization initiatives. Key Responsibilities Lead end-to-end data engineering and modernization projects using Azure Databricks and related technologies. Design, develop, and maintain scalable data pipelines and workflows using Azure Data F...

Experience : 7-10 Years Location : Mumbai/Pune/Bangalore Must-Have: Python (Pandas, PySpark) Data engineering & workflow optimization Delta Tables, Parquet Good-to-Have: Databricks Apache Spark, DBT, Airflow Advanced Pandas optimizations PyTest/DBT testing frameworksRole & responsibilities Preferred candidate profile

- AI architecture deployment and scaling - Agentic RAG, Gen AI Hub, Langchain, Python, .NET, Microsoft AI services, Azure ML, Databricks, Data Factory, TensorFlow, scikit-learn - DevOps, Azure Cloud, CI/CD, containerization, MLOps, LLMs/SLMs