642 Datafactory Jobs - Page 2

Role & responsibilities We are seeking an experienced Data Engineer to design, build, and optimize data pipelines and solutions on modern big data platforms. The ideal candidate will have strong expertise in PySpark , Databricks , and distributed data processing frameworks, with a passion for delivering scalable and efficient data solutions. Key Responsibilities Design, develop, and maintain ETL pipelines using PySpark and Databricks . Work with large-scale datasets to ensure data quality, integrity, and availability. Optimize data workflows for performance and cost efficiency in cloud environments (Azure/AWS/GCP). Collaborate with data scientists, analysts, and business teams to deliver rel...

Description: Description We are seeking a skilled DevOps Engineer to join our growing DevOps team. The role focuses on optimizing the software delivery lifecycle, enhancing automation, improving system reliability, and enabling seamless collaboration between development and operations. Requirements: Requirements Hands-on experience with Terraform for infrastructure provisioning. Strong knowledge of Docker, Kubernetes, and container orchestration. Experience in Azure or AWS (AKS, EKS, VM/EC2, S3/Blob, Data Factory, Kinesis, native monitoring tools). Proficiency in CI/CD tools such as Jenkins and GitHub Actions. Strong scripting skills in Python or Shell. Experience with GitHub/GitLab, Artifac...

Role & responsibilities Discuss with all teams to Plan, implement solutions to Ingest Data into Global Datalake Design, build and automate such Ingestion Process Develop and maintain data models and schemas that facilitate data integration and analysis. Work closely with Global teams Implement effective metrics, monitor, and proactively optimize ETL/ELT process performances, troubleshoot issues, and implement improvements to enhance data process efficiency in the data lifecycle. Collaborate with data analysts, data stewards and business stakeholders to understand their data requirements and translate them into technical specifications. Develop & Support Power BI Reports Develop & SupportPowe...

Must have skills : Databricks Unified Data Analytics Platform Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary: As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implementing ETL processes to migrate and deploy data across various systems. You will collaborate with cross-functional teams to understand data requirements and deliver effective solutions that meet business needs. Your role will also include troubleshooting data issues and optimizin...

A proven and credible practitioner, your deep solution experience will help you lead a team of go-to subject matter experts. Fostering a culture of candour, collaboration, and growth-mindedness, you'll ensure co-creation across IBM Sales and client teams that drive investment in, and adoption of IBM's strategic platforms. Overseeing your teams' fusion of innovative solutions with modern IT architectures, integrated solutions, and offerings, you'll ensure they're helping to solve some of their clients most complex business challenges. We're committed to success. In this role, your achievements will drive your career, team, and clients to thrive. A typical day may involve: Strategic Team Leade...

Roles & Responsibilities: Design, develop, and maintain scalable data pipelines and ETL processes using Azure Data Factory and related services. Work with large, complex datasets and ensure data integrity, quality, and security. Implement and optimize data storage solutions (Azure SQL Database, Azure Data Lake, Synapse, etc.). Collaborate with business and technical teams to gather requirements and deliver efficient data solutions. Monitor and improve performance, reliability, and cost-efficiency of data workflows. Ensure adherence to best practices in data engineering, security, and compliance. Support data scientists and analysts by providing clean, reliable, and well-structured data. Requ...

Role: Data Engineer Location: Hyderabad Experience: 6 - 8 years Job description: Databricks, Python, PySpark, Spark SQL Must have 4+ years of IT experience 2. Excellent coding skills in Python, PySpark,Spark SQL. 3. Excellent understanding on Databricks ETL concepts. 4. Ability to integrate multiple data sources. 5. Must have good hands-on knowledge of Git CI/CD process. 6. Need to have an independent and analytical approach work. 7. Identify bottlenecks and bugs, and devise a solution to these problems.

• Having good implementation experience in :Azure Services: Azure Data Factory, Azure Databricks, Azure SQL, Azure Data Lake Storage (ADLS), Azure Key Vault, Programming & Frameworks: Python, PySpark, Spark SQL BE/B.Tech/Masters in Computer Science

Design and develop end-to-end AI solutions using Azure AI services. Implement data integration pipelines using Azure Data Factory, Synapse/Fabric, and Spark Notebooks. Build real-time, AI-powered dashboards integrating model outputs into Power BI / Fabric dashboards. Develop and deploy cloud-native applications using Helm, Docker, and Kubernetes. Ensure ethical AI development, bias mitigation, and responsible AI practices aligned with Azure's Responsible AI toolkit. Collaborate with cross-functional teams to identify business requirements and develop solutions. Job Requirements At least 3 years of experience in AI/ML development, with at least 1 year focused on Generative AI. Proficient in P...

Job description Job Summary: We are seeking a talented Data Engineer with strong expertise inAzure , Databricks, specifically in Unity Catalog, PySpark, and SQL, to join our data team. Youll play a key role in building secure, scalable data pipelines and implementing robust data governance strategies using Unity Catalog. Key Responsibilities: Design and implement ETL/ELT pipelines using Databricks and PySpark. Work with Unity Catalog to manage data governance, access controls, lineage, and auditing across data assets. Develop high-performance SQL queries and optimize Spark jobs. Collaborate with data scientists, analysts, and business stakeholders to understand data needs. Ensure data qualit...

Reach Priya : 6362416146 for more details , WhatsApp your updated resume Knowledge of how to create and improve data sets, big data data pipelines, and infrastructures. Being able to do root cause analysis on data and procedures both internally and outside to find possibilities for improvement and provide clarification. Outstanding analytical abilities related to coping with unstructured datasets. Capacity to develop procedures that support task management, data structures, dependence, and metadata. Knowledge of data models, data mining, and segmentation techniques. Understanding of programming languages like Java and Python. Familiarity with Hadoop, HBase, MapReduce, and other suitable plat...

Key Responsibilities Develop interactive and visually compelling Power BI dashboards and reports . Build and optimize data models using Power BI Desktop. Create complex DAX measures and calculations to support analytical requirements. Connect to various data sources (SQL Server, Excel, SharePoint, APIs, Cloud databases). Perform data extraction, transformation, and loading (ETL) using Power Query (M language). Collaborate with business stakeholders to understand requirements and translate them into BI solutions. Ensure data accuracy, security, and refresh scheduling in Power BI Service. Publish, manage, and optimize reports and datasets in Power BI Workspace. Work closely with cross-function...

Role & responsibilities • Developing, managing and optimizing robust and reliable data pipelines using azure native capabilities. • Implement ADF workflows that perform data ingestion, data integration/ETL, statistical model executions etc. • Creating architecture for data solutions with high performance characteristics • Bringing data and analytics products to production • Implement CI/CD pipelines for data solutions • Build dashboards for data stewards and business reporting • Design & build RDBMS data models

Join phData, a dynamic and innovative leader in the modern data stack. We partner with major cloud data platforms like Snowflake, AWS, Azure, GCP, Fivetran, Pinecone, Glean and dbt to deliver cutting-edge services and solutions. We're committed to helping global enterprises overcome their toughest data challenges. phData is a remote-first global company with employees based in the United States, Latin America and India. We celebrate the culture of each of our team members and foster a community of technological curiosity, ownership and trust. Even though we're growing extremely fast, we maintain a casual, exciting work environment. We hire top performers and allow you the autonomy to deliver...

Join phData, a dynamic and innovative leader in the modern data stack. We partner with major cloud data platforms like Snowflake, AWS, Azure, GCP, Fivetran, Pinecone, Glean and dbt to deliver cutting-edge services and solutions. We're committed to helping global enterprises overcome their toughest data challenges. phData is a remote-first global company with employees based in the United States, Latin America and India. We celebrate the culture of each of our team members and foster a community of technological curiosity, ownership and trust. Even though we're growing extremely fast, we maintain a casual, exciting work environment. We hire top performers and allow you the autonomy to deliver...

We are seeking a motivated Data Engineer with experience to design, develop, and maintain scalable data solutions on the Microsoft Azure platform. You will collaborate with cross-functional teams to enable data-driven decision-making using Azure Synapse Analytics, Data Factory, SQL, Python, and data analysis techniques. This role offers opportunities to grow your expertise in cloud data engineering while contributing to impactful projects. ________________________________________ Key Responsibilities Data Pipeline Development: Build, deploy, and maintain efficient ETL/ELT pipelines using Azure Data Factory and Azure Synapse Analytics. For Data Engineers, Databricks and Fabric should must hav...

Job Summary We are seeking a highly skilled and innovative Platform Engineer to implement end-to-end data and analytics solutions using the Microsoft Fabric platform. This role is ideal for someone with technical expertise in Microsoft’s data ecosystem who thrives in identifying platform limitations and proactively building custom solutions to bridge functional gaps. The ideal candidate brings a strong foundation in automation and DevOps, enabling efficient, secure, and scalable deployment and management of analytics infrastructure. This role will work closely with data governance, data loss prevention (DLP), and Architecture teams to ensure platform compliance and data security across all s...

Duration: 15 Weeks of contract Job Description: we’re looking for a data engineer to add to our dynamic and rapidly scaling team. We’re making this investment to help us optimize our digital channels and technology innovations with the end goal of creating competitive advantages for our restaurants around the globe. We’re looking for a solid engineer who brings fresh ideas from past experiences and is eager to tackle new challenges in our company. We’re in search of a candidate who knows about and loves working with modern data integration frameworks, big data and cloud technologies. Candidates must also be proficient with data programming languages (e.g., Python and SQL). Data engineer will...

Role: Developer Location: ~MUMBAI~KOLKATA~NEW DELHI~CHENNAI~BANGALORE~PUNE~HYDERABAD~ Experience:- 6 to 8 Skill: Digital: DevOps, Digital: Databricks Role Description: - Good information and sound knowledge in Azure Databricks and Azure Devops Thanks & Regards, Swapna, Sr Talent Acquisition Specialist : Swapna@eliteexceed.com https://www.eliteexceed.com

Responsibilities : * Design, develop, and maintain Azure Data pipelines using DataFactory and Databricks. * Collaborate with cross-functional teams on data warehousing projects utilizing SQL, Python, and PySpark.

Job Description Job Title � Azure Data Bricks Candidate Specification � 6+ years, Notice Period � Immediate to 30 days, Hybrid. Job Description Strong in Azure Databricks. Experience in Azure Synapse Analytics, Azure Data Lake Storage (Gen2). Data Abse experience - Azure SQL Database / SQL Server. Proficiency in writing complex SQL queries and working with large datasets. Experience with Python, Scala, PySpark for data transformations. Knowledge of DevOps practices and tools (e.g., Azure DevOps, CI/CD for data pipelines). Skills Required RoleData Bricks Engineer Industry TypeIT/ Computers - Software Functional Area Required Education Bachelor Degree Employment TypeFull Time, Permanent Key Sk...

Azure Databricks (ADB), Delta Lake, Azure Data Lake Storage (ADLS). Azure Data factory (ADF), Azure SQL Database (SQL DB), SQL, ELT / ETL Pipeline Development in Spark based environment. SparkCore, PySpark, Python, SparkSQL, Scala, Azure Blob Storage. CI/CD, Version control tools like GitHub, Azure DevOps.

Work Mode: Hybrid (3 days per week) Location: Bangalore/ Pune/ Chennai Role & responsibilities Databricks platform engineer As a Databricks Platform engineer, you will work with various business facing functions on their Big Data Challenges using the Databricks Platform. You will be maintaining the platform's stability, performance, and security, ensuring that it enables our data analysts, data scientists, and other users to effectively work with big data and machine learning Preferred candidate profile 7+ years of experience with Big Data Technologies such as Apache Spark, cloud native Data lakes and Data mesh platforms technical Architecture or consulting role Strong experience in administ...

Role & responsibilities Implement efficient and maintainable code using best process and coding standards. Design, develop, test, and deploy high-performance and scalable data solutions using Python. Collaborate with cross-functional teams to understand business requirements and translate them into technical specifications. Implement efficient and maintainable code using best practices and coding standards Utilize experiences in SQL to design, optimize, and maintain relational databases. Write complex SQL queries for data retrieval, manipulation, and analysis. Perform database performance tuning and optimization. Databricks Platform Work with Databricks platform for big data processing and a...

Role: Azure Data Engineer Must Skill - Azure, ADF, Pyspark, Python, SQL, Azure Databricks, Azure Data Lake Storage, Azure Data Factory Location: PAN India Responsibilities The candidate must be excited by the prospect of optimizing or even re-designing data pipelines to support the modernization of data platform Be curious and eager to work across a variety and volume of data. Design and build scalable and reliable data pipelines with the latest tech stack. Facilitate real-life actionable use cases leveraging our data with a user- and product-oriented mindset. Support teams without data engineers with building decentralized data solutions and product integrations. Conceptualize, design and i...