3651 Azure Databricks Jobs - Page 50

** DO NOT APPLY IF OVERALL IS LESS THAN 6YEARS & RELEVANT TO AZURE IS LESS THAN 5YEARS ** **NOTICE PERIOD: IMMEDIATE JOINERS OR 15-20DAYS** Job Title: ADF Engineer Work Location: PUNE & KOLKATA (no relocations) Skill Required: Digital : Azure Databricks~Azure Data Factory~Pyspark Experience Range in Required Skills: Overall 6years (5years relevant to Azure services will be ONLY considered) Job Description: 5-6years relevant experience only will be considered. Should have PySpark, SQL, Azure Services (ADF, DataBricks, Synapse) Designing and implementing data ingestion pipelines from multiple sources using Azure Databricks. Developing scalable and re-usable frameworks for ingesting data sets I...

** DO NOT APPLY IF OVERALL IS LESS THAN 6YEARS & RELEVANT TO AZURE IS LESS THAN 5YEARS ** **NOTICE PERIOD: IMMEDIATE JOINERS OR 15-20DAYS** Connect with me on 9738893611 for 26th Sep Virtual Drive at 10AM Job Title: ADF Engineer Work Location: PUNE & KOLKATA (no relocations) Skill Required: Digital : Azure Databricks~Azure Data Factory~Pyspark Experience Range in Required Skills: Overall 6years (5years relevant to Azure services will be ONLY considered) Job Description: 5-6years relevant experience only will be considered. Should have PySpark, SQL, Azure Services (ADF, DataBricks, Synapse) Designing and implementing data ingestion pipelines from multiple sources using Azure Databricks. Devel...

About Koantek Koantek is a Databricks Pure-Play Elite Partner, helping enterprises modernize faster and unlock the full power of Data and AI. Backed by Databricks Ventures and honored as a six-time Databricks Partner of the Year, we enable global enterprises to modernize at speed, operationalize AI, and realize the full value of their data. Our deep expertise spans industries such as healthcare, financial services, retail, and SaaS, delivering end-to-end solutions from rapid prototyping to production-scale AI deployments. Description: As a Senior Data Engineer at Koantek, you will leverage advanced data engineering techniques and analytics to support business decisions for our clients. Your ...

Role & responsibilities Experience in Pyspark and Azure Databricks. • Proficiency in integrating, transforming and consolidating data from various structured and unstructured data sources. • Good experience in SQL or native SQL query languages. • Strong experience in implementing Databricks notebooks using Python. • Good experience in Azure Data Factory, ADLS, Storage Services, Synapse, Serverless architecture, Azure functions. Good to have: • Strong knowledge of Data management principles. • Good experience in SSIS/ETL transformation processes. • Experience in Azure DevOps and CI/CD deployments • Strong problem solving and analytical skills. • Experience with Agile development methodologies...

What You Will Do : Lead and execute data engineering projects from inception to completion, ensuring timely delivery and high quality. Build and optimize data architectures for operational and analytical purposes. Collaborate with cross-functional teams to gather and define data requirements. Implement data quality, data governance, and data security practices. Manage and optimize cloud-based data platforms (Azure,AWS). Develop and maintain Python/PySpark libraries for data ingestion, Processing and integration with both internal and external data sources. Design and optimize scalable data pipelines using Azure data factory and Spark(Databricks). Work with stakeholders, including the Executi...

Title: Lead Data Engineer Key skills : Azure Databricks , Azure Synapse , Python , SQL (Azure skills). Key Responsibilities: Data Pipeline Development: Develop & deploy data pipelines using Azure OneLake, Azure Data Factory, and Apache Spark, ensuring efficient, scalable, and secure data movement across systems. ETL: Implement ETL (Extract, Transform, Load) workflows, optimizing the process for data ingestion, transformation, and storage in the cloud. Data Integration: Build and manage data integration solutions that connect multiple data sources (structured and unstructured) into a cohesive data ecosystem. Use SQL, Python, Scala, and R to manipulate and process large datasets. Azure OneLake...

Design and implement efficient, scalable, and secure PostgreSQL database schemas and objects (tables, views, functions, procedures). Develop and optimize complex SQL queries, stored procedures, and triggers for regulatory data processing. Collaborate with backend developers, data engineers, and business analysts to understand data requirements and translate them into robust database solutions. Ensure data integrity, consistency, and quality across systems. Implement indexing, partitioning, and performance tuning strategies for large datasets. Support ETL processes and data pipelines for ingestion and transformation of trade data. Participate in code reviews, testing, and deployment processes...

Greetings from #LTIMindtree ! We are Hiring for #Azure Data Engineer ! Please help me to fill the below form to take this ahead. https://forms.office.com/r/LwFct8yvvQ Brief Description of Role Job Summary: We are seeking an experienced and strategic #Data to design, build, and optimize scalable, secure, and high-performance data solutions. You will play a pivotal role in shaping our data infrastructure, working with technologies such as Databricks, Azure Data Factory, Unity Catalog, and Spark, while aligning with best practices in data governance, pipeline automation, and performance optimization. Requirements: • Bachelors or masters degree in computer science, Information Systems, or relate...

*Mandatory Skills: Data factory, Databricks, SQL DB, Python, ADLS, PySpark *Preferred Skills: PBI, Power APP stack, Data Modelling , AWS lambda, Glue, GMR, Airflow, Kinesis, Redshift Role and responsibilities: • Create Service Offerings • Create Customer Presentation (Pitch Deck based on Service Offerings) • Help in winning the new deals and to manage the same • Help in taking the offerings to market along with the Sales team • Help in account mining /farming to grow the customer accounts • Ensure the services are delivered as per contractual agreement with the Customer *Required Skills and Qualifications: • Architecting and overall end-to-end design, deployment, and delivery of Azure Data P...

•Should have worked on at least 3 major engagements using Qlik Sense as the reporting and dashboarding tool •Candidate needs to have detail understanding of all the Qlik Sense modules, license types and features of the tool

Roles and responsibilities The responsibilities of the role include: Responsible for client interaction to gather the Business challenges and documentation Critical thinking and problem-solving skills are essential for interpreting data. Responsible of presenting the solution and insight to the Clients. Evaluate internal systems for efficiency, problems, and inaccuracies, developing and maintaining protocols for handling, processing, and cleaning data Work directly with management and users to gather requirements, provide status updates, and build relationships Requirement Design, build, and maintain Azure data services for internal and client platforms, including Azure SQL Database, Azure D...

ReQ Azure synapse- Data engineer role Location: Hyderabad / Bangalore / Pune/Chennai/Kolkata/Mumbai/Gurgoan Experience: 5yrs 15 yrs Mode: Contract to Hire - (Intially 3-6 months Shell Infotech payroll after that you will be Perm with client) *****Pls send me your resume along Photo Graph and PAN Number is mandatory for client Submittal***** ****************** Need resource who can join in Immediatley/ 15 days****************** JD Below Azure Synapse, Databricks, SQL exp. Working on synapse, Pyspark Additionally, the consultant should demonstrate excellent verbal and written communication skills. Kindly share your resume along with the below details Note: Photograph is the mandatory 1) Pancar...

Kindly share your resume to Nishikanth.konda@citiustech.com Looking for a highly skilled Senior Data Engineer to lead and execute the migration of data workflows from Alteryx to Azure Data Factory (ADF) and databases from SQL Server on Prem to Azure SQL Database. The ideal candidate will have deep expertise in cloud data engineering, ETL/ELT processes, and Azure ecosystem tools. Key Responsibilities: -Lead the migration of existing Alteryx workflows to Azure Data Factory pipelines. -Migrate on-premise SQL Server databases to Azure SQL Database -Design and implement scalable, secure, and optimized data pipelines in Azure (ADF). -Design and implement scalable data models to support analytics, ...

As a candidate for this role, you will be working on a project expected to last for 6 months with a monthly rate of 1.60 Lac in Bangalore, with hybrid working options available. Your main responsibilities will include: - Strong proficiency in Python, LLMs, Lang Chain, Prompt Engineering, and related Gen AI technologies. - Proficiency with Azure Databricks. - Possession of strong analytical, problem-solving, and stakeholder communication skills. - Solid understanding of data governance frameworks, compliance, and internal controls. - Experience in data quality rule development, profiling, and implementation. - Familiarity with Azure Data Services such as Data Lake, Synapse, and Blob Storage. ...

As a Data Engineer, you will be responsible for handling various technologies related to cloud platforms such as Azure Datalake, Azure function, Azure Databricks, Azure Data Factory, and PostgreSQL. Additionally, having experience in Azure DevOps and Git flow would be advantageous. Moreover, familiarity with AWS services like Kinesis, EMR, Glue, RDS, Athena, and RedShift is also desirable. Expertise in working with timeseries data and Industry 4.0 projects is essential, along with knowledge of Palantir. Your role will require strong problem-solving skills with an emphasis on sustainable development practices. Proficiency in Python/PySpark, Pandas, Numpy, seaborn/matplotlib, and Streamlit.io ...

As a highly skilled Azure PySpark Solution Architect, your role involves designing and implementing scalable data solutions on Microsoft Azure. Your expertise in Azure services, PySpark, and solution architecture will ensure efficient data processing and analytics workflows for enterprise applications. **Key Responsibilities:** - Design and implement end-to-end data solutions using Azure Data Services and PySpark - Develop high-performance ETL pipelines leveraging Azure Databricks, Azure Data Factory, and Synapse Analytics - Architect scalable, secure, and cost-efficient cloud solutions aligned with business objectives - Collaborate with data engineers, data scientists, and business stakehol...

As an Azure Data Engineer, your role involves designing, implementing, and maintaining data pipelines and data solutions on the Azure platform. You will focus on developing efficient data models, ETL processes, and data integration workflows to meet the organization's data needs. - Collaborate with data architects, data scientists, and stakeholders to understand requirements and translate them into technical solutions. - Optimize data storage and retrieval for performance and cost efficiency. - Troubleshoot data issues, monitor data pipelines, and ensure data quality and integrity. - Stay current with Azure data services and best practices to enhance data infrastructure. The ideal candidate ...

Role Overview: As a Senior Software Engineer (SSE) specializing in Kafka, Python, and Azure Databricks, you will play a crucial role in leading and contributing to healthcare data engineering projects. Your primary responsibility will involve building scalable real-time data pipelines and processing large healthcare datasets within a secure and compliant cloud environment. Key Responsibilities: - Designing and developing scalable real-time data streaming solutions using Apache Kafka and Python. - Architecting and implementing ETL/ELT pipelines utilizing Azure Databricks for both structured and unstructured healthcare data. - Optimizing and maintaining Kafka applications, Python scripts, and ...

Role Overview: As an integral part of American Airlines Tech Hub in Hyderabad, India, you will have the opportunity to contribute to the innovative and tech-driven environment that shapes the future of travel. Your role will involve collaborating with source data application teams and product owners to develop and support analytics solutions that provide valuable insights for informed decision-making. By leveraging Azure products and services such as Azure Data Lake Storage, Azure Data Factory, and Azure Databricks, you will be responsible for implementing data migration and engineering solutions to enhance the airline's digital capabilities. Key Responsibilities: - Collaborate with source d...

As an Associate Manager, Data Operations, you will play a crucial role in supporting the growing data organization by maintaining data pipelines on Microsoft Azure, Azure Data Factory (ADF), Azure Synapse Analytics, and Azure Databricks. Your responsibilities will involve ensuring data governance, reliability, and performance optimization, contributing to DataOps initiatives aligned with business objectives and enterprise data strategy. Key Responsibilities: - Implement and optimize enterprise-scale data pipelines, supporting data ingestion, transformation, orchestration, and storage workflows. - Ensure seamless batch, real-time, and streaming data processing while contributing to DataOps au...

As a Data Engineer specializing in supply chain applications at NovintiX in Coimbatore, India, you will play a crucial role in enhancing our Supply Chain Analytics team. Your primary focus will be on developing intelligent data solutions that drive real-world logistics, procurement, and demand planning. Your responsibilities will include: - Creating and optimizing scalable data pipelines for inventory, shipping, and procurement data - Integrating data from ERP, PLM, and external sources through the development of APIs - Designing, building, and maintaining enterprise-grade data warehouses and data lakes while ensuring data quality, integrity, and security - Collaborating with stakeholders to...

As a skilled data engineering professional with over 5 years of experience, you will be responsible for designing and implementing end-to-end ETL solutions using Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), Azure Databricks, and SSIS. Your strong proficiency in SQL, REST API integration, and automation through CI/CD pipelines using Azure DevOps and Git will be crucial for this role. You must have a solid understanding of maintaining and optimizing data pipelines, warehouses, and reporting within the Microsoft SQL stack. Key Responsibilities: - Design and implement comprehensive data solutions using Microsoft Azure Data Factory (ADF) and Azure Data Lake Storage (ADLS), Azure Data...

Job Title: Azure Data Engineer Role Overview We are seeking an experienced Azure Data Engineer with proven expertise in designing, developing, and managing large-scale data solutions on Microsoft Azure. The ideal candidate will have a strong background in data engineering, team/project leadership, and modern data platforms, along with hands-on experience in Databricks, Azure Data Services, and DevOps practices. Key Responsibilities Lead and mentor data engineering teams in delivering scalable, high-performance data solutions. years of data engineering experience, with at least 3+ years leading teams/projects. Strong expertise in Azure Data Services (Azure Data Lake, Azure Synapse, Data Facto...

Locations: Pune, Maharashtra, India Minimum Experience: 6 Maximum Experience: 12 ctc 6-8 -22 lac 8+ -30 lac max Skill Set: Databricks Engineer, Azure Databricks, SQL, Skill to Evaluate: Databricks Engineer, Azure Databricks, SQL,Pyspark, Data warehousing, ADF Experience: 5 to 12 Years Location: Pune, Maharashtra, India Job Description: Job Title: Senior Data Engineer Key Responsibilities: - Design, build, and maintain scalable data pipelines and ETL processes. - Collaborate with data scientists and analysts to understand data needs and provide support for their analytics requirements. - Develop and implement data models, database designs, and data management solutions. - Ensure data quality,...

**Job Description:** As a Python Azure Data Factory (ADF) professional, your role involves working with technologies such as Azure Databricks, PySpark, Delta Lake, ETL/ELT, data pipelines, and data lakehouse architecture. **Key Responsibilities:** - **Technical Delivery:** - Develop robust ETL/ELT workflows using Informatica to ingest, transform, and load data into our data warehouse, Azure Synapse Analytics. - Conduct exploratory data analysis (EDA) to validate pipeline outputs and ensure data accuracy. - Ensure data quality by implementing proactive checks and monitoring mechanisms. - Write and optimize complex SQL queries to support analytical and reporting team requirements. - Collaborat...