2404 Azure Databricks Jobs - Page 44

Role & responsibilities : Design Scalable Data Solutions: Contribute to the design of secure and scalable data engineering frameworks for analytics and BI. Build and Maintain Data Pipelines: Develop and maintain robust pipelines for data ingestion, transformation, and integration across diverse systems. Leverage Azure Platform Tools: Utilize services such as Azure Data Factory, Azure Databricks, and Azure Synapse Analytics to implement enterprise-grade data solutions. Support BI at Scale: Enable high-performance reporting and dashboarding by optimizing Synapse SQL Dedicated Pools and integrating with BI platforms like Power BI. Ensure Data Quality & Governance: Implement validation checks, l...

We are looking for an experienced Data Engineer with strong expertise in Databricks and Azure Data Factory (ADF) to design, build, and manage scalable data pipelines and integration solutions. The ideal candidate will have a solid background in big data technologies, cloud platforms, and data processing frameworks to support enterprise-level data transformation and analytics initiatives. Roles and Responsibilities Design, develop, and maintain robust data pipelines using Azure Data Factory and Databricks . Build and optimize data flows and transformations for structured and unstructured data. Develop scalable ETL/ELT processes to extract data from various sources including SQL, APIs, and fla...

PYSPARK PYTHON AZURE DATA BRICKS AZURE DATA FACTORY SQL

Location- Pune, Mumbai, Nagpur, Goa, Noida, Gurgaon, Ahmedabad, Jaipur, Indore, Kolkata, Kochi, Hyderabad, Bangalore, Chennai,) Minimum 67 years of experience in designing, implementing, and supporting Data Warehousing and Business Intelligence solutions on Microsoft Fabric data pipelines Design and implement scalable and efficient data pipelines using Azure Data Factory, Pyspark notebooks, Spark SQL, and Python. This includes data ingestion, data transformation, and data loading processes. Implement ETL processes to extract data from diverse sources, transform it into suitable formats, and load it into the data warehouse or analytical systems. Hands-on experience in design, development, and...

As an Azure Architect at Fractal, you will be part of a dynamic team in the Artificial Intelligence space dedicated to empowering human decision-making in the enterprise. You will contribute to the development and delivery of innovative solutions that assist Fortune 500 companies in making strategic and tactical decisions. Fractal is renowned for its cutting-edge products such as Qure.ai, Cuddle.ai, Theremin.ai, and Eugenie.ai, which leverage AI to drive business success. Joining our Technology team, you will play a pivotal role in designing, building, and maintaining technology services for our global clientele. Your responsibilities will include actively participating in client engagements...

Role: Data Engineer Location: Chennai, Bangalore, Hyderabad Experience: 8+ Work Mode: 5 days Work from Office only Responsibilities Knowledge to ingest, cleanse, transform and load data from varied data sources in the above Azure Services Strong knowledge of Medallion architecture Consume data from source with different file format such as XML, CSV, Excel, Parquet, JSON Create Linked Services with different type of sources. Create automated flow for pipeline which can consume data i.e may receive file via email or Share point. Strong problem-solving skill such as backtracking of dataset, data analysis etc. Strong Knowledge of in advanced SQL techniques for carrying out data analysis as per c...

Job Title: Data Engineer (Azure DE) Location: Hyderabad Experience: 4-12 Years Job Description: We are seeking a skilled and motivated Data Engineer to join our team in Hyderabad. The ideal candidate will have hands-on experience in designing, developing, and maintaining data pipelines and solutions using Azure services and open-source technologies. Key Responsibilities: Design, develop, and optimize data workflows using Azure Data Factory (ADF). Build and maintain scalable data processing solutions using Azure Data Bricks (ADB) with PySpark. Write efficient, reusable, and reliable Python and SQL scripts for data transformation and processing. Collaborate with data scientists and analysts to...

Our client is Global IT Service & Consulting Organization Data Software Engineer Location- Pune Notice period: Immediate to 60 days F2F interview on 27th July ,Sunday in Pune location Exp:5 -12 years Skill: Python, Spark, Azure Databricks/GCP/AWS Data Software Engineer - Spark, Python, (AWS, Kafka or Azure Databricks or GCP) Job Description: 5-12 Years of in Big Data & Data related technology experience Expert level understanding of distributed computing principles Expert level knowledge and experience in Apache Spark Hands on programming with Python Proficiency with Hadoop v2, Map Reduce, HDFS, Sqoop Experience with building stream-processing systems, using technologies such as Apache Storm...

Must Have Python & PySpark: Proficient in both, with strong understanding of data engineering best practices. ( High expertise ) Data Exploration & Troubleshooting: Ability to investigate data quality issues, debug pipelines, and explore datasets beyond surface-level analysis. ( High expertise ) CI/CD & GitHub: Experience with GitHub and GitHub Actions for version control and automation; familiarity with CI/CD practices for testing and deployment. ( High expertise ) Cloud & Platform Experience( High expertise ) Azure & Databricks: Hands-on experience with Azure cloud services and Databricks, including: Databricks Jobs, Clusters, Unity Catalog ( Medium expertise ) Data Pipeline Development Ba...

Job Summary: We are seeking a highly skilled Data Engineer with expertise in leveraging Data Lake architecture and the Azure cloud platform to develop, deploy, and optimise data-driven solutions. . You will play a pivotal role in transforming raw data into actionable insights, supporting strategic decision-making across the organisation. Responsibilities Design and implement scalable data science solutions using Azure Data Lake, Azure Data Bricks, Azure Data Factory and related Azure services. Develop, train, and deploy machine learning models to address business challenges. Collaborate with data engineering teams to optimise data pipelines and ensure seamless data integration within Azure c...

We are looking for a GenAI/ML Engineer to design, develop, and deploy cutting-edge AI/ML models and Generative AI applications . This role involves working on large-scale enterprise use cases, implementing Large Language Models (LLMs) , building Agentic AI systems , and developing data ingestion pipelines . The ideal candidate should have hands-on experience with AI/ML development , Generative AI applications , and a strong foundation in deep learning , NLP , and MLOps practices. Key Responsibilities Design, develop , and deploy AI/ML models and Generative AI applications for various enterprise use cases. Implement and integrate Large Language Models (LLMs) using frameworks such as LangChain...

Roles and Responsibility Design, develop, and implement scalable Kafka infrastructure solutions. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain technical documentation for Kafka infrastructure projects. Troubleshoot and resolve complex issues related to Kafka infrastructure. Ensure compliance with industry standards and best practices for Kafka infrastructure. Participate in code reviews and contribute to the improvement of the overall code quality. Job Requirements Strong understanding of Kafka architecture and design principles. Experience with Kafka tools such as Streams, KSQL, and SCADA. Proficient in programming languages su...

Share resume to : sowmya.v@acesoftlabs.com Hiring Now: Azure Data Engineer (36 Years) – Immediate Opportunity! Location : Bangalore Experience : 3–6 Years Key Responsibilities: Design and build scalable data solutions using Azure Data Factory, Azure Databricks, and Azure Synapse . Develop ETL/ELT pipelines for structured and unstructured data from various sources and formats. Write efficient SQL queries, stored procedures, functions , and dynamic SQL for data transformation and analysis. Implement data lake architecture and optimize data ingestion using Apache Spark with Scala or Python . Handle and maintain Delta Tables within the Databricks environment. Collaborate with DevOps team to supp...

Company Description Krish is committed to enabling customers to achieve their technological goals by delivering solutions that combine the right technology, people, and costs. Our approach emphasizes building long-term relationships while ensuring customer success through tailored solutions, leveraging the expertise and integrity of our consultants and robust delivery processes. Position Summary: We are seeking a highly skilled and experienced Senior Power BI Developer to join our Data & Analytics team. The ideal candidate will be responsible for designing, developing, and deploying interactive, visually appealing, and user-friendly business intelligence reports and dashboards using Power BI...

Role & responsibilities : Looking for a skilled Data Engineer with expertise in Python and Azure Databricks for building scalable data pipelines. Must have strong SQL skills for designing, querying, and optimizing relational databases. Responsible for data ingestion, transformation, and orchestration across cloud platforms. Experience with coding best practices, performance tuning

Azure Data Engineer Pyspark Python Azure Data Factory Azure Databricks SQL

Data Engineer 3 to 6 yrs 1. Excellent Programming skills in Python with object oriented design 2. Strong programming skills with Pyspark, SparkSQL 3. Hands on experience in working with relational database like SQL, postgres database 4. Hands on experience on developing solutions on Big Data Clusters like MAPR Clusters or on cloud platform like Azure 5. Experience on working with Azure Databricks, Azure Data Factory is an added advantage 6. Deployment experience with Dockers and Kubernetes is an added advantage 7. Excellent logical , analytical and problem solving skills 8. Strong communication skills

Seeking an experienced Azure DBA with expertise in Azure SQL, Data Factory, and Databricks. Manage and optimize databases, design pipelines, and support cloud-native compliance platforms. Required Candidate profile DBA with expertise in Microsoft Azure Data Factory and Databricks to manage, optimize, and scale our data infrastructure.

Job Title: Senior Data Engineer Location: Bangalore, India Experience Required: 7 to 10 Years Open Positions: 3 Notice Period: Immediate Joiners Only Job Description: We are looking for a Senior Data Engineer with strong hands-on experience in AWS and working knowledge of Azure . The ideal candidate should have deep expertise in building scalable data pipelines, working with cloud platforms, and handling large datasets. Must-Have Skills: Cloud Platforms: Strong experience in AWS and working knowledge of Azure Data Engineering: Data Warehousing, any ETL Tool Programming Languages: Python, PySpark, SQL Databases: Snowflake or Databricks, and any RDBMS Scripting/OS: Unix Shell Scripting Good to...

Greetings from Mastek, We have an exciting opportunity for you. We are seeking a Senior Data Engineer who has solid experience in Snowflake, Microsoft Azure Data Factory and Kafka. This is a hybrid role and Job location is Bangalore. Experience : 7+ years Job Location : Bangalore Mode : Hybrid Qualifications BS in Computer Science or Related 5+ years of data engineering experience Good understanding of modern data platforms including data lakes and data warehouse, with good knowledge of the underlying architecture, preferably in Snowflake. Proven experience in assembling large, complex sets of data that meets non-functional and functional business requirements. Experience in identifying, des...

Interested candidates can share your resume to aweaz.pasha@wisseninfotech.com JD: Azure Data Engineer Experience in Azure Data Factory, Databricks, Azure data lake and Azure SQL Server. Developed ETL/ELT process using SSIS and/or Azure Data Factory. Build complex pipelines & dataflows using Azure Data Factory. Designing and implementing data pipelines using in Azure Data Factory (ADF). Improve functionality/ performance of existing data pipelines. Performance tuning processes dealing with very large data sets. Configuration and Deployment of ADF packages. Proficient of the usage of ARM Template, Key Vault, Integration runtime. Adaptable to work with ETL frameworks and standards. Strong analy...

As a member of the Providence team, you will be part of one of the largest not-for-profit healthcare systems in the US, dedicated to providing high-quality and compassionate healthcare to all individuals. Our vision, "Health for a better world," drives us to ensure that health is a fundamental human right. With a network of 51 hospitals, 1,000+ care clinics, senior services, supportive housing, and various health and educational services, we aim to offer affordable quality care and services to everyone. Providence India is spearheading a transformative shift in the healthcare ecosystem towards Health 2.0. With a focus on healthcare technology and innovation, our India center will play a cruc...

As a Cloud Architect with expertise in Azure and Snowflake, you will be responsible for designing and implementing secure, scalable, and highly available cloud-based solutions on AWS and Azure Cloud. Your role will involve utilizing your experience in Azure Databricks, ADF, Azure Synapse, PySpark, and Snowflake Services. Additionally, you will participate in pre-sales activities, including RFP and proposal writing. Your experience with integrating various data sources with Data Warehouse and Data Lake will be crucial for this role. You will also be expected to create Data warehouses and data lakes for Reporting, AI, and Machine Learning purposes, while having a solid understanding of data mo...

As a Lead Data Engineer at our company located in Indore, Madhya Pradesh, you will be an integral part of our dynamic team, bringing your extensive experience and expertise in PySpark, Azure Data Bricks, Azure Data Factory, SQL, and Power BI to the table. Your primary responsibility will involve designing, constructing, and managing scalable data solutions that are crucial for our various projects. Your role will encompass data architecture, pipeline development, and ensuring data governance across different initiatives. Your key responsibilities will include leading the creation and enhancement of robust data pipelines utilizing Azure Data Factory and PySpark, building scalable data solutio...

You should have 8-12 years of experience in a Data Engineer role, with at least 3 years as an Azure data engineer. A bachelor's degree in Computer Science, Information Technology, Engineering, or a related field is required. You must be proficient in Python, SQL, and have a deep understanding of PySpark. Additionally, expertise in Databricks or similar big data solutions is necessary. Strong knowledge of ETL/ELT frameworks, data structures, and software architecture is expected. You should have proven experience in designing and deploying high-performance data processing systems and extensive experience with Azure cloud data platforms. As a Data Engineer, your responsibilities will include d...