4809 Azure Databricks Jobs - Page 9

Technical Consultant Exp- 4 to 8yr Location -Bengaluru JD- 1. Databricks hands-on with Phyton / Scala. 2. Experience in Building / optimizing delta lake. 3. Spark SQL, Data Frames, and building reusable frameworks for reconciliation. 4. Better knowledge of Spark UI and long-running jobs troubleshooting / Optimization. 5. ETL tool experience Talend / Informatica. 6. 6-10 years of experience in full range of data engineering, covering best practices. 7. Fully conversant with big-data processing approaches and schema-on-read methodologies is a must. 8. Knowledge of Azure Data Factory pipeline/Databricks/Azure Data Lake/Azure DW/Database is a must. 9. Experience building and deploying a range of...

permanent work from HomeWork Timing -4 PM -1 Am Job Description: We are looking for a skilled and motivated AI Azure Data Engineer with strong expertise in Microsoft Azure data services. The ideal candidate must have hands-on experience with Databricks or Microsoft Fabric and hold a valid certification in either. You will be responsible for designing, developing, and deploying scalable data pipelines, integrating AI/ML solutions, and supporting analytics platforms. Key Responsibilities: Design and develop end-to-end data pipelines using Azure Data Factory, Databricks, or Microsoft Fabric. Integrate structured and unstructured data from various sources into Azure data lakes or lakehouses. Opt...

Job Title Senior Microsoft AI Cloud & Data Solutions Engineer Employment Type: Full-time or Part-time Experience: 7+ years Role Overview We are looking for a senior, hands-on Microsoft AI Cloud & Data Solutions Engineer to design, build, and operate scalable data and AI platforms on Microsoft Azure. This is an individual contributor role focused on execution, delivery, and problem-solving. You will work closely with engineering, analytics, and business teams to implement modern data architectures and AI-driven solutions. Key Responsibilities Cloud & Data Engineering Design and implement end-to-end data solutions on Microsoft Azure Build and maintain data pipelines using Azure Data Factory , ...

Role & responsibilities • 6+ years of experience in data engineering, with a focus on big data technologies and cloud platforms. • Proficiency in PySpark, AWS Glue, S3, SQL, and Python. • Demonstrated experience leading data engineering teams or projects. • Strong analytical and problem-solving skills, with the ability to handle complex data challenges. • Excellent communication and interpersonal skills, enabling collaboration with technical and non-technical stakeholders. • Deep understanding of data modeling, schema design, and database management. • Knowledge of data quality assurance techniques and compliance requirements. • Bachelors degree in computer science, Information Systems, or a...

Databricks Engineer (Databricks Engineer, Python, data factory, Pyspark, Azure Data Engineer, SQL, Spark,data lake, Microsoft Azure, Azure Developer)

Min 10 + yrs of experience in Data Analysis, Advanced SQL Skills, Azure Data Factory, Azure Databricks, Data Models, Python, Automation using SQL/Python scripts, Version Control (Git)and Collaboration

As a Senior BI/Data Analyst at Exusia, a cutting-edge digital transformation consultancy, you will be part of the Analytics practice, focusing on delivering top-notch technology solutions using Azure/AWS, Tableau, and/or MSBI (Power BI) for clients. With more than 6 years of experience in Microsoft technologies, you will have the opportunity to contribute to competency development, drive innovation, and work on client projects. **Role Overview:** You will be responsible for developing, designing, and maintaining Tableau dashboards and reports, delivering Microsoft-based Data engineering & Analytics solutions for clients, and providing technical leadership on multiple projects. Additionally, ...

Develop and manage data pipelines using ADF and Azure databricks; Expert in data warehousing, data modeling & ETL,SQL,Pyspark Expertise in on-prem to azure cloud migration; Good to have datastage Immediate joiner Send CV- sachin@assertivebs.com

Hi All, SuccessPartner Consultant is hiring for a Senior Data Engineer for one of our product based japanese organization. Job Location: Kolkata(work from office) Designation : Senior Data Engineer Job Role: Understandthebusinessrequirementsforanalyticsanddatainterpretation Understandsrequirementsandisinvolvedinthediscussionsrelatingtotechnicalandfunctionaldesignof the sprint/ module/project Designandimplementend-to-enddatasolutions(storage,integration,processing,visualization)inAzure. UsedvarioussourcestoingestdataintoAzureDataLakeStorage(ADLS)suchasSQLServer,Excel,Oracle, SQL Azure etc. Extractdatafromonedatabaseandloaditinto another Builddataarchitectureforingestion,processing,andsurfacin...

Roles and Responsibilities: 5+ years of experience in BI/ETL development and data engineering. Hands-on expertise in Agentic AI frameworks (must-have). Proficiency in Snowflake, Databricks, and PySpark. Advanced programming skills in Python. Solid understanding of data modelling, data warehousing, and cloud platforms (AWS/Azure/GCP). Excellent problem-solving and communication skills. Experience with machine learning workflows and AI-driven analytics. Familiarity with CI/CD pipelines, API development, and microservices architecture Cloud Platforms: AWS (S3, EC2, Lambda). Programming Languages: Python (Dash, Pandas, NumPy), SQL. DevOps Tools: Jenkins, Git, GitHub. Database Technologies: MySQL...

Job Application Link: https://app.fabrichq.ai/jobs/e1003d62-f76d-4ee1-b787-da40ce6f717f Job Summary: You will serve as a key member of the Data Consulting team, working directly with partners and senior stakeholders. You will design and implement big data and analytics solutions. Communication and organisational skills are key for this position. Key Responsibilities Develop data solutions within a Big Data Azure and/or other cloud environments Working with divergent data sets that meet the requirements of the Data Science and Data Analytics teams Build and design Data Architectures using Azure Data factory, Databricks, Data lake, Synapse Liaising with CTO, Product Owners and other Operations...

Roles & Responsibilities Storng Skill in Palantir,Strong SQL, Python, and data engineering background Hands-on experience in Foundry data pipelines and ontology Good knowledge of data visualization and operational workflows Awareness of cloud, governance, and DevOps concepts Experience 8-11 Years Skills Primary Skill: Data Engineering Sub Skill(s): Data Engineering Additional Skill(s): Python, synapse, Databricks, SQL, Azure Data Factory

Summary: As an Application Developer, you will engage in the design, construction, and configuration of applications tailored to fulfill specific business processes and application requirements. Your typical day will involve collaborating with team members to understand project needs, developing innovative solutions, and ensuring that applications are optimized for performance and usability. You will also participate in testing and debugging processes to deliver high-quality applications that meet user expectations and business goals. Roles & Responsibilities: - Expected to perform independently and become an SME. - Required active participation/contribution in team discussions. - Contribute...

Design, develop, and maintain data pipelines using Azure Data Factory, Azure Databricks Understanding of Data Governance principles and practices Implement ETL solutions to integrate data from various sources into Azure Data Lake and Data Warehouse Hands-on experience with SQL, Python, PySpark for data processing Expertise in building Power BI dashboards and reports.

Job Title: Senior Data Engineer Experience: 6+ Years Skills: Python, Spark, Azure Required Skills & Experience 5+ years of hands-on experience in Data Engineering . Strong working knowledge of the Azure ecosystem , including: Azure Databricks Azure Data Lake Storage (ADLS) Azure Functions Azure Data Factory (optional but preferred) Strong expertise in Apache Spark with Python (PySpark) . Advanced SQL skills, including query optimization. Strong understanding of ETL/ELT methodologies and data warehousing concepts . Experience with Delta Lake , including schema evolution, ACID transactions, and time travel. Experience working with PostgreSQL or similar relational databases. Strong problem-solv...

Job Title: Senior Data Engineer - Azure & Databricks Overview We are seeking a highly skilled Senior Data Engineer with 5+ years of hands-on experience in building scalable, high-performance data solutions within the Azure ecosystem . The ideal candidate will have strong expertise in Databricks, Apache Spark (Java), modern data lake architectures , and end-to-end ETL pipeline development. This role involves designing, developing, and optimizing data systems that support business-critical analytics and operational use cases. Key Responsibilities Design, develop, and maintain scalable data pipelines using Azure services and Databricks. Build efficient data ingestion and transformation workflow...

Job Title: Senior Data Engineer Experience: 6+ Years Key Responsibilities Design, develop, and maintain scalable and reliable data pipelines using Azure services and Databricks . Build efficient data ingestion and transformation workflows using Databricks, PySpark, and Delta Lake . Develop, optimize, and maintain ETL/ELT pipelines using Python and SQL . Implement best practices for data modeling, data quality, governance, and performance optimization . Work with relational and lakehouse databases , including PostgreSQL and Delta Lake . Monitor, support, and troubleshoot production data pipelines . Collaborate with cross-functional teams including product, analytics, and engineering stakehold...

Job Title: Python Specialist Data Engineer Experience Level: 58 Years Employment Type: Full-Time Location: Chennai Notice period : Immediate to 15days joiners Shift time : 1 to 10pm -5days office in week Interview process: L1 or L2- F2F interview client interview Job Summary: We are looking for a skilled Data Engineer with strong expertise in Python programming and hands-on experience with Azure Data Services , including Synapse , Data Lake , App Logic , and DevOps integration . The ideal candidate will have a strong understanding of data warehousing , MS SQL/PLSQL , and building scalable data pipelines and solutions on the cloud. Key Responsibilities: Develop and optimize scalable data pipe...

Role & responsibilities 5+ years of experience in software development using Python, PySpark and its frameworks. Proven experience as a Data Engineer with experience in Azure cloud. Experience implementing solutions using - Azure cloud services, Azure Data Factory, Azure Lake Gen 2, Azure Databases, Azure Data Fabric, API Gateway management, Azure Functions Design, build, test, and maintain highly scalable data management systems using Azure Databricks Strong SQL skills with RDMS or noSQL databases Experience with developing APIs using FastAPI or similar frameworks in Python Familiarity with the DevOps lifecycle (git, Jenkins, etc.), CI/CD processes Good understanding of ETL/ELT processes Ex...

Must Have: Extensive expertise in designing and implementing data load processes using Azure Data Factory, Azure Databricks, Delta Lake, Azure Delta Lake Storage and Python/PySpark Proficient with Databricks & Python Senior developers with Full Database/ Datawarehouse/ DataMart development capabilities Senior SME with SQL Server required. Proficiency with standard file formats and markup language technology such as JSON, XML, XSLT. Proficiency with Azure Cloud data environments highly desired. Excellent verbal communication skills. Good problem-solving skills. Attention to detail. Proficiency with Data Warehousing principals and design Nice to have: Familiarity with oData Services/Kafka/ Azu...

Salary: 15 to 25 LPA Exp: 4 to 7 years Location: Gurgaon/Pune/Bengalore Notice: Immediate to 30 days..!! Job Profile: Experienced Data Engineer with a strong foundation in designing, building, and maintaining scalable data pipelines and architectures. Skilled in transforming raw data into clean, structured formats for analytics and business intelligence. Proficient in modern data tools and technologies such as SQL, T-SQL, Python, Databricks, and cloud platforms (Azure). Adept at data wrangling, modeling, ETL/ELT development, and ensuring data quality, integrity, and security. Collaborative team player with a track record of enabling data-driven decision-making across business units. As a Dat...

Salary: 35 to 50 LPA Exp: 7 to 12 years Location: Gurgaon/Pune/Bengalore Notice: Immediate to 30 days..!! Job Profile: Experienced Data Engineer with a strong foundation in designing, building, and maintaining scalable data pipelines and architectures. Skilled in transforming raw data into clean, structured formats for analytics and business intelligence. Proficient in modern data tools and technologies such as SQL, T-SQL, Python, Databricks, and cloud platforms (Azure). Adept at data wrangling, modeling, ETL/ELT development, and ensuring data quality, integrity, and security. Collaborative team player with a track record of enabling data-driven decision-making across business units. As a Da...

Job Title: Senior Data Engineer with Databricks and Power BI (DAX) Experience Key Responsibilities: - Design and implement scalable data processing solutions using Databricks, including ETL processes that efficiently handle large data volumes. - Develop interactive dashboards and reports using Power BI to facilitate real-time data visualization and insights for stakeholders. - Collaborate with cross-functional teams to understand data requirements and deliver solutions that meet business needs and objectives. - Optimize data storage and retrieval processes to enhance performance and reduce latency. - Ensure data quality and integrity by implementing best practices for data governance and val...

"* Strong Python skills * Have experience reading documentation for the technology/tools they're working with (in other words, if they don't know how to use something, do they have a habit of going to the source for answers, or do they rely on third-party tutorials etc? In AI, since things change so quickly, we need to be comfortable using original documentation) * Strong English skills (important for prompt engineering) * Strong communication skills (to accurately collect and communicate about fuzzy requirements, explain problems, etc) * Familiarity working with cloud resources (Azure or AWS) * Understanding of LLMs and making calls to a chat completion function (e.g. via Azure OpenAI)

* Significant experience with Azure resources * Strong knowledge of production-grade architecture with Azure * Heavy pipeline experience * Experience with Azure AI Search, Foundry, Databricks, Blob, OpenAI, Document Intelligence, ADF, Function Apps * Strong Python, Flask