4854 Azure Databricks Jobs - Page 19

Role : Azure Databricks Engineer Exp Range : 4 to 8 Yrs Location : PAN india Key Skills Required: Good Knowledge of Data Brick lakehouse and Azure DataLake concept • Knowledge of Data Bricks delta concept Delta live tables (DLT) • Strong hands-on experience in ELT pipeline development using Azure Data factory and Databricks Autoloader, Notebook scripting and Azure Synapse Activity Copy, Data Flow Task • Strong knowledge of metadata-driven data pipeline, metadata management, dynamic logic • In-depth knowledge of data storage solutions, including Azure Data Lake Storage (ADLS), and Azure Serverless SQL Pool. • Experience with data transformation using Spark, and SQL technologies. • Solid under...

Role : Azure Databricks Engineer Exp Range : 6 to 8 Yrs Location : PAN india Key Skills Required: Good Knowledge of Data Brick lakehouse and Azure DataLake concept • Knowledge of Data Bricks delta concept Delta live tables (DLT) • Strong hands-on experience in ELT pipeline development using Azure Data factory and Databricks Autoloader, Notebook scripting and Azure Synapse Activity Copy, Data Flow Task • Strong knowledge of metadata-driven data pipeline, metadata management, dynamic logic • In-depth knowledge of data storage solutions, including Azure Data Lake Storage (ADLS), and Azure Serverless SQL Pool. • Experience with data transformation using Spark, and SQL technologies. • Solid under...

experience working on Azure Databricks using Scala, PySpark experience on Azure Cloud platform full Software Development Life Cycle experience Knowledge about Azure DevOps and Terraform experience with DB/SQL experience with Scala or Python

Greetings from TCS!!! **TCS is Hiring for Azure Data Engineer** Desired Experience:4- 10 Years Job Location: Bengaluru Job Description: Primary Skills: Microsoft SQL, Pyspark, Azure Synapse Analytics Secondary Skills: Azure Data Factory, Azure Databricks, Microsoft Fabric, Power BI, Purview

Roles and Responsibilities Design, develop, and maintain large-scale data pipelines using Azure Data Factory (ADF) to extract, transform, and load data from various sources into Azure Storage solutions. Collaborate with cross-functional teams to identify business requirements and design scalable data architectures that meet those needs. Develop complex SQL queries to optimize database performance and troubleshoot issues in Azure Databricks. Implement data quality checks using PySpark to ensure high-quality data processing. Desired Candidate Profile 5-10 years of experience as an ADF developer with expertise in building end-to-end data workflows. Strong understanding of Azure Databricks, incl...

Job description Job Summary: We are seeking a talented Data Engineer with strong expertise inAzure , Databricks, specifically in Unity Catalog, PySpark, and SQL, to join our data team. Youll play a key role in building secure, scalable data pipelines and implementing robust data governance strategies using Unity Catalog. Key Responsibilities: Design and implement ETL/ELT pipelines using Databricks and PySpark. Work with Unity Catalog to manage data governance, access controls, lineage, and auditing across data assets. Develop high-performance SQL queries and optimize Spark jobs. Collaborate with data scientists, analysts, and business stakeholders to understand data needs. Ensure data qualit...

Location Chennai/Bangalore/Pune/Coimbatore Databricks JD: 7+ years overall IT development experience. 4+ years of Azure hands-on experience in ADF, Azure Data bricks and Spark (PySpark). Strong SQL skills and able to write SQL complex queries(Spark SQL). Should have good knowledge on Hadoop, Hive and Shell scripting, Working experience with different file formats like JSON, parquet, AVRO, ORC and CSV etc. Source-code versioning/promotion tools, e.g., Git/Jenkins. Experience in Agile environment, JIRA/Confluence tools. Should have good communication Skills and have direct client interaction involvement.

Databricks Architect: Lead architecture, design, and implementation of data lakehouse solutions using Databricks, Delta Lake, Unity Catalog, and Apache Spark. Define and enforce architectural best practices for data ingestion, ETL/ELT processing, transformation, governance, and analytics. Oversee the deployment, scaling, configuration, and cost optimization of Databricks environments (across Azure, AWS, or GCP). Design high-availability, resilient pipelines for both streaming and batch data processing at enterprise scale. Implement and manage data governance, privacy, and lineage (Unity Catalog, fine-grained access controls, encryption, audit logging). Guide teams in implementing CI/CD, vers...

Role: Senior Databricks Engineer / Databricks Technical Lead/ Data Architect Experience: 8-15 years Location: Bangalore, Chennai, Delhi, Pune About Tredence : Tredence focuses on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science and software engineering. The largest companies across industries are engaging with us and deploying their prediction and optimization solutions at scale. Head quartered in the San Francisco Bay Area, we serve clients in the US, Canada, Europe, and South East Asia. We are seeking an experienced data scientist who apart from the required mathematical and statistical expertise also possesses the...

Metyis is a Netherlands based fast-growing international company with a diverse team of over 700+ professionals with a mix of Analytics, Data Science and Technology Team. We are looking for an experienced Data Engineer to join our team with below requirements: Responsibilities: Independently execute data engineering projects Diagnose problems, disaggregate issues, develop hypotheses and execute relevant solutions Undertake processing of structured and unstructured data Undertake work related to ELT activities Development of data processing codes for automation & building scalable solutions Develop and maintain data solutions for clients / projects Communicate and interact with clients at the...

Role & responsibilities Role : Azure Data Engineer YOE : 4 to 6 Location : Hyderabad Role Overview We are seeking a highly skilled Azure Data Engineer with strong expertise in Azure Synapse Analytics and Microsoft Fabric. The ideal candidate will have hands-on experience in designing, developing, and maintaining scalable data solutions, modern data warehouses, and advanced analytics platforms using Azure cloud services. Shape Key Responsibilities Design and implement end-to-end data solutions using Azure Synapse and Microsoft Fabric. Develop and optimize data pipelines, dataflows, and ELT/ETL processes using Data Factory, Synapse Pipelines, and Fabric Data Factory. Build and maintain Lakehou...

Job Summary Role : Power BI & Power Apps Location: Hyderabad years of Exp: 6+ We are looking for a highly skilled Power BI & Power Apps expert who can design, develop, and maintain enterprise-grade business intelligence solutions and low-code applications. This role also requires foundational experience in data engineering (preferably using Azure Databricks) and an understanding of Power BI administration, governance, and security. The ideal candidate is passionate about continuous learning and staying current with new features, capabilities, and best practices across the Microsoft Power Platform. Technical Expertise 5-8 years’ experience developing Power BI dashboards (or equivalent strong ...

Role & responsibilities Develop and optimize in technical landscape, i.e. as Databricks, Python frameworks and DAX. Enhance existing self-service models to support operational needs. Implement scalable solutions for data processing, reporting, and analytics. Work closely with the roadmap owner to execute initiatives according to the pipeline. Ensure data quality, governance, and performance of analytics tools. Support project delivery by providing technical input for timelines, dependencies, and resource planning. Job Description: • 5+ years of hands-on experience in Data Analytics, Data Science, or AI- related IT roles • Expert coding skills in Python and SQL, with proven track record in la...

Role & responsibilities Job Description: Design, build, and optimize scalable data pipelines and ETL workflows on Databricks. Architect and implement data lake house solutions integrating Databricks with Azure Data Lake, Azure Synapse, and other Azure services. Ensure security, compliance, and governance of data platforms, including RBAC, Unity Catalog, and data lineage. Implement data quality, monitoring, and performance optimization strategies across large-scale datasets. Define and enforce best practices for Databricks development, deployment, and CI/CD automation. Troubleshoot and resolve issues related to Spark jobs, cluster performance, and data pipelines. Mentor junior engineers and c...

Role Overview: As a Principal at Alysian-Tech M&A, your role involves leading the design and implementation of enterprise-scale cloud data and AI solutions using Microsoft Fabric, Azure Databricks, and the broader Azure ecosystem. You will be responsible for translating business requirements into technical architectures, designing comprehensive cloud data and AI solutions, and ensuring seamless integration between IES Gateway and the analytics ecosystem. Your expertise in Microsoft technology will be crucial in driving customer engagements and adopting modern data and AI platforms. Key Responsibilities: - Lead solution design sessions with stakeholders to translate business requirements into...

As a highly skilled Azure Data Architect with over 12 years of professional experience in data engineering, your role involves end-to-end ownership of data engineering activities to deliver scalable and secure data solutions for advanced analytics and reporting. You will collaborate with business stakeholders, analysts, and architects to gather requirements and design technical solutions. Your responsibilities include: - Collaborating with business stakeholders to gather, analyze, and translate requirements into technical data engineering solutions. - Designing, developing, and maintaining data pipelines and ETL/ELT processes using Azure Data Factory, Databricks (PySpark, Delta Lake), and Sy...

As a Data Engineering & Analytics Architect at NTT DATA, you will be responsible for owning the strategy, governance, and end-to-end architecture for backend data pipelines, transformation logic, and real-time/batch analytics. Your role will include defining data-first architecture, standards, and blueprints across various layers, leading the design of batch and streaming pipelines, establishing semantic/serving models, and enforcing security, privacy, and compliance. **Key Responsibilities:** - Define data-first architecture, standards, and blueprints for ingestion, cleansing, enrichment, modeling, and serving layers. - Lead the design of batch and streaming pipelines using technologies suc...

As a Fabric Data Engineer with expertise in the Azure ecosystem, your role will involve designing, building, and maintaining scalable data solutions. You will work with technologies such as Microsoft Fabric, Databricks, Azure Data Factory, PySpark, and SQL to enable advanced analytics and data-driven decision-making. Key Responsibilities: - Design, develop, and maintain scalable data pipelines using Microsoft Fabric and Azure data services. - Implement data integration, transformation, and orchestration workflows with Azure Data Factory, Databricks, and PySpark. - Collaborate with stakeholders to understand business requirements and translate them into robust data solutions. - Optimize perfo...

As a Data Engineer Grade 5 at our company, you will be responsible for building solutions against delta lakes and relational databases. Your main tasks will include working on Azure Databricks, writing code in Python and SQL with PySpark, and performing analysis, design, implementation, and testing. We highly value automated testing to ensure the quality of our solutions. Key Responsibilities: - Extend the functionality of the consistency check engine for the sub-ledger data and any other tenants - Dive deeply into spark performance optimization due to large data volume (datasets with 10s of billion rows, 200+ columns) Qualifications Required: - Bachelor's or master's degree in computer scie...

You will be joining EY as a Data Engineering Lead, where you will collaborate with the Data Architect to design and implement scalable data lake architecture and data pipelines. Your responsibilities will include designing and implementing scalable data lake architectures using Azure Data Lake services, developing and maintaining data pipelines, optimizing data storage and retrieval processes, ensuring data security and compliance, collaborating with data scientists and analysts, monitoring and troubleshooting data pipeline issues, and documenting data lake designs and best practices. You should have experience with SQL, NoSQL databases, and big data file formats like Parquet and Avro. **Key...

As a Database Engineer with 1 to 3 years of experience, you will play a crucial role in designing, optimizing, and managing databases to ensure scalability, security, and high performance. Your responsibilities will involve collaborating with AI/Engineering teams to enhance storage, retrieval, and analytics pipelines, with a focus on utilizing Azure Databricks for advanced data processing and analytics. Key Responsibilities: - Design, develop, and maintain scalable database architectures using SQL & NoSQL technologies. - Optimize database queries, indexing, and performance tuning for efficiency. - Ensure data security, compliance, backup procedures, and disaster recovery plans are in place. ...

As a Data Engineer / Analyst at this company in Hyderabad (Hybrid work model), your responsibilities will include: - Designing, developing, and maintaining data solutions on Azure Databricks using Python, SQL, and PySpark. - Working extensively with Delta Lake and relational databases to build scalable data pipelines. - Performing analysis, design, implementation, and automated testing of data solutions. - Enhancing the consistency check engine for sub-ledger data and other tenants. - Optimizing Spark performance for very large datasets (10s of billions of rows, 200+ columns). - Identifying, troubleshooting, and resolving data issues proactively. - Collaborating with cross-functional teams t...

Role Overview: As an Associate Data Architect I-ADF at ADB, with 10+ years of experience, you will play a crucial role in designing and building scalable data solutions and modern data platforms. Your deep technical proficiency in PySpark, SQL, Azure Databricks, and experience with cloud environments such as AWS or GCP will be essential in leading the design and implementation of robust ETL/ELT pipelines. Your responsibilities will include developing data models using Kimball/star schema and mentoring a team of engineers in a fast-paced, data-driven organization. Key Responsibilities: - Design, develop, and maintain scalable, efficient ETL/ELT data pipelines for data ingestion, transformatio...

Role Overview: You will be responsible for utilizing your 5+ years of experience in Data Modeling, particularly Dimensional modeling, to support industrial data initiatives at EZData Advisory. Your key role will involve designing scalable data models, collaborating with cross-functional teams, and driving data architecture best practices across CCEP domains. Key Responsibilities: - Participate in Requirement workshops/ Backlog refinement workshop to understand data requirements for the project. - Build and maintain conceptual, logical, and physical data models using industry-standard tools (e.g., ER/Studio, Erwin). - Collaborate closely with Data Analysts, Data Stewards, and the Data Governa...

As an Azure Databricks with Pyspark professional, your role involves: - Designing, building, and deploying data pipelines and workflows using Databricks. - Developing and optimizing Apache Spark applications for data processing and analytics. - Integrating Databricks with various data sources and platforms. - Implementing data quality checks and monitoring processes. - Managing and configuring the Databricks environment, including clusters and notebooks. - Troubleshooting and resolving issues related to Databricks performance and functionality. - Collaborating with data scientists and analysts to implement machine learning models. - Staying up-to-date with the latest Databricks features and ...