6138 Data Bricks Jobs - Page 41

Job Title: Azure Databricks Data Engineer Location: Pune/Hyderabad Employment Type: Full-time Job Summary We are looking for a highly skilled Azure Databricks Data Engineer to design, build, and optimize cloud-based data pipelines and analytical solutions. The ideal candidate will have deep experience with Azure services, Databricks (PySpark), Delta Lake , and modern data engineering best practices. Key Responsibilities Design, build, and operationalize large-scale data pipelines in Azure Databricks using PySpark and Delta Lake. Develop ETL/ELT data flows using Azure services such as Azure Data Factory (ADF) , Azure Data Lake Storage (ADLS) , Azure Synapse , and Azure Functions . Implement a...

Job Summary The Data Analyst will be responsible for collecting, analyzing, and interpreting complex data sets to support business decision-making. This role includes generating insights, building dashboards, improving data quality, and working closely with cross-functional teams to provide actionable recommendations. Key Responsibilities Collect, clean, and validate data from multiple sources. Perform exploratory data analysis to identify trends, anomalies, and insights. Build dashboards and reports using BI tools (Power BI, Tableau, Looker, etc.). Develop automated data pipelines and workflows. Analyze key performance metrics and track business performance. Prepare and present data-driven ...

Job Title : Data Engineer Location: Gurugram, Haryana Experience: 3-5 Years Role Overview : We are seeking a skilled Data Engineer with experience in designing, building, and optimizing big data solutions to meet business and technology needs. The ideal candidate will have a strong background in Hadoop, Hive, Spark, and Python/Java , with proven expertise in handling large-scale datasets, implementing data governance best practices, and ensuring data quality across all layers. Key Responsibilities: Design, develop, and maintain scalable big data pipelines and architectures to support business and analytical needs Build and optimize data processing systems using technologies such as Hadoop, H...

Strong Python, PySpark & SQL skills Good understanding of ML libraries Azure expertise (Databricks, Data Factory, DevOps) CI/CD experience Experience with SQL Server / Oracle / MySQL Excellent communication & problem-solving skills

Key Responsibilities: Design, develop, and deploy AI/ML solutions on the Azure platform. Implement supervised and unsupervised machine learning models and predictive analytics using Python. Perform feature generation through data exploration and subject matter expert (SME) requirements. Query and manipulate relational databases for data extraction and analysis. Apply computational algorithms and statistical methods to both structured and unstructured data. Communicate analytical results effectively using data visualizations. Utilize Big Data technologies like Spark with PySpark for scalable data processing. Manage Azure resources including RBAC roles, storage accounts, web apps, key vault, S...

We are looking a Senior Data Engineer with extensive experience in designing and building scalable data pipelines, integrating AI/LLM models, and developing automation solutions using Python. The ideal candidate will have strong hands-on expertise in ETL workflows, deep proficiency with cloud platforms, and a proven track record of implementing robust data governance and security practices. Role & responsibilities Bachelors or Masters degree in Computer Science, Engineering, or a related field. Extensive full-lifecycle data engineering experience within enterprise environments. Strong expertise in ETL development, API integrations, data processing workflows, and implementation of GenAI-power...

Looking for immediate joiners Required Responsibility: Understand Requirement, Analyze, Design, Develop, Test and Deploy End to End Azure based Data and Analytics solutions Develop, Test, Debug, Monitor data solutions, like data pipelines, data warehousing, and big data solutions, with Azure Data Fabric and Azure Synapse Analytics Follow Best Practices, Guideline, Review, Tune and optimize Microsoft Azure Synapse Analytics experience is essential. (Dedicated SQL Pool, Azure Data Factory, Azure Storage) End-to-end Data Warehouse experience: ingestion, ETL, big data pipelines, data architecture, message queuing, stream processing, BI/Reporting, and Data Security. Ability to build processes sup...

Area(s) of responsibility Test Lead Key Responsibilities Test strategy and planning: Design and develop comprehensive test strategies, test plans, and test cases for ETL workflows and data pipelines. Team leadership: Lead and mentor the ETL testing team, allocating tasks, and providing technical guidance. Collaboration: Work closely with business analysts, data engineers, and developers to understand requirements and resolve issues. Quality Metrices: Monitor and analyse data quality metrics, identifying and resolving data issues. Data validation: Perform data validation, reconciliation, and verification between source and target systems using SQL and other tools to ensure data accuracy and c...

Area(s) of responsibility Test Lead Key Responsibilities Test strategy and planning: Design and develop comprehensive test strategies, test plans, and test cases for ETL workflows and data pipelines. Team leadership: Lead and mentor the ETL testing team, allocating tasks, and providing technical guidance. Collaboration: Work closely with business analysts, data engineers, and developers to understand requirements and resolve issues. Quality Metrices: Monitor and analyse data quality metrics, identifying and resolving data issues. Data validation: Perform data validation, reconciliation, and verification between source and target systems using SQL and other tools to ensure data accuracy and c...

Area(s) of responsibility irlasoft, a global leader at the forefront of Cloud, AI, and Digital technologies, seamlessly blends domain expertise with enterprise solutions. The company's consultative and design-thinking approach empowers societies worldwide, enhancing the efficiency and productivity of businesses. As part of the multibillion-dollar diversified CKA Birla Group, Birlasoft with its 12,000+ professionals, is committed to continuing the Group's 170-year heritage of building sustainable communities. Key Responsibilities Test strategy and planning: Design and develop comprehensive test strategies, test plans, and test cases for ETL workflows and data pipelines. Team leadership: Lead ...

Han Digital Solution (P) is looking for Scala developer + play /Akka to join our dynamic team and embark on a rewarding career journey We are looking for a skilled Scala developer with expertise in Play and Akka to join our team at Han Digital Solution (P) The ideal candidate will have a strong background in software development using Scala, Play, and Akka Roles and Responsibility Design, develop, and test scalable software applications using Scala, Play, and Akka Collaborate with cross-functional teams to identify and prioritize project requirements Develop high-quality code that meets industry standards and best practices Troubleshoot and resolve technical issues efficiently Participate in...

Han Digital Solution (P) is looking for ETL Test (Python+Azure) - Alaka POC to join our dynamic team and embark on a rewarding career journey We are looking for a skilled ETL Test professional with expertise in Python and Azure to join our team at Han Digital Solution (P) The ideal candidate will have experience in testing and validating ETL processes, ensuring data quality and integrity This role is based in Alaka POC Roles and Responsibility Design and develop test cases for ETL processes to ensure data accuracy and completeness Collaborate with cross-functional teams to identify and resolve data-related issues Develop and maintain automated testing scripts using Python Integrate Azure ser...

Primary skills: Threat hunting, threat intelligence, Splunk In-depth knowledge of external attacks and detection techniques to be able to run analysis of the requirements provided by threat intelligence / SOC teams, generate list of rules that could be implemented (based on self analysis of a threat and avaiable log sources), work with SOC team to operationalize and Purple Team to test Familiarity with MITRE ATT&CK framework and Tactics, Techniques, and Procedures (TTPs) Experience with security tools such as Splunk, MDE , Databricks to be able to write custom detections to detect various threats (preferably MDE)

Data Engineer + Power BI ( Power BI is good to have) Experience - 4+ yrs Location only Pune Kharadi Budget 14 LPA Max Candidate should be ready for f2f interview , should be in Pune Must have in Azure databricks Must have in Data factory Must have in Python Must have in SQL Power BI Good to have.

JD: Seeking a Power BI Developer with strong expertise in database technologies to design, develop, and implement business intelligence solutions. The ideal candidate will possess advanced Power BI skills along with hands-on experience in database design, development, and optimization. This role involves working with large datasets, ensuring data integrity, and creating impactful dashboards and reports to support business decision-making. Requirements Power BI Expertise: o Proficient in Power BI Desktop, Power BI Service, and Power BI Mobile. o Advanced knowledge of DAX (Data Analysis Expressions) and Power Query (M Language). o Expertise in creating custom visuals, slicers, and drill-throug...

Skill: Azure Databricks + Pyspark Location: Hyderabad Experience: 6 to 8 Years Job Summary 6 plus years of technical and development experience 3 plus years of Experience with Azure Data Factory Azure Synapse and Databricks Experience with ETL SQL PySpark Experience managing cloud applications (Managing network security is a plus) Experience with git repositories and release pipelines Ability to communicate effectively Ability to manage multiple tasks and deadlines with attention to detail 1 or more professional Azure certifications Prior work experience in Datastag Responsibilities 6 plus years of technical and development experience 3 plus years of Experience with Azure Data Factory Azure ...

Skill: Azure Databricks + Pyspark Experience - 9 to 12 Years Location: Hyderabad Job Summary 8 plus years of technical and development experience 3 plus years of Experience with Azure Data Factory Azure Synapse and Databricks Experience with ETL SQL PySpark Experience managing cloud applications (Managing network security is a plus) Experience with git repositories and release pipelines Ability to communicate effectively Ability to manage multiple tasks and deadlines with attention to detail 1 or more professional Azure certifications Prior work experience in Datastag Responsibilities 8 plus years of technical and development experience 3 plus years of Experience with Azure Data Factory Azur...

Azure Databricks Location - Hyderabad / Experience - 9 to 12 Years Job Summary 8plus years of technical and development experience 3 plus years of Experience with Azure Data Factory Azure Synapse and Databricks Experience with ETL SQL PySpark Experience managing cloud applications (Managing network security is a plus) Experience with git repositories and release pipelines Ability to communicate effectively Ability to manage multiple tasks and deadlines with attention to detail 1 or more professional Azure certifications Prior work experience in Datastage Responsibilities 8plus years of technical and development experience 3 plus years of Experience with Azure Data Factory Azure Synapse and D...

Work Location: Pan India Experience: 7-20yrs Required Skills: Develop and maintain Azure Data Architecture, ensuring compliance with data-related policies and standards Analyze data-related system integration challenges and propose appropriate solutions Design and implement data solutions on Azure, using a range of services like Azure SQL Database, Data Factory, Data Lake Store, Data Lake Analytics, Stream Analytics, Azure Storage, Cosmos DB and more Collaborate with data scientists and IT team members to assist with data-related technical issues and support their data infrastructure needs Implement data security and privacy protection Thanks & Regards Suganya R suganya@spstaffing.in

Key Responsibilities: Cloud Infrastructure & Architecture: • Design, provision, and configure cloud infrastructure within Azure using IaC principles to ensure automation, consistency, and scalability. • Review existing cloud implementations and design a future-proof architecture for the Data and Analytics platform. • Define and implement standardised naming conventions and cloud configurations for a structured, manageable environment. Security and Access Management: • Configure robust Identity and Access Management (IAM) and User Access Management (UAM) to ensure secure and controlled access to all data resources. • Enforce data security and governance policies in line with organisational st...

• Build ,optimize ETL/ELT pipelines • Develop scalable data models • Ensure data quality, integrity,observability • Engineer cloud solutions (Azure/AWS/GCP) • Collaborate with product + engineering teams • Drive architecture, performance, automation

Responsibilities: * Develop data pipelines using Python, SQL & Airflow. * Collaborate with cross-functional teams on data initiatives. * Design data models and implement ETL processes.

At EY, you'll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And we're counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all. **Role Overview:** As a Data Integration Consultant Senior, you will be responsible for designing, developing, and deploying data-driven solutions that enhance supply chain operations and decision-making processes for clients. You will work closely with IT, supply chain, and other stakeholders to understand data analysis needs, develop strate...

As a Test Lead at Birlasoft, you will play a crucial role in ensuring the quality and accuracy of ETL workflows and data pipelines. Your responsibilities will include: - Designing and developing comprehensive test strategies, test plans, and test cases for ETL workflows and data pipelines. - Leading and mentoring the ETL testing team, allocating tasks, and providing technical guidance. - Collaborating closely with business analysts, data engineers, and developers to understand requirements and resolve issues. - Monitoring and analyzing data quality metrics, identifying and resolving data issues. - Performing data validation, reconciliation, and verification between source and target systems ...

Arkatechture is seeking a Support Desk Coordinator to join our Support Services team. In this role, you will provide frontline support for our BI & Analytics platform, Arkalytics, serving as a fi rst point of contact for customer requests and routine issues. Youll be responsible for accurately triaging tickets, maintaining clear communication with customers, and delivering timely resolutions. Along the way, you’ll build foundational skills with our platform, tools, processes, and client interactions, creating a clear pathway to grow your data and technical expertise. The ideal candidate is a proactive problem solver with a technical foundation, strong communication skills, and the ability to...