4749 Data Bricks Jobs - Page 38

JD for Unity Catalog and Databricks Engineer ClientPersistent Role C2H LocationPan India Job description Experience-6 to 9yrs overall, Also experience in Pyspark, Databricks Location-PAN INDIA(except Hyderabad and Chennai as preferred location) NP-Immediate/15 days Hybrid-2 or 3 days WFO "Unity Catalog Adoption Data Engineer 3-6 Years,PySpark,Databricks,Unity Catalog JD Design, develop, and maintain efficient and scalable data pipelines using PySpark, Databricks. Utilize Databricks to orchestrate and automate data workflows. Implement and manage data storage solutions using Unity Catalog for effective data governance. Collaborate with data scientists, analysts, and business stakeholders to e...

Description Minimum Requirements 1. Experience in ETL Testing, data analysis and quality assurance. 2. Strong knowledge on SQL 3. Familiar with Data warehousing concepts and data modeling 4. Working knowledge on ETL Tool and Agile 5. Good communication skills Good to have 1. Knowledge or experience on cloud-based ETL solutions. 2. Experience on Data Migration knowledge on Databricks is added advantage Named Job Posting? (if Yes - needs to be approved by SCSC) Additional Details Global Grade B Level To Be Defined Named Job Posting? (if Yes - needs to be approved by SCSC) No Remote work possibility No Global Role Family To be defined Local Role Name To be defined Local Skills ETL Testing Langu...

Hire Type: Fulltime Tech Stack: Proficiency in Python, SQL, Databricks, Snowflake Data Modeling, ETL process, Apache Spark and PySpark, data integration and workflow orchestration, real time data processing experience/frameworks, Cloud experience (Azure preferred) Job Description Minimum 5 years of experience in Data Engineering role that involves Analyzing, organizing raw data, and building data systems & pipelines in Cloud Platform [Azure] Experienced in migrating data from on-prem to cloud-based solution architectures [Azure] Extensive experience with Python, Spark and SQL Experience in developing ETL processes. Proficient with Azure Data Lake, Azure Data Factory, Azure SQL, Azure Databri...

Description: Minimum Requirements 1. Experience in ETL Testing, data analysis and quality assurance. 2. Strong knowledge on SQL 3. Familiar with Data warehousing concepts and data modeling 4. Working knowledge on ETL Tool and Agile 5. Good communication skills Good to have 1. Knowledge or experience on cloud-based ETL solutions. 2. Experience on Data Migration knowledge on Databricks is added advantage Named Job Posting? (if Yes - needs to be approved by SCSC) Additional Details Global Grade : B Level : To Be Defined Named Job Posting? (if Yes - needs to be approved by SCSC) : No Remote work possibility : No Global Role Family : To be defined Local Role Name : To be defined Local Skills : ET...

Data Support Engineer Location: Bangalore Experience 6+yrs Rate 30 LPA AMVikas POC:Swati Patil Key Responsibilities: Database Development & Support: Write and optimize SQL queries, stored procedures, and views for data retrieval and transformation. Develop and maintain data pipelines to support business intelligence and analytics requirements. Support SQL Server and Amazon Redshift environments for data storage, transformation, and analytics. Ensure data integrity, security, and quality across all database solutions. Operational Support: Monitor ETL logs and troubleshoot data pipeline issues to minimize downtime. Perform data validation and reconciliation to ensure data accuracy. Maintain Ex...

Summary Within this role, you would be a hands-on experience in data engineering functions including schema design, data movement, data transformation, encryption, and monitoring: all the activities needed to build, sustain, and govern big data pipelines. Responsibilities Own development of large-scale data platform including operational data store, real time metrics store and attribution platform, data warehouses and data marts for advertising planning, operation, reporting and optimization Wider team collaboration and system documentation Maintain next-gen cloud based big data infrastructure for batch and streaming data applications, and continuously improve performance, scalability and av...

Azure Databricks: 1. Mounting Files 2. PAT Tokens 3. Cluster Auto scaling 4. Cluster Types 5. Nesting notebooks 6. Reading file using default and custom schema 7. Types Secrets and scopes in databricks 8. Delta Tables 9. Basic file loading scenario with its steps 10. Optimization 11. User defined functions 12. Transformations ADF: 1. Integration runtimes familiar with and where they are used 2. Components in creating pipelines 3. Scenario based question for creating a basic pipeline for loading data to Azure SQL table 4. Basic steps to improve the loading activity of a huge amount of file , ex: 1TB file size

Description: Mandatory skills: oOverall 2-4+ years of exp, Cloud and infra related Skills oMandatory hands-on experience in Azure services like Active directory, Container registry, Keyvault, Storage, Kubernetes, Terraform, PowerShell / Python scripting. oAdministrating Kubernetes cluster oExperience in creating Azure pipelines. oDeveloping Terraform code and automation. oScripting experience with PowerShell/Python. Preferred skills: oExperience in Postgres DB, Azure Data Factory, Data bricks, Data Integration oKafka Additional Details Global Grade : B Remote work possibility : No Local Skills : Microsoft Azure;PaaS Languages Required: : ENGLISH

We are seeking a highly skilled Data Architect/Lead with expertise in Azure Data Systems to join our team. As a Data Architect/Lead, you will be responsible for designing and implementing scalable, high-performance data solutions using Azure data services. This role offers an exciting opportunity to work on cutting-edge projects and play a key role in shaping our data architecture strategy. Responsibilities: Design, develop, and implement scalable and robust data architectures using Azure data services such as Azure SQL Database, Azure Synapse Analytics, Azure Data Lake, and Azure Data Factory. Collaborate with cross-functional teams to gather requirements and translate them into data archit...

Data Engineer + Level Sr.Analyst + Entity ACS/Accenture Song Management Level: Level 10- Sr. Analyst Location:Kochi, Coimbatore, Trivandrum Must have skills:Python/Scala, Pyspark/Pytorch Good to have skills:Redshift Job Summary Youll capture user requirements and translate them into business and digitally enabled solutions across a range of industries. Your responsibilities will include: Roles and Responsibilities Designing, developing, optimizing, and maintaining data pipelines that adhere to ETL principles and business goals Solving complex data problems to deliver insights that helps our business to achieve their goals. Source data (structured unstructured) from various touchpoints, forma...

Bachelor's degree in Computer Science, Information Technology, or a related field. A master's degree is a plus. Proven experience as a Data Engineer or in a similar role, with a focus on ETL processes and database management. Proficiency in the Microsoft Azure data management suite (MSSQL, Azure Databricks , PowerBI , Data factories, Azure cloud monitoring, etc.) and Python scripting. Strong knowledge of SQL and experience with database management systems Strong development skills in python and pyspark . Experience with data warehousing solutions and data mart creation. Familiarity with big data technologies (e.g., Hadoop, Spark) is a plus. Strong problem-solving skills and attention to deta...

Identifying business problems, understand the customer issue and fix the issue. Evaluating reoccurring issues and work on for permanent solution Focus on service improvement. Troubleshooting technical issues and design flaws Required education Bachelor's Degree Preferred education Master's Degree Required technical and professional expertise BE / B Tech in any stream, M.Sc. (Computer Science/IT) / M.C.A, with Minimum 3-5 years of experience Azure IAAS, PASS & SAAS services expert and Handson experience on these and below all services. VM, Storage account, Load Balancer, Application Gateway, VNET, Route Table, Azure Bastion, Disaster Recovery, Backup, NSG, Azure update manager, Key Vault etc....

Graduate degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field. 7+ Yrs total experience in Data Engineering projects & 4+ years of relevant experience on Azure technology services and Python Azure Azure data factory, ADLS- Azure data lake store, Azure data bricks, Mandatory Programming languages Py-Spark, PL/SQL, Spark SQL Database SQL DB Experience with AzureADLS, Databricks, Stream Analytics, SQL DW, COSMOS DB, Analysis Services, Azure Functions, Serverless Architecture, ARM Templates Experience with relational SQL and NoSQL databases, including Postgres and Cassandra. Experience with object-oriented/object function scripting languagesPython...

Key Responsibilities Design and implement scalable, secure, and maintainable software architectures using Python and related technologies. Collaborate with stakeholders, business analysts, and cross-functional teams to understand technical and business requirements. Define architectural standards, best practices, and development guidelines for Python-based systems. Evaluate and select appropriate frameworks, libraries, and tools for various projects. Oversee code quality, performance tuning, and application optimization. Lead the migration or integration of legacy systems to modern Python-based platforms. Create and maintain technical documentation, architecture diagrams, and API specificati...

Key Responsibilities Design and implement scalable, secure, and maintainable software architectures using Python and related technologies. Collaborate with stakeholders, business analysts, and cross-functional teams to understand technical and business requirements. Define architectural standards, best practices, and development guidelines for Python-based systems. Evaluate and select appropriate frameworks, libraries, and tools for various projects. Oversee code quality, performance tuning, and application optimization. Lead the migration or integration of legacy systems to modern Python-based platforms. Create and maintain technical documentation, architecture diagrams, and API specificati...

Minimum 8+ years of working experience in Technology (application development and production support) and Minimum 5+ years of experience in developing & supporting ETLs and using Python/Scala in Databricks/Spark platform.

Required Qualifications o 3+ Years professional experience in a data Engineer/analyst role or similar.o At least 5+ year of Development experience in ADF V2 . o At least 1 years of Experience with Spark (PySpark and other python data libraries), Spark Scala is also fine.o At least 1 years of experience in T-SQL, creating complex store procedures, triggers etc. o Should have used Azure DevOps extensively as part of projectso Should have worked on at least 1 project involving hybrid cloud implementation. o Should have worked on Azure Data Bricks, SQL Database, Azure SQL Database, Azure Datawarehouse and should be comfortable with data warehousing concepts. o Should have worked on Azure Logic A...

Position Overview We are looking for an experienced Full Stack Developer who has a strong experience in web application development, focusing on integrating Generative AI and Agentic Application models. Proficiency in React.js (front-end), Python (back-end), Databricks, and Azure platforms is required. Knowledge of Node.js, CI/CD pipelines, and Terraform is beneficial. The role will work with AI engineers , data scientists, and software engineers to embed and deploy AI models, ensuring seamless integration and performance. Key Responsibilities Front-End Development: - Create responsive UIs using React.js and modern JavaScript (ES6+). - Use state management libraries like Redux or Zustand. - ...

About the Role Youll lead the architecture, development, and deployment of next-generation agentic AI systems that transform enterprise operations. These intelligent agents will autonomously orchestrate workflows, analyze real-time data, and embed decision-making across domains like finance, sales, and operations. Youll guide cross-functional teams, mentor engineers, and ensure technical excellence across all stages of delivery. Microsoft AI Foundry will be a key platform for agent development, and Copilot Studio may be used optionally for few use cases. Responsibilities Architect and lead development of scalable, production-grade agentic AI systems. Design serverless, event-driven workflows...

About the role: The Data Intelligence Center of Excellence is looking for a high-performing Senior Data Scientist to support Blackbaud customers through the creation and maintenance of intelligent data products . Additionally, the senior data scientist will collaborate with team members on research and thought leadership initiatives . What youll do: Use statistical techniques to manage and analyze large volumes of complex data to generate compelling insights to include predictive modeling, storytelling, and data visualization Integrate data from multiple sources to create dashboards and other end-user reports Interact with internal customers to identify and define topics for research and exp...

About the Role We are seeking a highly skilled and experienced Data Architect to join our team. The ideal candidate will have at least 18 years of experience in Data engineering and Analytics and a proven track record of designing and implementing complex data solutions. As a senior principal data architect, you will be expected to design, create, deploy, and manage Blackbauds data architecture. This role has considerable technical influence within the Data Platform, Data Engineering teams, and the Data Intelligence Center of Excellence at Blackbaud. This individual acts as an evangelist for proper data strategy with other teams at Blackbaud and assists with the technical direction, specific...

The Data Intelligence Center of Excellence is looking for the right candidate to join us as Principal Product Manager, AI and Data Product Platform . This in an incredibly exciting and important role in the Data Intelligence Center of Excellence; this product manager will be responsible for the tech stack that enables our data business transformation, driving step-function improvements in customer outcomes, automation, delightful user experiences, and higher product margins. We're looking for someone with their eyes on the horizon - someone who's able to lay out a big idea and has the drive to make it happen. This individual will be the link between vertical market groups, Centers of Excelle...

Title and Summary Senior Software Engineer-3 Senior Software Development Engineer (DW) Job Posting Title Overview Mastercard is looking for a Senior Software Engineer to join the Account Level Management(ALM) team in our Pune office thats focused on building ALM Services with Data warehouse skills. The Mastercard Account Level Management platform empowers real-time card level decisioning. As consumers progress along their life stages as card holders, with increasing disposable income and more refined preferences, ALM provides services to issuers so they can effectively offer more relevant benefits and rewards at each stage, to drive loyalty and spend. Role o Develop high quality, secure and ...

What you'll do Develop, maintain, and enhance new data sources and tables, contributing to data engineering efforts to ensure comprehensive and efficient data architecture. Serves as the liaison between Data Engineer team and the Airport operation teams, developing new data sources and overseeing enhancements to existing database; being one of the main contact points for data requests, metadata, and statistical analysis Migrates all existing Hive Metastore tables to Unity Catalog, addressing access issues and ensuring smooth transition of jobs and tables. Collaborate with IT teams to validate package (gold level data) table outputs during the production deployment of developed notebooks Deve...

General Summary: Data Platform, Engineering and Operations lead will play a pivotal role in shaping the future of our data capabilities as part of strategic and critical Enterprise Data Transformation (EDT) program. We're seeking a visionary, hands-on leader to drive the build out of a modern enterprise-wide lake house, ensuring reliability, scalability, security, and compliance. and enabling cutting edge analytics solutions. This role will be leading a talented team of platform and data engineers, fostering a culture of excellence while balancing speed of delivery with innovation and operational excellence. This role will also collaborate with cross functional teams (Solution engineers, SME...