22 Databrick Jobs

Position Summary: As a Software Architect, you will be responsible for providing technical leadership and architectural guidance to development teams, ensuring the design and implementation of scalable, robust, and maintainable software solutions. You will collaborate with stakeholders, including business leaders, project managers, and developers, to understand requirements, define architectural goals, and make informed decisions on technology selection, system design, and implementation strategies. Additionally, you will mentor and coach team members, promote best practices, and foster a culture of innovation and excellence within the organization. This role is based in Redaptive Pune, India office. Responsibilities and Duties: Time Spent Performing Duty: System Design and Architecture : 40% Identify and propose technical solutions for complex problem-statements. Provides an application-level perspective during design and implementation, which incorporates for cost constraints, testability, complexity, scalability, performance, migrations, etc. Provide technical leadership and guidance to development teams, mentoring engineers and fostering a culture of excellence and innovation. Review code and architectural designs to ensure adherence to coding standards, best practices, and architectural principles. Create and maintain architectural documentation, including architectural diagrams, design documents, and technical specifications, to ensure clarity and facilitate collaboration. Software Design and Development: 50% Gather and analyze requirements from stakeholders, understanding business needs, and translating them into technical specifications. Work alongside teams at all stages of design & development. Augmenting and supporting teams as needed. Collaborate with product managers, stakeholders, and cross-functional teams to define project scope, requirements, and timelines, and ensure successful project execution. Knowledge Sharing and Continuous Improvement: 10% Conduct presentations, workshops, and training sessions to educate stakeholders and development teams on architectural concepts, best practices, and technologies. Stay updated with emerging technologies, industry trends, and best practices in software architecture and development. Identify opportunities for process improvement, automation, and optimization in software development processes and methodologies. Share knowledge and expertise with team members through mentorship, training sessions, and community involvement. Required Abilities and Skills: Strong analytical and troubleshooting skills. Excellent verbal and written communication skills. Ability to effectively communicate with stakeholders, including business leaders and project managers to understand requirements and constraints. Works effectively with cross-functional teams, including developers, QA, product managers, and operations. Capability to understand the bigger picture and design systems that align with business goals, scalability requirements, and future growth. Ability to make tough decisions and take ownership of architectural choices, considering both short-term and long-term implications Mastery of one or more programming languages commonly used in software development, such as Java, Python, or JavaScript. Expertise in SQL and NoSQL database, including database design and optimization. Ability to quickly learn new technologies and adapt to changing requirements. Knowledge of techniques for designing scalable and high-performance web services, including load balancing, caching, and horizontal scaling. Knowledge of software design principles (e.g. object-oriented principles, data structures, and algorithms.) Processes a security mindset, drives adoption of best practices to design systems that are secure and resilient to security threats. Continuously learning and staying up to date with emerging technologies and best practices. Domain knowledge in energy efficiency, solar/storage, or electric utilities is a plus. Education and Experience: 10+ years of software development experience. Proven track record of delivering high-quality software solutions within deadlines. Demonstrated technical leadership experience. Experience with data heavy systems like Databricks and Data Ops. Experience with Cloud (AWS) application development. Experience with Java & Spring framework strongly preferred. Experience with distributed architectures, SOA, microservices and containerization technologies (e.g., Docker, Kubernetes) Experience designing and developing web-based applications and backend services. Travel: This role may require 1-2 annual international work visits to the US. The Perks! Equity plan participation Medical and Personal Accident Insurance Support on Hybrid working and Relocation Flexible Time Off Continuous Learning Annual bonus, subject to company and individual performance The company is an Equal Opportunity Employer, drug free workplace, and complies with Labor Laws as applicable. All duties and responsibilities are essential functions and requirements and are subject to possible modification to reasonably accommodate individuals with disabilities. The requirements listed in this document are the minimum levels of knowledge, skills, or abilities.

Primary Responsibilities Come up with architecture and design on various aspects like extensibility, scalability, security, design patterns etc., against a predefined checklist and ensure that all relevant best practices are followed Execute POCs to make sure that suggested design/technologies meet the requirements Architecting with modern technology stack and Designing Public Cloud Application leveraging in Azure Possess/acquire solid troubleshooting skills and be interested in performing. Troubleshooting of issues in different desperate technologies and environments Comply with the terms and conditions of the employment contract, company policies and procedures, and any and all directives (such as, but not limited to, transfer and/or re-assignment to different work locations, change in teams and/or work shifts, policies in regards to flexibility of work benefits and/or work environment, alternative work arrangements, and other decisions that may arise due to the changing business environment). The Company may adopt, vary or rescind these policies and directives in its absolute discretion and without any limitation (implied or otherwise) on its ability to do so Required Qualifications Graduate degree or equivalent ( Experience - 6+ years ) Solid foundational skills on Data engineering (using on prime & cloud tools) Data Management Data engineering on Azure Azure Databricks Azure Data flow, Azure Functions ANSI SQL, PySpark and Spark SQL - ETL Processes, Databrick DLT (Delta Live table) Unity Catalog integration Orchestrate with Databricks workflow CI/CD and version control Knowledge on Snowflake, RDBMS

1. Good Experience on core java/Python. 2. Experience on any web framework like Spring Boot/Fastapi. 3. Experience on indexing and querying data from Elasticsearch with variety of data sources. 4. Experience writing data discovery, analytics and Visualization application using Elasticsearch. 5. Experience implementing search solutions using Elasticsearch. 6. Experience implementing AI/ML usecases. 7. Experience working migration from Solr to Elasticsearch preferred. 8. Basic knowledge of bigdata systems like Databrick, Snowflake will be added advantage. 9. Self-motivated, fast learner, individual contributor preferred.

Azure + databrick + Advanced SQL+ Data Modeling Understanding current architecture and design principles of Databricks echo system Understanding of Managing and securing data assets in Databricks using Unity Catalog. Understanding Monitoring and observability using Datadog. Understanding Code quality and security analysis with SonarQube. Code walkthrough to explain current Python / Pyspark scripts for data processing and analysis. Understanding Version control with GitHub and automating workflows using GitHub Actions. Understanding financial operations and cost management in cloud environments. Understanding 3rd Party Vendor coordination and escalation matrix (if any) Understanding of existing DevOps for CI/CD pipeline Understanding of current performance of application, monitoring and logging practices

Azure + databrick + Advanced SQL+ Data Modeling Understanding current architecture and design principles of Databricks echo system Understanding of Managing and securing data assets in Databricks using Unity Catalog. Understanding Monitoring and observability using Datadog. Understanding Code quality and security analysis with SonarQube. Code walkthrough to explain current Python / Pyspark scripts for data processing and analysis. Understanding Version control with GitHub and automating workflows using GitHub Actions. Understanding financial operations and cost management in cloud environments. Understanding 3rd Party Vendor coordination and escalation matrix (if any) Understanding of existing DevOps for CI/CD pipeline Understanding of current performance of application, monitoring and logging practices

Azure + databrick + SQL + Pyspark Understanding current architecture and design principles of Databricks echo system Understanding of Managing and securing data assets in Databricks using Unity Catalog. Understanding Monitoring and observability using Datadog. Understanding Code quality and security analysis with SonarQube. Code walkthrough to explain current Python / Pyspark scripts for data processing and analysis. Understanding Version control with GitHub and automating workflows using GitHub Actions. Understanding financial operations and cost management in cloud environments. Understanding 3rd Party Vendor coordination and escalation matrix (if any) Understanding of existing DevOps for CI/CD pipeline Understanding of current performance of application, monitoring and logging practices

• Minimum 6 years experience within Data Engineering with minimum 2 years in a similar role • Experience with Databrick, DBT, Python and Pyspark is preferrable but not mandatory • Comfortable working within conceptual, logical and physical data model following Data Vault 2.0 and Kimball data modelling methodologies • Strong experience working in Data Warehousing and Data Analytics projects including data acquisition, data transformation, and data migration projects • Strong experience in SQL and Redshift • Experience in developing and optimising data pipelines using control-m and sql • Experience in data migration, building, enhancing, and maintaining cloud data warehousing • Experience in performance tuning and optimising databases and SQL queries for analysis and reporting • Ability to rapidly acquire an understanding of complex business problems/requirements to develop solutions and designs, regardless of existing areas of expertise or specialisation • Strong skills and experience in cloud environments, especially AWS • Experience supporting high availability production systems is desirable

• Minimum 6 years experience within Data Engineering with minimum 2 years in a similar role • Experience with Databrick, DBT, Python and Pyspark is preferrable but not mandatory • Comfortable working within conceptual, logical and physical data model following Data Vault 2.0 and Kimball data modelling methodologies • Strong experience working in Data Warehousing and Data Analytics projects including data acquisition, data transformation, and data migration projects • Strong experience in SQL and Redshift • Experience in developing and optimising data pipelines using control-m and sql • Experience in data migration, building, enhancing, and maintaining cloud data warehousing • Experience in performance tuning and optimising databases and SQL queries for analysis and reporting • Ability to rapidly acquire an understanding of complex business problems/requirements to develop solutions and designs, regardless of existing areas of expertise or specialisation • Strong skills and experience in cloud environments, especially AWS • Experience supporting high availability production systems is desirable

• Minimum 6 years experience within Data Engineering with minimum 2 years in a similar role • Experience with Databrick, DBT, Python and Pyspark is preferrable but not mandatory • Comfortable working within conceptual, logical and physical data model following Data Vault 2.0 and Kimball data modelling methodologies • Strong experience working in Data Warehousing and Data Analytics projects including data acquisition, data transformation, and data migration projects • Strong experience in SQL and Redshift • Experience in developing and optimising data pipelines using control-m and sql • Experience in data migration, building, enhancing and maintaining cloud data warehousing • Experience in performance tuning and optimising databases and SQL queries for analysis and reporting • Ability to rapidly acquire an understanding of complex business problems/requirements to develop solutions and designs, regardless of existing areas of expertise or specialisation • Strong skills and experience in cloud environments, especially AWS • Experience supporting high availability production systems is desirable What you'll do • Implement and maintain Datawarehouse platform and data pipelines suitable for Data Warehousing and reporting use cases • Build data assets that are aligned to IET data strategy and architectural roadmaps • Promote and champion Data Platform and Engineering ways of working via continuous build, continuous integration and continuous delivery • Support detailed solution design, data modelling, estimation and specification process • Promote test driven development and automated unit test frameworks within the teams • Promote and champion DevOps (CI/CD) practices using Bitbucket and Jenkins • Coordination of deployment and release activities for the team • Develop data engineering standards, implementation patterns and how to guides • Challenge the development team on their delivery of quality, unit test coverage and assistance in the creation of development artefacts • Contribute to risk analysis and utilise that information to plan development activities • Identify technical and process improvements that will benefit the business • Optimising code and ensuring we are getting the best out of the Data Platform • Foster a safe, innovative and results driven culture

• Minimum 6 years experience within Data Engineering with minimum 2 years in a similar role • Experience with Databrick, DBT, Python and Pyspark is preferrable but not mandatory • Comfortable working within conceptual, logical and physical data model following Data Vault 2.0 and Kimball data modelling methodologies • Strong experience working in Data Warehousing and Data Analytics projects including data acquisition, data transformation, and data migration projects • Strong experience in SQL and Redshift • Experience in developing and optimising data pipelines using control-m and sql • Experience in data migration, building, enhancing and maintaining cloud data warehousing • Experience in performance tuning and optimising databases and SQL queries for analysis and reporting • Ability to rapidly acquire an understanding of complex business problems/requirements to develop solutions and designs, regardless of existing areas of expertise or specialisation • Strong skills and experience in cloud environments, especially AWS • Experience supporting high availability production systems is desirable What you'll do • Implement and maintain Datawarehouse platform and data pipelines suitable for Data Warehousing and reporting use cases • Build data assets that are aligned to IET data strategy and architectural roadmaps • Promote and champion Data Platform and Engineering ways of working via continuous build, continuous integration and continuous delivery • Support detailed solution design, data modelling, estimation and specification process • Promote test driven development and automated unit test frameworks within the teams • Promote and champion DevOps (CI/CD) practices using Bitbucket and Jenkins • Coordination of deployment and release activities for the team • Develop data engineering standards, implementation patterns and how to guides • Challenge the development team on their delivery of quality, unit test coverage and assistance in the creation of development artefacts • Contribute to risk analysis and utilise that information to plan development activities • Identify technical and process improvements that will benefit the business • Optimising code and ensuring we are getting the best out of the Data Platform • Foster a safe, innovative and results driven culture

Looking for Technical support architect_ Remote Job Title: Technical Support Lead/Architect Experience: 7 to 18 years Location: Pan India Notice Period: Immediate to 10 Days System Administration: Must Have exp Databricks administration (application), Webapp administration (application), AWS Server administration, PG SQL administration, AWS console/Cloud administration Advanced Troubleshooting: Must Have Advanced application troubleshooting techniques & strategies VPCx issues working with client VPCx team for services issues Application Performance/System Performance Azure data bricks with postgresql is mandatory, Dont apply if you not have experience Kindly share your resume to Staffingteam3@ontimesolutions.in Call me 9036023026

About the Company : `Headquartered in California, U.S.A., GSPANN provides consulting and IT services to global clients. We help clients transform how they deliver business value by helping them optimize their IT capabilities, practices, and operations with our experience in retail, high-technology, and manufacturing. With five global delivery centers and 1900+ employees, we provide the intimacy of a boutique consultancy with the capabilities of a large IT services firm. Please find the Details below: Job Position (Title) Azure Data Engineers / Leads Experience Required 4 to 10 Yrs Location- Bangalore, Hyderabad, Pune Technical Skill Requirements - Azure, SQL, Pyspark, Python Pls share the below details also along with your profile: Full Name: Email Id: Contact No: Total years of experience - Relevant experience - Bigdata- Cloud- Rating on SQL : Any other Technology- Notice period - CTC- ECTC- Current company- Current location: Preferred location: Any offers, If yes, Pls mention- Interview availability for face to face OR Virtual?-Pls mention

About the Company : `Headquartered in California, U.S.A., GSPANN provides consulting and IT services to global clients. We help clients transform how they deliver business value by helping them optimize their IT capabilities, practices, and operations with our experience in retail, high-technology, and manufacturing. With five global delivery centers and 1900+ employees, we provide the intimacy of a boutique consultancy with the capabilities of a large IT services firm. Please find the Details below: Job Position (Title) Azure Data Engineers / Leads Experience Required 4 to 10 Yrs Location- Bangalore, Hyderabad, Pune Technical Skill Requirements - Azure, SQL, Pyspark, Python Pls share the below details also along with your profile: Full Name: Email Id: Contact No: Total years of experience - Relevant experience - Bigdata- Cloud- Rating on SQL : Any other Technology- Notice period - CTC- ECTC- Current company- Current location: Preferred location: Any offers, If yes, Pls mention- Interview availability for face to face OR Virtual?-Pls mention

About the Company : `Headquartered in California, U.S.A., GSPANN provides consulting and IT services to global clients. We help clients transform how they deliver business value by helping them optimize their IT capabilities, practices, and operations with our experience in retail, high-technology, and manufacturing. With five global delivery centers and 1900+ employees, we provide the intimacy of a boutique consultancy with the capabilities of a large IT services firm. Please find the Details below: Job Position (Title) Azure Data Engineers / Leads Experience Required 4 to 10 Yrs Location- Bangalore, Hyderabad, Pune Technical Skill Requirements - Azure, SQL, Pyspark, Python Pls share the below details also along with your profile: Full Name: Email Id: Contact No: Total years of experience - Relevant experience - Bigdata- Cloud- Rating on SQL : Any other Technology- Notice period - CTC- ECTC- Current company- Current location: Preferred location: Any offers, If yes, Pls mention- Interview availability for face to face OR Virtual?-Pls mention

About the Company : Headquartered in California, U.S.A., GSPANN provides consulting and IT services to global clients. We help clients transform how they deliver business value by helping them optimize their IT capabilities, practices, and operations with our experience in retail, high-technology, and manufacturing. With five global delivery centers and 1900+ employees, we provide the intimacy of a boutique consultancy with the capabilities of a large IT services firm. Role: Azure Databricks Engineer Experience: 5 +yrs Skillsets: Azure + Databricks + Unity Catalog + Python+SQL Work Location: Hyderabad/ Pune/Gurgaon/Bangalore Job Description Job Summary: We are seeking a highly skilled Azure Databricks Engineer to join our growing team. In this role, you will be responsible for managing and integrating Databricks services with Azure to build and maintain robust data pipelines. You will play a key role in ensuring our data infrastructure is efficient, scalable, and secure. Responsibilities: Manage Databricks clusters, including provisioning, configuration, and optimization. Manage Databricks users in workspace and services used by them such as notebooks, sql, workflows, mlflow etc. Integrate Azure services like Azure Data Factory, Azure Data Lake Storage, and Azure Synapse Analytics with Databricks for a comprehensive data processing solution. Write high-performance Spark code for data manipulation and analysis. Monitor and troubleshoot Databricks jobs and pipelines for performance and stability. Monitor usage of Databricks workspaces and generate reports. Collaborate with data analysts, data scientists, and software engineers to design and implement data solutions. Stay up-to-date on the latest advancements in Azure and Databricks technologies. Qualifications: Proven experience working with Microsoft Azure and Azure Databricks. Good understanding of data warehousing and data lake concepts. Experience with Apache Spark for large-scale data processing. Proficiency in programming languages like Python (PySpark). Experience with SQL and relational databases. Excellent problem-solving and analytical skills. Strong communication and collaboration skills. Ability to work independently and as part of a team. Benefits: Competitive salary and benefits package. Opportunity to work on challenging and impactful projects. Collaborative and supportive work environment. Continuous learning and development opportunities.

About the Company : Headquartered in California, U.S.A., GSPANN provides consulting and IT services to global clients. We help clients transform how they deliver business value by helping them optimize their IT capabilities, practices, and operations with our experience in retail, high-technology, and manufacturing. With five global delivery centers and 1900+ employees, we provide the intimacy of a boutique consultancy with the capabilities of a large IT services firm. Role: Azure Databricks Engineer Experience: 5 +yrs Skillsets: Azure + Databricks + Unity Catalog + Python+SQL Work Location: Hyderabad/ Pune/Gurgaon/Bangalore Job Description Job Summary: We are seeking a highly skilled Azure Databricks Engineer to join our growing team. In this role, you will be responsible for managing and integrating Databricks services with Azure to build and maintain robust data pipelines. You will play a key role in ensuring our data infrastructure is efficient, scalable, and secure. Responsibilities: Manage Databricks clusters, including provisioning, configuration, and optimization. Manage Databricks users in workspace and services used by them such as notebooks, sql, workflows, mlflow etc. Integrate Azure services like Azure Data Factory, Azure Data Lake Storage, and Azure Synapse Analytics with Databricks for a comprehensive data processing solution. Write high-performance Spark code for data manipulation and analysis. Monitor and troubleshoot Databricks jobs and pipelines for performance and stability. Monitor usage of Databricks workspaces and generate reports. Collaborate with data analysts, data scientists, and software engineers to design and implement data solutions. Stay up-to-date on the latest advancements in Azure and Databricks technologies. Qualifications: Proven experience working with Microsoft Azure and Azure Databricks. Good understanding of data warehousing and data lake concepts. Experience with Apache Spark for large-scale data processing. Proficiency in programming languages like Python (PySpark). Experience with SQL and relational databases. Excellent problem-solving and analytical skills. Strong communication and collaboration skills. Ability to work independently and as part of a team. Benefits: Competitive salary and benefits package. Opportunity to work on challenging and impactful projects. Collaborative and supportive work environment. Continuous learning and development opportunities.

About the Company : Headquartered in California, U.S.A., GSPANN provides consulting and IT services to global clients. We help clients transform how they deliver business value by helping them optimize their IT capabilities, practices, and operations with our experience in retail, high-technology, and manufacturing. With five global delivery centers and 1900+ employees, we provide the intimacy of a boutique consultancy with the capabilities of a large IT services firm. Role: Azure Databricks Engineer Experience: 5 +yrs Skillsets: Azure + Databricks + Unity Catalog + Python+SQL Work Location: Hyderabad/ Pune/Gurgaon/Bangalore Job Description Job Summary: We are seeking a highly skilled Azure Databricks Engineer to join our growing team. In this role, you will be responsible for managing and integrating Databricks services with Azure to build and maintain robust data pipelines. You will play a key role in ensuring our data infrastructure is efficient, scalable, and secure. Responsibilities: Manage Databricks clusters, including provisioning, configuration, and optimization. Manage Databricks users in workspace and services used by them such as notebooks, sql, workflows, mlflow etc. Integrate Azure services like Azure Data Factory, Azure Data Lake Storage, and Azure Synapse Analytics with Databricks for a comprehensive data processing solution. Write high-performance Spark code for data manipulation and analysis. Monitor and troubleshoot Databricks jobs and pipelines for performance and stability. Monitor usage of Databricks workspaces and generate reports. Collaborate with data analysts, data scientists, and software engineers to design and implement data solutions. Stay up-to-date on the latest advancements in Azure and Databricks technologies. Qualifications: Proven experience working with Microsoft Azure and Azure Databricks. Good understanding of data warehousing and data lake concepts. Experience with Apache Spark for large-scale data processing. Proficiency in programming languages like Python (PySpark). Experience with SQL and relational databases. Excellent problem-solving and analytical skills. Strong communication and collaboration skills. Ability to work independently and as part of a team. Benefits: Competitive salary and benefits package. Opportunity to work on challenging and impactful projects. Collaborative and supportive work environment. Continuous learning and development opportunities.

Python Data engineer JD With 3+ years of application development experience with backend technologies Like Python. • Candidate should be able to understand and interpretate business requirements into clearly articulated technology solution. • Experience working with RDBMS database models in Cloud. • Basic knowledge of cloud components like Databrick, ADLS & OAuth/Secrets will be added advantage. • Understanding different DB's like Clickhouse, MS SQL, Postgres, Snowflake will be added advantage. • Experience working with Python Tornado and FastAPI frameworks. • In-depth understanding of RESTful APIs, token authentications, compression. • Good problem-solving skills and Team spirit • Experience with version control and issue tracking systems: Bit Bucket, Git CLI, Jira. • Strong debugging, problem solving and investigative skills. Ability to assimilate disparate information (log files, error messages etc.) and pursue leads to find root cause problems. • Ability to work in an Agile environment at scale. • Excellent verbal and written communication skills • Knowledge of software development lifecycle, DevOps (build, continuous integration, deployment tools) and standard methodologies • Experience in working source control management systems like git, Bitbucket and managing packages using private registries like Jfrog • Understanding of fundamental design principles behind a scalable application

Warm Greetings from SP Staffing Services Private Limited!! We have an urgent opening with our CMMI Level 5 client for the below position. Please send your update profile if you are interested. Relevant Experience: 8 - 24 Yrs Location- Pan India Job Description : - Candidates should have minimum 2 Years hands on experience as Azure databricks Architect If interested please forward your updated resume to sankarspstaffings@gmail.com / Sankar@spstaffing.in With Regards, Sankar G Sr. Executive - IT Recruitment

Warm Greetings from SP Staffing Services Private Limited!! We have an urgent opening with our CMMI Level 5 client for the below position. Please send your update profile if you are interested. Relevant Experience: 8 Yrs - 18 Yrs Location- Pan India Job Description : - Experience in Synapase with pyspark Knowledge of Big Data pipelinesData Engineering Working Knowledge on MSBI stack on Azure Working Knowledge on Azure Data factory Azure Data Lake and Azure Data lake storage Handson in Visualization like PowerBI Implement endend data pipelines using cosmosAzure Data factory Should have good analytical thinking and Problem solving Good communication and coordination skills Able to work as Individual contributor Requirement Analysis CreateMaintain and Enhance Big Data Pipeline Daily status reporting interacting with Leads Version controlADOGIT CICD Marketing Campaign experiences Data Platform Product telemetry Analytical thinking Data Validation of the new streams Data quality check of the new streams Monitoring of data pipeline created in Azure Data factory updating the Tech spec and wiki page for each implementation of pipeline Updating ADO on daily basis If interested please forward your updated resume to sankarspstaffings@gmail.com / Sankar@spstaffing.in With Regards, Sankar G Sr. Executive - IT Recruitment

Warm Greetings from SP Staffing Services Private Limited!! We have an urgent opening with our CMMI Level 5 client for the below position. Please send your update profile if you are interested. Relevant Experience: 8 Yrs - 18 Yrs Location- Pan India Job Description : - Mandatory Skill: Azure ADB with Azure Data Lake Lead the architecture design and implementation of advanced analytics solutions using Azure Databricks Fabric The ideal candidate will have a deep understanding of big data technologies data engineering and cloud computing with a strong focus on Azure Databricks along with Strong SQL Work closely with business stakeholders and other IT teams to understand requirements and deliver effective solutions Oversee the endtoend implementation of data solutions ensuring alignment with business requirements and best practices Lead the development of data pipelines and ETL processes using Azure Databricks PySpark and other relevant tools Integrate Azure Databricks with other Azure services eg Azure Data Lake Azure Synapse Azure Data Factory and onpremise systems Provide technical leadership and mentorship to the data engineering team fostering a culture of continuous learning and improvement Ensure proper documentation of architecture processes and data flows while ensuring compliance with security and governance standards Ensure best practices are followed in terms of code quality data security and scalability Stay updated with the latest developments in Databricks and associated technologies to drive innovation Essential Skills Strong experience with Azure Databricks including cluster management notebook development and Delta Lake Proficiency in big data technologies eg Hadoop Spark and data processing frameworks eg PySpark Deep understanding of Azure services like Azure Data Lake Azure Synapse and Azure Data Factory Experience with ETLELT processes data warehousing and building data lakes Strong SQL skills and familiarity with NoSQL databases Experience with CICD pipelines and version control systems like Git Knowledge of cloud security best practices Soft Skills Excellent communication skills with the ability to explain complex technical concepts to nontechnical stakeholders Strong problemsolving skills and a proactive approach to identifying and resolving issues Leadership skills with the ability to manage and mentor a team of data engineers Experience Demonstrated expertise of 8 years in developing data ingestion and transformation pipelines using DatabricksSynapse notebooks and Azure Data Factory Solid understanding and handson experience with Delta tables Delta Lake and Azure Data Lake Storage Gen2 Experience in efficiently using Auto Loader and Delta Live tables for seamless data ingestion and transformation Proficiency in building and optimizing query layers using Databricks SQL Demonstrated experience integrating Databricks with Azure Synapse ADLS Gen2 and Power BI for endtoend analytics solutions Prior experience in developing optimizing and deploying Power BI reports Familiarity with modern CICD practices especially in the context of Databricks and cloudnative solutions If interested please forward your updated resume to sankarspstaffings@gmail.com / Sankar@spstaffing.in With Regards, Sankar G Sr. Executive - IT Recruitment

Warm Greetings from SP Staffing Services Private Limited!! We have an urgent opening with our CMMI Level 5 client for the below position. Please send your update profile if you are interested. Relevant Experience: 11 - 20 Yrs Location- Pan India Job Description : - Minimum 2 Years hands on experience in Solution Architect ( AWS Databricks ) If interested please forward your updated resume to sankarspstaffings@gmail.com With Regards, Sankar G Sr. Executive - IT Recruitment