4854 Azure Databricks Jobs - Page 34

We are seeking a highly skilled and experienced Senior Data Engineer (Azure+DBT) with strong expertise in Streaming Data and Big Data Technologies . The ideal candidate will have hands-on experience in architecting and implementing scalable data solutions using modern cloud-native tools and frameworks. Strong expertise in: Azure Cloud Services o Databricks (including workflows and notebooks) PySpark and Python o SQL (complex queries, performance tuning) Azure Data Factory (ADF) DBT (Data Build Tool) o ServiceNow (incident and change management) Experience in reverse engineering and legacy system modernization is a plus. Excellent problem-solving and communication skills.

As a Solution Architect for Generative AI at Siemens Healthineers (SHS), your role will involve designing, building, and operating AI services. You will be responsible for developing and maintaining artificial intelligence systems and applications that address complex business challenges. Your expertise in machine learning, deep learning, natural language processing, computer vision, and other AI technologies will be essential for the success of this role. Key Responsibilities: - Design, develop, and deploy Azure-based AI solutions, including machine learning models, cognitive services, and data analytics solutions. - Collaborate with cross-functional teams to design and implement AI solutio...

Job Title: Azure Databricks Architect Job Description We are hiring an experienced Databricks Architect to lead the end-to-end architecture, design, and implementation of scalable data lakehouse platforms. The ideal candidate will have strong experience in Databricks, Delta Lake, Unity Catalog, and large-scale data engineering frameworks. Key Responsibilities: Lead architecture, design, and delivery of Databricks-based data lakehouse solutions. Define & enforce best practices for ingestion, ETL/ELT, transformations, governance & analytics. Manage deployment, scaling, configuration & cost optimization across Azure/AWS/GCP. Architect streaming & batch pipelines for enterprise-scale processing....

Skills: Cloudera, Big Data, Hadoop, SPARK, Kafka, Hive, CDH Clusters Design and implement Cloudera-based data platforms, including cluster sizing, configuration, and optimization. Install, configure, and administer Cloudera Manager and CDP clusters, managing all aspects of the cluster lifecycle. Monitor and troubleshoot platform performance, identifying and resolving issues promptly. Review the maintain the data ingestion and processing pipelines on the Cloudera platform. Collaborate with data engineers and data scientists to design and optimize data models, ensuring efficient data storage and retrieval. Implement and enforce security measures for the Cloudera platform, including authenticat...

Role & responsibilities Mandatory Skill Experience in developing MLOps framework cutting ML lifecycle: model development, training, evaluation, deployment, monitoring including Model Governance Expert in Azure Databricks, Azure ML, Unity Catalog Hands-on experience with Azure DevOps, MLOPS CI/CD Pipelines, Python, Git, Docker Experience in developing standards and practices for MLOPS life cycle Nice to Have Skill Strong understanding of data privacy, compliance, and responsible Al Azure Data Factory (ADF) Soft Skill Excellent communication & stakeholder management skills Experience working in cross-functional teams (data scientists, platform architects) Preferred candidate profile MLOPS Seni...

Salary: 15 to 25 LPA Exp: 4 to 7 years Location: Gurgaon/Pune/Bengalore Notice: Immediate to 30 days..!! Job Profile: Experienced Data Engineer with a strong foundation in designing, building, and maintaining scalable data pipelines and architectures. Skilled in transforming raw data into clean, structured formats for analytics and business intelligence. Proficient in modern data tools and technologies such as SQL, T-SQL, Python, Databricks, and cloud platforms (Azure). Adept at data wrangling, modeling, ETL/ELT development, and ensuring data quality, integrity, and security. Collaborative team player with a track record of enabling data-driven decision-making across business units. As a Dat...

Responsible for the design, implementation, and optimization of data solutions as an expert Azure Data Engineer with 4-6 years of experience. Proficiency in programming languages like Python, SQL, or Scala for data manipulation, transformation, and analysis Expertise in data modelling, data warehousing, and data integration concepts. Sound knowledge of data governance practices, data quality management, and data security principles. Develop efficient ETL pipelines using Azure Data Factory and ensure data quality and storage via Azure Data Lake . Utilize your proficiency in complex stored procedures within Azure Databricks to enable advanced analytics on data volumes exceeding 50TB. Collabora...

Educational Requirements MCA,MSc,MTech,Bachelor of Engineering,BCA,BSc Service Line Data & Analytics Unit Responsibilities A day in the life of an Infoscion • As part of the Infosys delivery team, your primary role would be to ensure effective Design, Development, Validation and Support activities, to assure that our clients are satisfied with the high levels of service in the technology domain. • You will gather the requirements and specifications to understand the client requirements in a detailed manner and translate the same into system requirements. • You will play a key role in the overall estimation of work requirements to provide the right information on project estimations to Techno...

Job description Hiring for Azure Databrick Engineer Mandatory Skills: Databrick, Data lake, Azure Responsibilities A day in the life of an Infoscion As part of the Infosys consulting team, your primary role would be to actively aid the consulting team in different phases of the project including problem definition, effort estimation, diagnosis, solution generation and design and deployment You will explore the alternatives to the recommended solutions based on research that includes literature surveys, information available in public domains, vendor evaluation information, etc. and build POCs You will create requirement specifications from the business needs, define the to-be-processes and d...

Interested candidate please share your resume at - oiendrilaguha@kpmg.com Job Description: Typically: Manages one or more data engineering projects of moderate complexity. Leads or acts as key team member in defining and builds the data pipelines that will enable faster, better, data-informed decision-making within the business. Jointly designs and implements a big new data solution which supports high amounts and velocity of data and supports future growth. Identifies latest development, testing and deployment techniques to quickly deploy new releases to e.g., deploy new data pipelines and add data sources. Influences stakeholders in adopting analyses / outcomes. Plays a prominent role in p...

MLOps Engineer" OR "ML Engineer Skill: MLOPS+ Databricks/Snowfalks Location: PAN India Grade: P2/P3/P4/P5 Exp- 3-5/5-8/8-12/12-15yrs JD: Roles and Responsibilities: As an ML Engineering Specialist you will be owning responsibility to operationalize ML models NLP Computer Vision and other type of models End to End model lifecycle management starting from feature extraction to monitor machine learning models using high end tools and technologies Design implementation of DevOps principles in Machine Learning Model quality assurance governance and monitoring Integrate models as part of business applications via APIs Execute best practices in version control and continuous integration delivery Co...

Job Title : Senior Azure Data Engineer Shift Timings : 1 PM - 10 PM Location : Jaipur, India , Work from Home Experience Required : 8 - 13 Years Job Summary: We are seeking a highly skilled and experienced Senior Azure Data Engineer to join our team. The ideal candidate will have deep expertise in Microsoft Azure data services, cloud-based data engineering solutions and modern reporting tools. This role involves leading technical projects, designing scalable data architectures, and delivering actionable insights through BI tools using modern data Lakehouse/warehouse architecture. Ideal candidate should have strong experience with data modelling , ETL/ELT pipeline, and performance tuning. Nee...

Lead the design and implementation of advanced data solutions on Databricks. Architect scalable, secure, and efficient data platforms using Spark, Python, and SQL. Optimize ETL processes and data workflows for performance and reliability. Collaborate with data engineers, data scientists, and business stakeholders to understand requirements and deliver robust solutions. Set up and manage CI/CD pipelines and enforce data governance standards. Monitor and troubleshoot data pipelines to ensure data quality and integrity. Mentor junior team members and foster a culture of continuous learning. Stay updated with emerging technologies and promote innovation in data practices.

SUMMARY W issen Technology is Hiring for Lead Data Engineer About Wissen Technology: At Wissen Technology, we deliver niche, custom-built products that solve complex business challenges across industries worldwide. Founded in 2015, our core philosophy is built around a strong product engineering mindset ensuring every solution is architected and delivered right the first time. Today, Wissen Technology has a global footprint with 2000+ employees across offices in the US, UK, UAE, India, and Australia . Our commitment to excellence translates into delivering 2X impact compared to traditional service providers. How do we achieve this? Through a combination of deep domain knowledge, cutting-edge...

Roles and Responsibilities Location - Bangalore/Hyderabad/Noida Exp - 5 - 12 years Design, develop, and maintain large-scale data pipelines using Azure Data Factory (ADF) to extract, transform, and load data from various sources into Azure storage solutions such as Blob Storage, File Share, and SQL Database. Collaborate with cross-functional teams to understand business requirements and design scalable data architectures that meet those needs. Develop complex SQL queries to optimize database performance and troubleshoot issues in Microsoft Azure environments. Implement data bricks solutions using Azure Databricks for big data processing tasks. Interested candidates can share profiles to mary...

As a professional services firm affiliated with KPMG International Limited, KPMG in India has been operating since August 1993. Leveraging the global network of firms, our professionals are well-versed in local laws, regulations, markets, and competition. With offices in multiple cities across India including Ahmedabad, Bengaluru, Chandigarh, Chennai, Gurugram, Hyderabad, Jaipur, Kochi, Kolkata, Mumbai, Noida, Pune, Vadodara, and Vijayawada, we aim to offer rapid, performance-based, industry-focused, and technology-enabled services to national and international clients. Our services are designed to showcase our shared knowledge of global and local industries and our understanding of the Indi...

As an Audit and Assurance professional at PwC, your focus will be on providing independent and objective assessments of financial statements, internal controls, and other assurable information. You will enhance the credibility and reliability of information for various stakeholders by evaluating compliance with regulations, including assessing governance and risk management processes and related controls. Your role will also involve working in data, analytics, and technology solutions to assist clients in developing solutions that build trust, drive improvement, and detect, monitor, and predict risks. You will utilize advanced analytics, data wrangling technology, and automation tools to lev...

Role Overview: As a member of the team at Capgemini, you will play a crucial role in designing, developing, and maintaining data pipelines using Azure Data Factory, Azure Databricks, and Azure Synapse. You will need to have a strong proficiency in Microsoft Fabric and related technologies, along with an understanding of Data Governance principles and practices. Your responsibilities will include implementing ETL solutions to integrate data from various sources into Azure Data Lake and Data Warehouse, as well as hands-on experience with SQL, Python, and PySpark for data processing. Additionally, you will be expected to showcase your expertise in building Power BI dashboards and reports, with ...

As a Cloud Data Engineer at ECI, you will have the opportunity to work with an industry leader in managed services, cybersecurity, and business transformation for mid-market financial services organizations globally. Your role will involve supporting various client systems, ensuring customer satisfaction through excellent communication skills and a positive attitude. You will be part of a team that values passion for technology and empowers employees worldwide. **Role Overview:** As a senior cloud data engineer with over 7 years of experience, your responsibilities will include: - Utilizing Azure data services such as Azure Data Factory, Azure Synapse Analytics, Azure SQL Database, Azure Dat...

We are seeking a highly skilled and experienced Senior Data Engineer (Azure+DBT) with strong expertise in Streaming Data and Big Data Technologies . The ideal candidate will have hands-on experience in architecting and implementing scalable data solutions using modern cloud-native tools and frameworks. Strong expertise in: Azure Cloud Services o Databricks (including workflows and notebooks) PySpark and Python o SQL (complex queries, performance tuning) Azure Data Factory (ADF) DBT (Data Build Tool) o ServiceNow (incident and change management) Experience in reverse engineering and legacy system modernization is a plus. Excellent problem-solving and communication skills.

Role Overview: We are seeking street-smart and technically strong Data Engineers who can take ownership of designing and developing cutting edge data and AI platforms using Azure-native technologies and Databricks. You will play a critical role in building scalable data pipelines, modern data architectures, and intelligent analytics solutions. Key Responsibilities: Design and implement scalable, metadata-driven frameworks for data ingestion, quality, and transformation across both batch and streaming datasets. Develop and optimize end-to-end data pipelines to process structured and unstructured data, enabling the creation of analytical data products. Build robust exception handling, logging,...

Company overview: At Leapwork, our vision is to break down the barriers between humans and computers through the worlds most accessible automation platform. We are the leading global AI-powered visual test automation solution, enabling some of the world’s largest enterprises to adopt, scale, andmaintainautomation–inunder30 days. In today’s environment, where efficiency, automation, and cost optimization are essential to enterprise growth, we are uniquely positioned to deliver impact. In 2023, Microsoft, the world’s largest and most recognizable software company, recognised Leapwork as a truly innovative and disruptive product, leading to a strategic partnership that continues to be a major g...

Contract Duration : 4 Months +Exendible based on Performance Job Timings : India Evening Shift (till 11 : 30 PM IST) Job Description : We are seeking a skilled Databricks Developer to join our team on a 4-month contract basis. The ideal candidate will have strong expertise in modern data engineering technologies and the ability to work in a fast-paced, remote environment. Key Responsibilities : - Develop, optimize, and manage large-scale data pipelines using Databricks, PySpark, DBT, and AWS S3/Glue/Redshift. - Work in multi-cloud environments including AWS, Azure, and GCP. - Implement workflow orchestration using Airflow or similar frameworks. - Design, implement, and manage data warehouse ...

Contract Duration : 4 Months (Extendable based on Performance) Job Timings : India Evening Shift (till 11 : 30 PM IST) Job Description : We are looking for an experienced Databricks Tech Lead to join our team on a 4-month extendable contract. The ideal candidate will bring deep expertise in data engineering, big data platforms, and cloud-based data warehouse solutions, with the ability to work in a fast-paced remote environment. Key Responsibilities : - Lead the design, optimization, and management of large-scale data pipelines using Databricks, Spark (PySpark), and AWS data services. - Productionize and deploy Big Data platforms and applications across multi-cloud environments (AWS, Azure, ...

Contract Duration : 4 Months +Exendible based on Performance Job Timings : India Evening Shift (till 11 : 30 PM IST) Job Description : We are seeking a skilled Databricks Developer to join our team on a 4-month contract basis. The ideal candidate will have strong expertise in modern data engineering technologies and the ability to work in a fast-paced, remote environment. Key Responsibilities : - Develop, optimize, and manage large-scale data pipelines using Databricks, PySpark, DBT, and AWS S3/Glue/Redshift. - Work in multi-cloud environments including AWS, Azure, and GCP. - Implement workflow orchestration using Airflow or similar frameworks. - Design, implement, and manage data warehouse ...