4854 Azure Databricks Jobs - Page 20

Job description Hiring for Azure Databrick Engineer Mandatory Skills: Databrick, Data lake, Azure Responsibilities A day in the life of an Infoscion As part of the Infosys consulting team, your primary role would be to actively aid the consulting team in different phases of the project including problem definition, effort estimation, diagnosis, solution generation and design and deployment You will explore the alternatives to the recommended solutions based on research that includes literature surveys, information available in public domains, vendor evaluation information, etc. and build POCs You will create requirement specifications from the business needs, define the to-be-processes and d...

TCS Inviting Application for Azure Data Engineer Location - Bangalore Experience - 4 to 10 yrs Assure that data is cleansed, mapped, transformed, and otherwise optimised for storage and use according to business and technical requirements Develop and maintain innovative Azure solutions Solution design using Microsoft Azure services and other tools The ability to automate tasks and deploy production standard code (with unit testing, continuous integration, versioning etc.) Load transformed data into storage and reporting structures in destinations including data warehouse, high speed indexes, real-time reporting systems and analytics applications Build data pipelines to collectively bring tog...

Azure Data engineer Data Bricks Pyspark Azure data factory

As an AI Architect at our company, your role involves implementing architecture and design from the definition phase to the go-live phase. You will collaborate with business analysts and subject matter experts (SMEs) to comprehend current landscape priorities and define conceptual and low-level models using AI technology. Your responsibilities will include reviewing designs to ensure alignment with architecture, hands-on development of AI-led solutions, and implementing the entire data pipeline involving data crawling, ETL processes, creating Fact Tables, and data quality management. Additionally, you will integrate with multiple systems using APIs, web services, or data exchange mechanisms....

Role Overview: As an Azure Data Architect at Hitachi Solutions, you will be responsible for designing and implementing end-to-end data solutions on Microsoft Azure. Your role will involve developing scalable and efficient data architectures to support large-scale data processing and analytics workloads. You will work closely with business and technical teams to understand data needs and translate them into robust, scalable data architecture solutions. Additionally, you will provide expertise and leadership to the development team implementing data engineering solutions and collaborate with stakeholders to ensure data architectures align with business goals. Key Responsibilities: - Design and...

As a Data Engineer at this company based in Pune (Hybrid), your primary roles and responsibilities will include: - Developing Modern Data Warehouse solutions using Databricks and Azure Stack - Providing solutions that are forward-thinking in the data engineering and analytics space - Collaborating with DW/BI leads to understand new ETL pipeline development requirements - Triaging issues to identify gaps in existing pipelines and resolving them - Working with the business to understand the reporting layer needs and developing data models to fulfill reporting requirements - Assisting team members in resolving issues and technical challenges - Driving technical discussions with client architect...

As an Architect II at Insight, you will play a crucial role in leading Business Intelligence (BI) and Data Warehousing (DW) initiatives. Your responsibilities will include designing and implementing end-to-end data pipelines using modern cloud services and frameworks, collaborating with stakeholders and ETL/BI developers, and ensuring scalable, secure data architectures that align with business requirements and regulatory compliance. Here is what you can expect in this role: **Role Overview:** You will be responsible for architecting and implementing end-to-end data pipelines, data lakes, and warehouses using modern cloud services and architectural patterns. Your role will involve developing...

As a Data Engineer at CDM Smith, you will be part of the Data Technology group within the Digital Engineering Solutions team. Your role will involve driving strategic Architecture, Engineering, and Construction (AEC) initiatives by utilizing cutting-edge data technologies and analytics to deliver actionable business insights and robust solutions for AEC professionals and client outcomes. The Data Technology group will lead the firm in AEC-focused Business Intelligence and data services, providing architectural guidance, technological vision, and solution development. You will play a key role in utilizing advanced analytics, data science, and AI/ML to give the business a competitive advantage...

Role Overview: As a Data Engineer Grade 5 at our company in Hyderabad, TL, you will be responsible for building solutions against delta lakes and relational databases. Your main focus will be working on Azure Databricks, writing code in Python and SQL with PySpark. Your tasks will include analysis, design, implementation, and testing of solutions. We highly value automated testing to ensure quality deliverables. One of your key responsibilities will be extending the functionality of the consistency check engine for sub-ledger data and other tenants. Given the significant data volume you will be dealing with, you will also be required to optimize Spark performance deeply. Key Responsibilities...

You will be joining as an Engineer (Azure) at ArcelorMittal, a leading global steel and mining company committed to building a better world with smarter low-carbon steel. Your role will involve contributing to the development, optimization, and support of the cloud data platform and reporting infrastructure. **Key Responsibilities:** - Developing on a wide range of technologies related to Datalakes - Working with SQL, SYNAPSE, Databricks, and Fabric for development - Utilizing DEVOPS, Visual Studio, TFS, and GIT for tools - Handling SQL Server databases - Following Agile (SCRUM) methodologies - Working with SAP BW / SAC, Power BI / Tableau **Qualifications Required:** - Minimum 2-4 years of ...

Must-Have Skills: Hands-on experience with Azure Machine Learning, Azure Data Factory, and Azure Databricks Proficiency in Python or R for data analysis and model development Strong understanding of machine learning algorithms and statistical techniques Experience in designing, developing, and deploying machine learning models and data science solutions on Azure Data integration and processing using Azure tools Excellent problem-solving and communication skills For Manager: Demonstrated experience in managing and mentoring teams, project management, and stakeholder engagement Preferred Skills: Experience with Azure Synapse Analytics and Power BI Familiarity with deploying models using Azure ...

We are looking for Big Data lead with Databricks, Pyspark, SQL & Data Factory Exp: 6 to 12 years Job Locations: Chennai, Bangalore, & Pune Required: Immediate / Dec month joiners only interested candidates please share your profiles to manojkumark2@hexaware.com

Role & responsibilities Relevant experience in Pyspark and Azure Databricks. • Proficiency in integrating, transforming, and consolidating data from various structured and unstructured data sources. Good experience in SQL or native SQL query languages. Strong experience in implementing Databricks notebooks using Python. Good experience in Azure Data Factory, ADLS, Storage Services, Serverless architecture, Azure functions. Advanced working knowledge in building robust data pipelines using ADF Experience in building processes supporting data transformation, data structures, metadata, dependency and workload management. • Exposure to any cloud based Datawarehouse like Snowflake. Exposure to ba...

Role Overview: You will be joining a team that has laid the foundation for a robust DevOps practice to support an Azure-based data platform. Your mission will be to make deployments faster, more reliable, and less dependent on manual work so that developers can focus on building. As a hands-on DevOps Engineer, you will work independently and take ownership of end-to-end topics. Key Responsibilities: - Design and implement GitHub actions workflow for various Azure solutions including Azure databricks, DB solutions, Azure functions, App Services, REST API Solutions (APIOps), Power BI Solutions, and AI/ML Solutions (MLOps). - Define Pull Request flow, including Pull Request, Review, Merging, Bu...

Role Overview: YASH Technologies is looking to hire a Data Analytics Lead with 8+ years of experience to join their team in Gurgaon, IN. As a part of their dynamic team, you will be responsible for building, managing, and fostering a high-functioning team of data engineers and analysts. You will collaborate with business and technical teams to capture and prioritize platform ingestion requirements and lead the data analytics team members to ensure their professional growth and success. Additionally, you will be accountable for managing customer, partner, and internal data on the cloud and on-premises, evaluating current data technologies, and promoting a culture of learning. Key Responsibili...

As a Data Engineer working with multiple teams, you will be responsible for delivering solutions on the Azure Cloud using core cloud data warehouse tools such as Azure Data Factory, Azure Databricks, Azure SQL DW, and other Big Data related technologies. Your role involves building the next generation of application data platforms and improving recent implementations. You must analyze data and develop strategies for populating data lakes. Complex coding using U-SQL, Scala or Python, and T-SQL may be required. **Key Responsibilities:** - Work as part of a team to develop Cloud Data and Analytics solutions - Participate in the development of cloud data warehouses, data as a service, and busine...

As an Associate Manager - AIOps & MLOps Operations, your role will involve supporting and enhancing the automation, scalability, and reliability of AI/ML operations across the enterprise. You will need to have a solid understanding of AI-driven observability, machine learning pipeline automation, cloud-based AI/ML platforms, and operational excellence. Your responsibilities will include: - Support and maintain AIOps and MLOps programs, ensuring alignment with business objectives, data governance standards, and enterprise data strategy. - Assist in implementing real-time data observability, monitoring, and automation frameworks to enhance data reliability, quality, and operational efficiency....

Role Overview: As a Leader for the India based team, you will be responsible for managing and growing a small multidisciplinary team specializing in Geospatial Analytics, Geographic Information Systems (GIS), and Data Engineering. Your role will involve acting as the primary interface between stakeholders in the UK and the team in India. The ideal candidate should have a strong understanding of data and analytics, with expertise in at least one of the key areas - Geospatial Analytics, GIS, or Data Engineering. Reporting to the Head of Planning, Property and Advisory, you will provide strategic direction, technical leadership, and ensure project outcomes align with business objectives. Key Re...

As a Supply Chain Analytics Specialist at Axalta, you will be responsible for driving data-driven decision-making in supply chain operations. Your expertise in SQL, Power BI, and strong analytical mindset will be crucial in optimizing supply chain processes and improving operational efficiencies. **Key Responsibilities:** - Design and develop Power BI dashboards to provide real-time insights into supply chain performance, demand forecasting, and inventory management. - Well versed with DAX queries and M-queries. - Able to utilize SQL wherever it is required. - Collaborate with cross-functional teams (procurement, logistics, and finance) to understand business requirements and implement analy...

Required Skills & Experience Minimum 6 years of hands-on experience with Azure data services (Data Factory, Databricks, ADLS, SQL DB, etc .). - 2-3 years of architecture experience: Designing and optimizing data sources, application ingestion, datalake hosting. Python and Pysparks Bachelors degree in Computer Science, Computer Engineering, or a STEM discipline (Science, Technology, Engineering, Math). • Strong working knowledge of Databricks and Azure Data Factory (ADF). Expertise in databases and SQL. Familiarity with Agile delivery methodologies. Ability to multi-task and reprioritize in a dynamic environment. Excellent written and verbal communication skills. Nice to Have Skills & Experie...

TCS is hiring... Role: Azure Data Modeler and Architect EXP: 8 - 12 YEARS LOCATION: Kolkata Job Description We are seeking a highly experienced and visionary Azure Data Modeler and Architect for designing, implementing, and maintaining data models that support our business objectives and to design, implement, and manage robust, scalable, and secure data solutions on the Microsoft Azure platform. Lead the design and development of end-to-end data solutions on Microsoft Azure, including data ingestion, storage, processing, and consumption layers. Define and enforce data architecture principles, standards, and best practices across the organization. Develop and maintain the enterprise data road...

Job description Hiring for Azure Databrick Engineer Mandatory Skills: Databrick, Data lake, Azure Responsibilities A day in the life of an Infoscion As part of the Infosys consulting team, your primary role would be to actively aid the consulting team in different phases of the project including problem definition, effort estimation, diagnosis, solution generation and design and deployment You will explore the alternatives to the recommended solutions based on research that includes literature surveys, information available in public domains, vendor evaluation information, etc. and build POCs You will create requirement specifications from the business needs, define the to-be-processes and d...

Job Title: Azure Data Engineer Job Summary: We're seeking a skilled Azure Data Engineer to join our team, leveraging expertise in Databricks, Data Factory, and SQL to design and implement data solutions. Key Responsibilities: - Design and implement data pipelines using Azure Data Factory and Databricks - Develop and maintain data architectures on Azure - Analyze data using SQL and Databricks to inform business decisions - Collaborate with cross-functional teams to understand business requirements - Optimize data solutions for performance, scalability, and cost-effectiveness Requirements: - Strong knowledge of Azure data services (e.g., Data Factory, Databricks, Synapse) - Proficiency in SQL ...

Job Title: Azure Data Engineer Job Summary: We're seeking a skilled Azure Data Engineer to join our team, leveraging expertise in Databricks, Data Factory, and SQL to design and implement data solutions. Key Responsibilities: - Design and implement data pipelines using Azure Data Factory and Databricks - Develop and maintain data architectures on Azure - Analyze data using SQL and Databricks to inform business decisions - Collaborate with cross-functional teams to understand business requirements - Optimize data solutions for performance, scalability, and cost-effectiveness Requirements: - Strong knowledge of Azure data services (e.g., Data Factory, Databricks, Synapse) - Proficiency in SQL ...

Job Title: Azure Data Engineer Job Summary: We're seeking a skilled Azure Data Engineer to join our team, leveraging expertise in Databricks, Data Factory, and SQL to design and implement data solutions. Key Responsibilities: - Design and implement data pipelines using Azure Data Factory and Databricks - Develop and maintain data architectures on Azure - Analyze data using SQL and Databricks to inform business decisions - Collaborate with cross-functional teams to understand business requirements - Optimize data solutions for performance, scalability, and cost-effectiveness Requirements: - Strong knowledge of Azure data services (e.g., Data Factory, Databricks, Synapse) - Proficiency in SQL ...