3649 Azure Databricks Jobs - Page 7

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : Microsoft Azure Databricks Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve cre...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : Microsoft Azure Databricks Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creat...

About The Role Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : Python (Programming Language) Good to have skills : Microsoft Azure Active Directory, Microsoft Azure Databricks Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact. Your typical day will involve collaborating with various teams to ensure that application development aligns with organizational goals, managing pro...

Key Responsibilities: The ideal candidate will have strong expertise in Snowflake, Hadoop ecosystem, PySpark, and SQL, and will play a key role in enabling data-driven decision-making across the organization. Design, develop, and optimize robust data pipelines using PySpark and SQL. • Implement and manage data warehousing solutions using Snowflake. Work with large-scale data processing frameworks within the Hadoop ecosystem. Collaborate with data scientists, analysts, and business stakeholders to understand data requirements. Ensure data quality, integrity, and governance across all data platforms. Monitor and troubleshoot data pipeline performance and reliability. Automate data workflows an...

Greetings from HR Central!!! We do have an Urgent Opening for Azure Data Engineer for One of the Leading Product based MNC for Pune Location for Hybrid Mode: Job Description: Data Engineer (Azure Suite + SQL) Job Title: Data Engineer Department: IT / Data & Analytics Reports To: Data Analytics Manager Summary The Data Engineer is responsible for designing, building, and maintaining the data infrastructure that powers reporting, analytics, and decision-making across the organization. This role works extensively with the Microsoft Azure data ecosystem including Azure Data Factory (ADF), Azure SQL Database/Synapse, and Azure Data Lake to ingest, transform, and deliver high-quality, trusted data...

Role: MLOPS Engineer Location: Gurgaon & Pune & Kochi / In-Person Interview (F2F) at 7th Novermber Fulltime Key words -Skillset AWS SageMaker, Azure ML Studio, GCP Vertex AI PySpark, Azure Databricks MLFlow, KubeFlow, AirFlow, Github Actions, AWS CodePipeline Kubernetes, AKS, Terraform, Fast API Responsibilities: Model Deployment, Model Monitoring, Model Retraining Deployment pipeline, Inference pipeline, Monitoring pipeline, Retraining pipeline Drift Detection, Data Drift, Model Drift Experiment Tracking MLOps Architecture REST API publishing Job Responsibilities: Research and implement MLOps tools, frameworks and platforms for our Data Science projects. Work on a backlog of activities to r...

Location Pune , Hinjewadi ( F2F on 8th Nov) Mode of work: 5 Days WFO Work Timings: 12.30 PM to 9.30 PM IST Notice Period Immediate to Any serving. Important points: Relevant experience should be 5 yrs minimum into Databricks. Lead or Team handling experience will be preferred. Candidate should be from Data background in his entire experience. Eg. He can start career with any of the Data skills (SQL/PLSQL/Informatica, Etc.) and should be working in Databricks from past 5 to 6 years minimum. ADB- DE: Primary: Azure, Databricks, Pyspark/Python Secondary: Datawarehouse,, ADF Must Have • 10+ Years of IT experience in Datawarehouse and ETL • Hands-on data experience on Cloud Technologies on Azure,...

Role & responsibilities Azure Data Factory (ADF), Azure Databricks with Python experience Specifically looking for hands-on experience in Databricks Delta Live Tables (DLT), Expectations, Workflows Orchestration are extensively used on ADI Data Engineering side along with PySparK programming and also Unity Catalog feature" Good to know Azure Synapse, snowflake Decent communication skills Able to collaborate with multiple project teams Excellent stakeholder management skills Preferred candidate profile

Job Description: AWS/Azure/SAP ETL Data Modelling Data Integration & Ingestion Data Manipulation and Processing GITHUB, Action , Azure DevOps Data factory, Databricks, SQL DB, Synapse, Stream Analytics, Glue, Airflow, Kinesis, Redshift, SonarQube, PyTest

3+ years of ETL and data pipeline development (Azure Data Factory, Dell Boomi, Databricks) Data engineering programming languages (SQL, Scala) Databases and database objects (SQL Server, SQL DDL) Understanding of connectors and data sources (e.g., flat files, web APIs, SFTP, databases) Source control (Git) Familiarity with cloud frameworks and solutions (Azure Storage, Azure SQL, PaaS) Familiarity with providing data to BI visualization tools (Power BI) Generalist, who can get up-to-speed quickly with new technologies through self-paced learning and online research Analytical thinker with excellent critical thinking and problem-solving skills as well as the ability to adapt to changing prior...

Role & responsibilities Data Engineer 3+ years of ETL and data pipeline development (Azure Data Factory, Dell Boomi, Databricks) Data engineering programming languages (SQL, Scala) Databases and database objects (SQL Server, SQL DDL) Understanding of connectors and data sources (e.g., flat files, web APIs, SFTP, databases) Source control (Git) Familiarity with cloud frameworks and solutions (Azure Storage, Azure SQL, PaaS) Familiarity with providing data to BI visualization tools (Power BI) Generalist, who can get up-to-speed quickly with new technologies through self-paced learning and online research Analytical thinker with excellent critical thinking and problem-solving skills as well as ...

Role & responsibilities Hands on with Databricks Jobs, Scheduling, Orchestration, Workflow, Databricks Rest API integration Delta Lake Architecture and Implementation Hands-on experience in Databricks and Pyspark. Good understanding of Data Engineering concepts Preferred candidate profile Skills: Azure databricks , azure data factory ,azure data lake, Pyspark Perks and benefits

8+ years of relevant IT experience in the BI/DW domain with hands-on experience on the Azure modern data platform . Strong knowledge and experience with the Python programming language Experience using version control systems like Git, bitbucket . Experience in data analysis and transformation using PySpark on Azure Databricks or Apache Spark . Good knowledge of Distributed Processing using Databricks or Apache Spark. Experience in creating data structures optimized for storage and various query patterns. Experience of integrating Unity Data Catalog with the Databricks and registering data assets etc. Understanding of CI/CD pipelines. Knowledge of Agile/Scrum methodologies.

Job Description: Functioning as an Application Support for the new Cloud platform at one of the corporate investment bank. Support the applications hosted on Azure/Databricks and facilitate onboarding of application to the Cloud platform. Provide incident, problem, and event management according to the ITIL framework. Drive the team to fulfil targets regarding problem management, incident management and meet agreed SLA's. Drive incident, request, work driver and alert reduction efforts across an application cluster. Face-off to and develop effective working relationships with internal Data Operations, Development, and Infrastructure teams. Challenge the status quo and work to improve the sup...

Design, develop, and maintain scalable data pipelines using Python and modern data engineering tools. Understanding of banking data models, financial reporting, and regulatory compliance . Integrate data from legacy banking platforms into modern data lakes and warehouses. Collaborate with business analysts, architects, and operations teams to understand core banking workflows and data requirements. Design, build, and maintain scalable and reliable data pipelines using Azure Data Factory, Databricks, Synapse (Azure SQL DW), and Azure Data Lake. Perform data analysis and transformation using PySpark on Azure Databricks or Apache Spark. Design and implement data models optimized for storage and...

Role: Azure Data Engineer Experience: 9-10 Years Relevant Experience in Data Engineer: 6+ Years Notice Period: Immediate Joiners Only Job Location: Pune and Bangalore Technical and professional skills: Must have skills: Data Engineer, pyspark,Azure Data Factory and SQL. We are looking for a flexible, fast learning, technically strong Data Engineer. Expertise is required in the following fields: Bachelors Degree in Computer Science or related field 9-11 years of experience in Cloud Data Engineering. Proficient in Cloud Services Azure Build ETL and data movement solutions. Migrate data from traditional database systems to Cloud environment Strong hands-on experience in handling streaming data ...

Skill - Azure Data Engineer Exp - 4- 10 Location - Bangalore Candidate should be available for face-to-face interview on 8th Nov 25 (Saturday) Role & responsibilities Implement data-driven processes & monitoring related to Inventory Control, Fleet Management & Supply Chain Management or Finance & Accounting Working with Cloud platform to build near real time data movements and data routing. Work closely with customers to implement the Data Platform. Provide optimal and cost-effective solutions to business teams in achieving business objectives. Assist project managers in developing project plans including budgets, timelines, and forecasts. Analyze business performance & develop reports on pe...

Salary: 15 to 25 LPA Exp: 4 to 7 years Location: Gurgaon/Pune/Bengalore Notice: Immediate to 30 days..!! Job Profile: Experienced Data Engineer with a strong foundation in designing, building, and maintaining scalable data pipelines and architectures. Skilled in transforming raw data into clean, structured formats for analytics and business intelligence. Proficient in modern data tools and technologies such as SQL, T-SQL, Python, Databricks, and cloud platforms (Azure). Adept at data wrangling, modeling, ETL/ELT development, and ensuring data quality, integrity, and security. Collaborative team player with a track record of enabling data-driven decision-making across business units. As a Dat...

Required Skills & Qualifications: 6 to 15+ years of experience in Data Engineering. Strong programming skills in Python and SQL. Hands-on experience with PySpark for large-scale data processing. Good working knowledge of Azure Databricks. Experience in designing and optimizing ETL pipelines. Must Have : Databricks Fundamentals Architecture Patterns PySpark/SparkSQL Optimization Data & Dimensional Modelling Cloud Integration DLT Orchestration DQ & Governance (Unity Catalog) Version Management & CI/CD Streaming Data (Nice to have) Interested candiates can share profiles to marygracy.antony@ilink-systems.com || 8056897061 Job Location : Bangalore , Noida, Chennai, Pune, Trichy Notice Period: Im...

Role & responsibilities Key Responsibilities Design and implement robust ETL/ELT pipelines using Azure Data Factory, SSIS, and Databricks. Integrate data from diverse sources including on-premises databases, cloud platforms, APIs, and flat files. Develop and optimize data models for Azure SQL Database, Synapse Analytics, and Data Lake Storage Gen2. Architect scalable and secure data storage solutions using Azure Blob Storage and Data Lake. Tune data workflows and clusters for performance, reliability, and cost-efficiency. Monitor and troubleshoot data pipelines using Azure Monitor and Log Analytics. Work closely with business teams to understand data requirements. Translate business needs in...

AIA-Pune Job Summary Data Engineer 4 to 9 Years Responsibilities Data Engineering design experience (to support with HLD review LLD build out etc.) Azure experience confident in working with Azure Cloud and Data Engineering capabilities ( e.g. ADLS Gen2 Synapse ADF etc.) Advanced SQL experience query writing & optimisation data aggregation stored procedures etc. Experience writing data Pipelines using Python and PySpark. Relational data model / data schema design experience Understanding of DevOps and CI/CD in the context of Data Engineering Familiarity with working in a scrum environment and supporting scrum ceremonies Certifications Required Azure Pyspark Python

Coeo are trusted data management and analytics experts, delivering technology strategy and support for business. The team have deep technical and commercial experience working with Microsoft Data Services to help our clients optimise their costs and maximise the benefits from their investments in these technologies. Coeo has been established for over 15 years and has offices in Reading, UK and Hyderabad, India. We are exclusively focused on Microsoft technologies. Our mission is to "help our clients predict their future" through the better use of data, technology, people, and processes. To do this our business has always focused on:. Data Managed Services. Data Platform Consultancy. Analytic...

Skills: Azure, Data Engineer, python, SQL, ADF, Databrick, Azure Databricks,. Position:Azure Data Engineer. Work Experience:5-8years. Work location:Bangalore/Hyderabad/Pune. Required Skills. Azure, Strong SQL, ADF, Python, PySpark, Databricks. Key Responsibilities. Design and develop data pipelines using Azure services. Collaborate with cross-functional teams to understand data requirements. Optimize and troubleshoot data pipelines for performance and reliability. Implement data security and governance best practices. Stay updated with the latest industry trends and emerging Azure. Show more Show less

Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Microsoft Azure Databricks Good to have skills : Microsoft SQL Server, Microsoft Azure Analytics Services Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary: As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact. You will oversee the development process and ensure successful project delivery. Roles & Responsibilities: - Expected to perform independently and become an SME. - Requir...

Essential Duties and Responsibilities Minimum 3 years of experience working with Azure services Experience with Azure SQL Databases, Azure Data Factory, Azure Synapse, Azure Logic Apps, Azure Service Bus and Storage Accounts/Data Lake Gen 2 3+ years of experience working in an Azure CI/CD environment Deep understanding of ADF parameterization and movement of pipelines from lower to higher environments Experience with Azure Cloud ecosystem Experience in a self-service Business Intelligence environment a plus In-depth knowledge of and proven cloud experience with cloud data management Collaborate and develop credibility and rapport with business stakeholders and data stewardsStrong analytical,...