3649 Azure Databricks Jobs - Page 22

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Data Engineering, Data Science, Microsoft Azure Databricks, Datasphere and knowledgeable in system integration Good to have skills : Peoplesoft Campus BA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will design, build, and configure applications to meet business process and application requirements. A typical day involves collaborating with team members to understand project needs, developing application ...

Job Title: Data Scientist Experience: 7+years Location: Remote Work Timings: USA/ET Job Description Build and maintain data pipelines using Azure Data Factory, Synapse, or Databricks. Ensure data quality, transformation, and ingestion from various sources. Optimize data storage (e.g., Azure Data Lake, Blob Storage). Collaborate with ML Engineers and Solution Architects to deploy models into production environments . Design automated retraining and monitoring pipelines to track model drift and accuracy. Ensure reproducibility of experiments and maintain version control of models and datasets. Ingest, explore, and preprocess structured and unstructured data using: Azure Data Lake Storage Azure...

Key Skills: Azure, Data modeling, Python, ETL, Data Engineering, Microsoft fabric, Azure Databricks Roles and Responsibilities: Design, develop, and optimize ETL/ELT processes using SQL Server, Azure Data Factory, or equivalent tools. Build and maintain data pipelines supporting real-time and batch processing. Implement data transformations, cleansing, and quality checks to ensure integrity. Integrate on-premises data sources with cloud solutions (Azure/AWS). Manage and maintain data lakes, lakehouses, and warehouses in cloud environments. Ensure data availability, lineage, and performance across platforms. Collaborate with stakeholders to translate business requirements into technical data ...

Greetings from TCS !!! TCS presents an excellent opportunity for Pyspark Developers Experience (Yrs) : 6-12 years Location: Chennai/Bangalore Mode of interview : Virtual Key Responsibilities: Develop, optimize, and maintain big data pipelines using PySpark on distributed computing platforms. Design and implement ETL workflows for ingesting, processing, and transforming large datasets in Hive . Work with structured and unstructured data sources to ensure efficient data storage and retrieval. Optimize Hive queries and Spark jobs for performance, scalability, and cost efficiency. Implement best practices for data engineering, including data governance, security, and compliance. Monitor, trouble...

Azure Data Factory: - Develop Azure Data Factory Objects - ADF pipeline, configuration, parameters, variables, Integration services runtime - Hands-on knowledge of ADF activities(such as Copy, SP, lkp etc) and DataFlows - ADF data Ingestion and Integration with other services Azure Databricks: - Experience in Big Data components such as Kafka, Spark SQL, Dataframes, HIVE DB etc implemented using Azure Data Bricks would be preferred. - Azure Databricks integration with other services - Read and write data in Azure Databricks - Best practices in Azure Databricks Synapse Analytics: - Import data into Azure Synapse Analytics with and without using PolyBase - Implement a Data Warehouse with Azure...

Responsibilities: Collaborate with cross-functional teams on project delivery. Design, develop & maintain large-scale data pipelines using Azure Databricks, python, PySpark & SQL.

Azure Data Factory: - Develop Azure Data Factory Objects - ADF pipeline, configuration, parameters, variables, Integration services runtime - Hands-on knowledge of ADF activities(such as Copy, SP, lkp etc) and DataFlows - ADF data Ingestion and Integration with other services Azure Databricks: - Experience in Big Data components such as Kafka, Spark SQL, Dataframes, HIVE DB etc implemented using Azure Data Bricks would be preferred. - Azure Databricks integration with other services - Read and write data in Azure Databricks - Best practices in Azure Databricks Synapse Analytics: - Import data into Azure Synapse Analytics with and without using PolyBase - Implement a Data Warehouse with Azure...

Job Title: Azure Data Engineer with Snowflake Experience: 8+ Years Location: Remote Job Type: Fulltime /Contract REQUIREMENT: 8+ years of experience in data engineering or related fields. Strong proficiency in SQL Snowflake. Hands-on experience with Snowflake SQL, ADF (Azure Data Factory), Microsoft MDS (Master Data Service). Experience with cloud platforms (Azure). Snowflake Azure -ADF, Microsoft MDS, SQL, Data Pipelines with a focus on developing and maintaining the Data Analytics solutions. Must have excellent English written and verbal communication skills. The ideal candidate should be experienced in data engineering on Snowflake Azure -ADF, Microsoft MDS, SQL, Data Pipelines with a foc...

Project description You will be working in a global team that manages and performs a global technical control.You'll be joining Assets Management team which is looking after asset management data foundation and operates a set of in-house developed tooling.As an IT engineer you'll play an important role in ensuring the development methodology is followed, and lead technical design discussions with the architects. Our culture centers around partnership with our businesses, transparency, accountability and empowerment, and passion for the future. Responsibilities Design, build, and manage data pipelines using Azure Data Integration Services (Azure DataBricks, ADF, Azure Functions.) Collaborate ...

•Exp of unified data platform,Data lifecycle starting from Data Ingestion, Transformation, Serve and consumption. • Must have excellent coding skills in Pyspark,Spark sql. • Must be strong in SQL and sprak-sql. Expin Data Engineering domain. •

At EY, youll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And were counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all. Azure Cognitive Service and AI Developer Required Skills on Azure and Python Azure ServicesStrong knowledge in Azure Web Services, Azure SQL Computer VisionImage analysis, OCR, and facial recognition using Azure APIs. Text AnalyticsSentiment analysis, key phrase extraction, and language detection. Speech ServicesSpeech-to-text, text-to-speech, ...

At EY, youll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And were counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all. Manager - MSM (Microsoft Sustainability Manager) Architect As an Architect on the GDS Consulting team within the Digital Engineering team, your primary responsibility will be to design and implement cutting-edge sustainability solutions for clients on a global scale. Your role involves leveraging your expertise to ensure these solutions align w...

At EY, youll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And were counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all. EY GDS Data and Analytics (D And A) Azure Databricks - Senior Job Summary: We are seeking a skilled Data Engineer with expertise in Databricks and Python scripting to enhance our ETL (Extract, Transform, Load) processes. The ideal candidate will have a proven track record of developing and optimizing data pipelines, implementing data solutions,...

Your key responsibilities Responsible for managing multiple client engagements. Understand and analyse business requirements by working with various stakeholders and create the appropriate information architecture, taxonomy and solution approach Work independently to gather requirements, cleansing extraction and loading of data Translate business and analyst requirements into technical code Create interactive and insightful dashboards and reports using Power BI , connecting to various data sources and implementing DAX calculations. Design and build complete ETL/Azure Data Factory processes moving and transforming data for ODS, Staging, and Data Warehousing Design and development of solutions...

At EY, youll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And were counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all. PositionSenior - Data Engineer Role Description: Leads the delivery of solution or infrastructure development services for a large or more complex project, using advanced technical capabilities Takes accountability for the design, development, delivery and maintenance of solutions or infrastructure, driving compliance with and contributing to t...

Azure Data Factory: - Develop Azure Data Factory Objects - ADF pipeline, configuration, parameters, variables, Integration services runtime - Hands-on knowledge of ADF activities(such as Copy, SP, lkp etc) and DataFlows - ADF data Ingestion and Integration with other services Azure Databricks: - Experience in Big Data components such as Kafka, Spark SQL, Dataframes, HIVE DB etc implemented using Azure Data Bricks would be preferred. - Azure Databricks integration with other services - Read and write data in Azure Databricks - Best practices in Azure Databricks Synapse Analytics: - Import data into Azure Synapse Analytics with and without using PolyBase - Implement a Data Warehouse with Azure...

Description: About The Role :: 1. Should have overall 5+ years of experience. 2. Should haves 2+ years in MS Azur Data Engineer Role. 3. Has implemented MS Azure data pipelines/project. 4. Experience with Azure Databricks(Delta tables Unitycatalog) Azure Data Factory Azure Synapse SQL. 5. Should have experience in python/PySpark SQL. 6. Knowledge on data Azure Bus Service Function App(C#) and GIT. Named Job Posting? (if Yes - needs to be approved by SCSC) Additional Details Global Grade :B Level :To Be Defined Named Job Posting? (if Yes - needs to be approved by SCSC) :No Remote work possibility :No Global Role Family :60242 (P) Data Management Local Role Name :60327 Data Engineer Local Skil...

Description: About The Role :: 1. Should have overall 5+ years of experience. 2. Should haves 2+ years in MS Azur Data Engineer Role. 3. Has implemented MS Azure data pipelines/project. 4. Experience with Azure Databricks(Delta tables Unitycatalog) Azure Data Factory Azure Synapse SQL. 5. Should have experience in python/PySpark SQL. 6. Knowledge on data Azure Bus Service Function App(C#) and GIT. Named Job Posting? (if Yes - needs to be approved by SCSC) Additional Details Global Grade :C Level :To Be Defined Named Job Posting? (if Yes - needs to be approved by SCSC) :No Remote work possibility :No Global Role Family :60242 (P) Data Management Local Role Name :60327 Data Engineer Local Skil...

3+ years of hands on experience with Data warehouse / ETL testing. Strong SQL/PL SQL skills for creating queries to compare data between Source and target, find data anomalies. Analytical approach to identify data mismatch issues. Expertise in various testing like Functional, Manual, Automated, Regression, Black Box, System, Integration and User Acceptance testing (UAT). Ability to perform Data warehouse BI testing using any ETL tool with Bigdata, Azure Databricks as a Database. Experience in Validating Dashboards / Reports tools like Cognos, Tableau and Power BI. Understand the behaviour of complex data warehousing and business intelligence solutions and apply that knowledge towards testing...

We are seeking a highly skilled and experienced Azure Data Engineer to join our data team. The ideal candidate will have over five years of professional experience and possess deep expertise in building, managing, and optimizing scalable data pipelines and solutions within the Microsoft Azure ecosystem. This role requires a strong focus on Databricks , Python , and SQL to deliver high-quality, reliable, and performant data products. Responsibilities Design and Development: Design, development, and implementation of robust and scalable ETL/ELT processes using Azure services and Databricks. Data Platform Expertise: Act as a subject matter expert for Databricks , leveraging its capabilities for...

Description: Responsibilities: Perform testing in Databricks environment which includes :Participating in developing Test frameworks. Participating in testing scripts development, code reviews Partner with the product owner, data engineers, data architects and analysts to create scalable and robust solutions. Prepare the status report of testing activities and share updates with the team during Scrum meeting. Experience using appropriate test management tool like Azure DevOps Competencies / Required Skills: ETL Testing experience of 7+ years Report Testing experience of 2+ years, preferably PowerBI Hands on experience of 3+ years working in Databricks/ADLS environment. Good at Python/Pyspark...

Experienced Azure Data Engineer Tech Lead ( Tech Lead ) with 7 to 10 years of expertise Design, develop, and maintain robust data pipelines using Azure Databricks, Azure Data Factory,Pyspark / Python, Azure Data Lake Gen2, and Azure SQL Database. Integrate and manage data from various source systems, ensuring data quality and consistency. Mandatory Skills :Azure Databrick + Pyspark + Azure Data Facory + SQL +CICD + Strong Coding skills.

Technical Skills:(Primary) Overall, 6 8 yrs experience, with relevant experience on Azure Databricks for 4+ yrs Primary Technologies:Azure Databricks, spark, python Database Technologies:SQL, MS SQL Server, Relational Databases Experience in conducting Code Reviews for offshore team members Strong experience on ETL concepts Areas on Primary Skills Good understanding of databricks as a platform to write and execute notebooks. Should be able to create Databricks workflows and schedule them with dependencies Understands delta table as a concept and versioning to update/delete/merge the existing dataset and for DML operations Good knowledge of Spark framework, its internals and its distributed p...

Description: We are seeking a highly skilled and experienced Azure Platform Engineer to lead the design, implement and maintain azure data platform. The ideal candidate will have a deep understanding of Azure data services such as Azure Databricks, ADF, ADLS Gen2, Azure SQL, Azure Synapse, Azure VMs, Azure App Services, Azure Functions. Youll collaborate with cross-functional teams to ensure the scalability, reliability, and performance of our analytics and data solutions. Must have solid experience in terraform based provisioning, Building automations and reports using Pyspark, Powershell and Python Roles Responsibilities:Experience on Schema, delta/parquet tables on UC, Spark configuration...

Databriks + Pyspark About The Role ::1 Skill:Databriks + Pyspark Exp 5 to 8 yr Location Any PSL , Bangalore, Delhi, Pune , Chennai Dont look for Hyderabad Location Azure Data bricks,PySpark,Oracle PL SQL,ETL,SQL,Data Integration Data Engineer - Data AnalystSummaryStrategically manages and maintains corporate global clinical data for all major business units, while ensuring data quality and integrity. Provides system support, testing, and training for applications accessing clinical data.Proven 2-5 years work experience as a Data Analyst in Clinical data Identifies, investigates, and resolves data quality issues, communicating with business units and IT and performing root cause analysis as n...