2404 Azure Databricks Jobs - Page 21

Key Responsibilities: Lead the design end-to-end data engineering solutions across cloud platforms. Develop and oversee robust data pipelines and ETL workflows using Python and Apache Spark. Implement scalable Delta Lake solutions for structured and semi-structured data. Orchestrate complex workflows using Databricks Workflows or Azure Data Factory. Translate business rules, retention metadata, and data governance policies into reusable, modular, and scalable pipeline components. Ensure adherence to data privacy, security, and compliance standards (e.g., GDPR, HIPAA, etc.). Mentor and guide junior data engineers, fostering best practices in coding, testing, and deployment. Collaborate with c...

Primary Responsibilities: Analyze business requirements & functional specifications Be able to determine the impact of changes in current functionality of the system Interaction with diverse Business Partners and Technical Workgroups Be flexible to collaborate with onshore business, during US business hours Be flexible to support project releases, during US business hours Required Qualifications: Undergraduate degree or equivalent experience 3+ years of working experience in Python, Pyspark, Scala 3+ years of experience working on MS Sql Server and NoSQL DBs like Cassandra, etc. Hands-on working experience in Azure Databricks Solid healthcare domain knowledge Exposure to following DevOps met...

JD: a bachelors degree or higher in Computer Science/ Engineering/ Science data engineer with 10+ years of experience, having 4+ experience in Azure cloud native services. Experience in Azure Data Bricks (Scala/Python), ADLS Gen2, Azure SQL Database, SQL/T-SQL, Azure Services like Azure Data Factory Understanding on different monitoring and logging solutions on Azure Good to have experience on Data Visualization Tools like Power BI and Tableau Good to have experience on Azure Streaming, Azure Cosmos DB, Azure Data Explorer (ADX), Azure Stream Analytics, Azure Event Hubs, Event Grids Good to have experience in programming language like Python/Scala/Java Good to have experience in Dev Ops conc...

Locations: Pune, Maharashtra, India Minimum Experience: 5 Maximum Experience: 12 ctc 5-8 -28 lac 8+ 32 Skill Set: Databricks Engineer, Azure Databricks, SQL, Pyspark Skill to Evaluate: Databricks Engineer, Azure Databricks, SQL Experience: 5 to 12 Years Location: Pune, Maharashtra, India Job Description: Job Title: Senior Data Engineer Key Responsibilities: - Design, build, and maintain scalable data pipelines and ETL processes. - Collaborate with data scientists and analysts to understand data needs and provide support for their analytics requirements. - Develop and implement data models, database designs, and data management solutions. - Ensure data quality, integrity, and consistency acro...

Primary Roles And Responsibilities : - Developing Modern Data Warehouse solutions using Databricks and AWS/ Azure Stack - Ability to provide solutions that are forward-thinking in data engineering and analytics space - Collaborate with DW/BI leads to understand new ETL pipeline development requirements. - Triage issues to find gaps in existing pipelines and fix the issues - Work with business to understand the need in reporting layer and develop data model to fulfill reporting needs - Help joiner team members to resolve issues and technical challenges. - Drive technical discussion with client architect and team members - Orchestrate the data pipelines in scheduler via Airflow Skills And Qual...

About The Role Key Responsibilities: Provide expert-level support for Azure Machine Learning, OpenAI, Cognitive Services, Synapse, and Data Factory . Troubleshoot real-time data integration pipelines, model deployments, inference performance, and security configurations. Guide customers in implementing Responsible AI , security governance, and model versioning best practices. Collaborate with engineering teams to resolve service issues and release platform updates. Proactively identify patterns in customer challenges and build reusable diagnostics or automations. Work with cross-functional teams (Product, Engineering, Customer Success) to improve support processes and tooling. Skillset: Stro...

Role Purpose The purpose of this role is to design, test and maintain software programs for operating systems or applications which needs to be deployed at a client end and ensure its meet 100% quality assurance parameters Job Summary We are seeking a highly skilled Data Engineer to join our dynamic team. The ideal candidate will have extensive experience in Data Analysis & analytics using Azure technologies. Will be responsible for designing, developing, and maintaining data pipelines and solutions within the Azure technologies like Azure Databricks, Azure Data Factory, Cloud DB-Azure SQL and ensuring data quality, consistency, and security while collaborating with other teams to meet busin...

ADF (Azure datafactory) Databricks Sql queries (ms sql, MySQL, Cassandra etc.. any) Working Knowledge on any ETL tool (preferably on Talend) not mandatory but good to have. Working Knowledge on job scheduling tool. Experience in monitoring scheduled jobs. Working Knowledge on SLA, driving high priority issues and escalation handling.

Key Responsibilities: 5 to 10 years of experience designing and building data pipelines using Apache Spark, Databricks or equivalent bigdata frameworks Handson expertise with streaming and messaging systems such as Apache Kafka (publish subscribe architecture), Confluent Cloud, RabbitMQ or Azure Event Hub. Experience creating producers, consumers and topics and integrating them into downstream processing. Deep understanding of relational databases and CDC. Proficiency in SQL Server, Oracle, or other RDBMSs; experience capturing change events using Debezium or native CDC tools and transforming them for downstream consumption. Implement CDC and deduplication logic. Capture change events from s...

Role: Azure Data Engineer Experience: 6 10 Years Location: Bangalore (Hybrid, 3 days office per week) Notice Period: Immediate to 2 weeks only apply if you can join early Job Description: We are seeking an Azure Data Engineer with strong expertise in designing, developing, and running end-to-end data pipelines . The role involves working on data validation, data flows, data transformation, and data warehousing to deliver deep insights through analytics and visualization. Key Responsibilities: Design, build, and optimize E2E Data Pipelines on Azure Implement and manage ETL processes & Data Warehousing solutions Work with Azure services (ADF, ADB, ADLS) for scalable solutions Perform data tran...

Hi , Hope you are doing great !! Must have Skillset: ETL TESTER SQL ADB Job Title: Analyst Work Location: Pune -MH Skill Required: Digital :~Data Migration Testing Experience Range : 6-8 Years Job Description: The ETL Tester will be responsible for validating data movement, transformations, and data quality across different stages of the ETL (Extract, Transform, Load) process. Requires strong SQL skills, analytical thinking, and hands-on experience with ETL tools (Informatica, Talend, DataStage, SSIS, etc.), and good knowledge of data warehouse concepts (star schema, snowflake schema, data modeling). Key Responsibilities Understand business requirements, source systems, and target data model...

Role Purpose The purpose of the role is to support process delivery by ensuring daily performance of the Production Specialists, resolve technical escalations and develop technical capability within the Production Specialists. Do Oversee and support process by reviewing daily transactions on performance parameters Review performance dashboard and the scores for the team Support the team in improving performance parameters by providing technical support and process guidance Record, track, and document all queries received, problem-solving steps taken and total successful and unsuccessful resolutions Ensure standard processes and procedures are followed to resolve all client queries Resolve cl...

Salary: 25 to 40 LPA Exp: 5 to 10 years Location: Gurgaon/Pune/Bengalore Notice: Immediate to 30 days..!! Job Profile: Experienced Data Engineer with a strong foundation in designing, building, and maintaining scalable data pipelines and architectures. Skilled in transforming raw data into clean, structured formats for analytics and business intelligence. Proficient in modern data tools and technologies such as SQL, T-SQL, Python, Databricks, and cloud platforms (Azure). Adept at data wrangling, modeling, ETL/ELT development, and ensuring data quality, integrity, and security. Collaborative team player with a track record of enabling data-driven decision-making across business units. As a Da...

Hiring Azure Data Engineer with expertise in Python & PySpark. Must design and optimize data pipelines, build scalable solutions, and work on Azure-based data engineering projects.

About The Role Project Role : Application Lead Project Role Description :Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : Microsoft Azure Databricks Good to have skills : NAMinimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact. Your typical day will involve collaborating with various teams to ensure that application development aligns with business objectives, overseeing project timelines, and facilitating communication among stakeho...

About The Role Project Role : Application Developer Project Role Description :Design, build and configure applications to meet business process and application requirements. Must have skills : Microsoft Azure Databricks Good to have skills : NAMinimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will engage in the design, construction, and configuration of applications tailored to fulfill specific business processes and application requirements. Your typical day will involve collaborating with team members to understand project needs, developing innovative solutions, and ensuring that applications are o...

About The Role Project Role : Application Designer Project Role Description :Assist in defining requirements and designing applications to meet business process and application requirements. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : Microsoft Azure DatabricksMinimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Designer, you will assist in defining requirements and designing applications to meet business process and application requirements. A typical day involves collaborating with various stakeholders to gather insights, analyzing user needs, and translating them into funct...

About The Role Project Role : Data Architect Project Role Description :Define the data requirements and structure for the application. Model and design the application data structure, storage and integration. Must have skills : Microsoft Azure Databricks Good to have skills : AWS Architecture, Snowflake Data Warehouse, PySparkMinimum 15 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Architect, you will define the data requirements and structure for the application. Your typical day will involve modeling and designing the application data structure, storage, and integration, ensuring that the architecture aligns with business need...

Graduate degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field. 7+ Yrs total experience in Data Engineering projects & 4+ years of relevant experience on Azure technology services and Python Azure Azure data factory, ADLS- Azure data lake store, Azure data bricks, Mandatory Programming languages Py-Spark, PL/SQL, Spark SQL Database SQL DB Experience with AzureADLS, Databricks, Stream Analytics, SQL DW, COSMOS DB, Analysis Services, Azure Functions, Serverless Architecture, ARM Templates Experience with relational SQL and NoSQL databases, including Postgres and Cassandra. Experience with object-oriented/object function scripting languagesPython...

Project Role: Azure date engineer Work Experience: 3 to 8 Years Work location: Bangalore/Gururam/Kochi/Pune Work Mode: Hybrid Must Have Skills: Azure Data engineer, SQL, Spark/Pyspark Job Overview: Responsible for the on-time completion of projects or components of large, complex projects for clients in the life sciences field. Identifies and elevates potential new business opportunities and assists in the sales process. Skills required: Experience in developing Azure components like Azure data factory, Azure data Bircks, Logic Apps, Functions Develop efficient & smart data pipelines in migrating various sources on to Azure datalake Proficient in working with Delta Lake, Parquet file formats...

Role: Solution Architect- Data Exp : 13-18 yrs Location: Hyderabad Role & responsibilities Bachelors or Masters degree in Computer Science, Information Systems, or related field. 8+ years of experience in data architecture and engineering , with a strong focus on financial services . Proven experience with lakehouse platforms and cloud-native data ecosystems Strong understanding of wealth management and insurance data domains. Hands-on experience with MDM platforms (e.g., Informatica MDM, Reltio, Semarchy). Expertise in API design and enablement (REST, GraphQL, OpenAPI). Proficiency in SQL , Python , and distributed data processing frameworks . Familiarity with data governance tools (e.g., C...

Greetings from TCS!! TCS is Hiring for Senior Data Consultant Interview Mode: Virtual Required Experience: 10-16 years Work location: PAN INDIA Must-Have Databricks (including PySpark, Delta Lake, MLflow) Snowflake (data warehousing, performance tuning, data sharing) Data Lake architecture Cloud platforms: Azure, AWS, GCP CI/CD and DataOps practices Legacy system migration and modernization strategies Good-to-Have Exposure to GenAI/LLM integration Experience with streaming data (Kafka, Spark Streaming) Knowledge of data governance and cataloging tools (Unity Catalog, Purview) Familiarity with BI tools and dashboarding

Job Description: You are invited to apply for the position of Azure Data Engineer based in Bangalore with a salary ranging from 14-20 LPA. As an Azure Data Engineer, your primary responsibility will be to design, develop, and maintain data pipelines using Azure services such as Azure Data Factory (ADF), Azure Databricks (ADB), and Azure Data Lake Storage (ADLS). You will collaborate closely with cross-functional teams to ensure efficient data processing and integration for analytics purposes. Additionally, you will be tasked with writing and maintaining code in SQL, Python, and PySpark to handle data manipulation and transformation. Monitoring and optimizing the performance of data workflows...

As an Enterprise Architect at our organization, you will have the opportunity to work with cutting-edge technology, delivering high-quality solutions across various industries while overseeing team(s) on engagements of varying sizes and scopes. You will receive continuous career development opportunities to support the actualization of a business strategic vision by understanding current technology states, performing gap analyses, and developing plans to close those gaps. Your role will involve owning consulting relationships across multiple clients and technologies. You will collaborate with the Data Analytics Practice at BDO Digital(USA), an IT advisory and technology services consulting o...

As a Data Engineer with 3-5 years of experience, you will be responsible for creating data ingestion flows for consumption in Gen AI solutions. Your role will involve designing, developing, and optimizing ETL processes and data pipelines using Azure Data Factory and Azure Databricks. Additionally, you will implement AI-driven data solutions leveraging Azure OpenAI, Prompt Engineering, and Retrieval-Augmented Generation (RAG). You will be expected to develop and maintain Azure Functions for seamless integration and automation, as well as utilize Python and C# for data transformation, integration, and AI model deployment. Managing CI/CD pipelines using Azure DevOps for efficient deployment and...