4749 Data Bricks Jobs - Page 46

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensu...

Job Role - Lead Data Architect Location - Bangalore / Navi Mumbai / Gurugram and Noida Actionable: Responsible for building data lake, data foundation and analytical solution with standard design and modern cloud/hybrid architecture pattern Work with cross functional teams to make the data usable for functional users and applications to enable delivery of business values to customers Provide architectural leadership and vision for Bank's Next Gen Data Platform and Data Lakehouse Develop and maintain architectural roadmap for data products and data services plus ensuring alignment with the business and enterprise architecture strategies and standards Drive design and architecture for Data Tra...

Role: Tech Lead Description The Data Engineering Lead is a senior-level position within our Data Engineering team, responsible for spearheading the design, implementation, and optimization of advanced data architectures using Databricks. This role involves leading a team of data engineers, collaborating with business and data analysts, and business stakeholders, and delivering scalable, secure data solutions tailored to the needs of commercial analytics in the pharmaceutical industry. Certifications in Databricks, AWS, Azure, or related technologies is REQUIRED. Responsibilities 1. Architecture Design Develop and maintain scalable data architectures using Databricks, including data lakes, da...

Role: Senior/Lead Data Analyst Experience: 5-10 Yrs Location: Pune, Chennai Notice Period: Immediate to 15 days only Interview: L1 - Virtual / L2 Virtual Mode: Hybrid 4 days a week Job Description: Bachelors or masters degree in computer science, Information Technology, or a related field. Proven experience as a Data Analyst or in a similar role, with 5-10 years of hands-on experience in developing data pipelines and managing data infrastructure. Demonstrated expertise in working with Data Bricks for data processing and analysis. Python and SQL experience required Worked on end-to-end Data Product deployment Deployment experience (various databases, server/cloud environment: AWS, Azure, and ...

JOB DESCRIPTION: Basic Functions 6-8 Years of experience in enterprise application design, development & support. Handling high volume SQL warehouse, Extensive knowledge on MS SQL, SSIS and Visual Report Experienced in designing and building data warehouses/marts using Microsoft SQL. Proficient in developing engaging and insightful visual dashboards with Power BI. Possesses a strong understanding of data modelling and visualization principles. Design, develop, and maintain enterprise BI reports, visualizations, and dashboards in Power BI Work with the report team to design and implement a reporting user experience that is consistent and intuitive across environments and across report methods...

As a Data Engineer at UPS, your role involves participating in the support of batch and real-time data pipelines for Marketing and Finance business units. You will be responsible for integrating data from various sources, performing ETL data conversions, and facilitating data cleansing and enrichment. Your duties will include full systems life cycle management activities, such as analysis, technical requirements, design, coding, testing, and implementation of systems and applications software. Additionally, you will contribute to synthesizing disparate data sources to support reusable and reproducible data assets. **Key Responsibilities:** - Supervising and supporting data engineering projec...

Key Responsibilities: Ensures that software applications development projects Performs proof of concept as and when required and ensure that development costs and activities remain within budget. Uses business requirements to advise on the design, deployment, and operation of infrastructures. Helps determine how technology can be applied to meet external client and business requirements by crafting high level solutions and work breakdown. Works closely with various external stakeholders to define the scope or boundary of the concepts which includes a cost benefit analysis, risk management plan and a feasibility study. Ensures the delivery of the design and completion requirements to applicat...

Title : Data Analyst Location: Chennai Duration : Full Time 7+ Years Bachelors or master's degree in computer science, Information Technology, or a related field. Demonstrated expertise in working with Data Bricks for data processing and analysis. Experience in implementing and optimizing data solutions using multiple programming languages in an Azure environment. Experience Proven experience as a Data Analyst or in a similar role, years of hands-on experience in developing data pipelines and managing data infrastructure within Azure. 3 years of experience in banking data Databricks and SQL experience required Experience in reporting, analysis and MIS teams preferred Worked on end-to-end Dat...

AWS Cloud Platform , CI/CD , Terraform, along with Databricks knowledge and Devops. Need Immediate Joiner Share cv at hr@newgenstaffing.co.in

8+ years of overall IT experience with minimum 5 years leading a small team of Azure Data Engineers 5+ years of experience with Database Development and Data Integration initiatives 5+ years of experience building ETL/ELT solutions using Azure data integration tools such as Azure Data Factory, Azure Functions, Logic Apps and Databricks Highly experienced with DLTs, Unity Catalog, Databricks SQL and Workflows. Hands-on experience in Azure Databricks & Pyspark to develop ETL pipelines, Strong experience reading and writing queries in Azure or any relational database is required. Prior knowledge of best practices in SDLC and use of source control management tool preferably Azure DevOps to GitHu...

We are currently seeking a Data Engineer to join our team in Remote, Karntaka (IN-KA), India (IN). "Key Responsibilities: Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical stack. Provide thought leadership by recommending the most appropriate technologies and solutions for a given use case, covering the entire spectrum from the application layer to infrastructure. Demonstrate proficiency in coding skills, utilizing languages such as Python, Java, and Scala to efficiently move solutions into production while prioritizing performance, security, scalability, and ...

We are currently seeking a FID Federal Risk Applications Data Engineer to join our team in Bangalore, Karntaka (IN-KA), India (IN). Job Duties: Team Profile: Our focus is developing systems serving as a data integration and feeding platform, ensuring that calculation results and other data initiated in our Division reaches our downstream clients and meeting all their requirements. The main challenges in this area are the volume of the data (feeding hundreds of gigabytes daily), interfacing with multiple other systems, being exposed to different financial products to a certain extent and being resilient to errors while keeping our SLA-s. The data we feed is critical in fulfilling the regulato...

Name of Position: Databricks Lead No. of Positions : 1 Company Name: Whiteblue Cloud Services Location: Chennai, Tamil Nadu Job Description Role Overview: We are looking for an experienced Databricks Lead to design, develop, and optimize large-scale data solutions leveraging Azure Databricks, Azure Data Factory, and PySpark . The ideal candidate will have strong leadership skills, hands-on technical expertise, and a passion for driving cloud-based data modernization initiatives. Key Responsibilities Lead end-to-end data engineering and modernization projects using Azure Databricks and related technologies. Design, develop, and maintain scalable data pipelines and workflows using Azure Data F...

JOB DESCRIPTION Data Engineer Designation Data Engineer Experience 5+ Years Location Mumbai (onsite) Job Summary: We are seeking a highly skilled Data Engineer with deep expertise in Apache Kafka integration with Databricks, structured streaming, and large-scale data pipeline design using the Medallion Architecture. The ideal candidate will demonstrate strong hands-on experience in building and optimizing real-time and batch pipelines, and will be expected to solve real coding problems during the interview. Job Description: • Design, develop, and maintain real-time and batch data pipelines in Databricks. • Integrate Apache Kafka with Databricks using Structured Streaming. • Implement robust ...

Job Title: Data Engineer Experience Level: 3-5 years Job Description: We are seeking a skilled data engineer to join our team. The ideal candidate will have 3-5 years of experience working with data pipelines, databases, and data warehousing solutions. As a data engineer, you will be responsible for designing, developing, and maintaining our data infrastructure to support our growing data needs. Responsibilities: Develop and maintain data integration solutions to consolidate data from various sources (e.g., databases, APIs, flat files) into a unified format for analysis and reporting. Design and optimize databases to ensure efficient storage and retrieval of data. Collaborate with data scien...

Mode of work: 5 Days WFO Work Timings: 12.30 - 9.30 PM IST ADB: Primary: Azure, Databricks, ADF, Pyspark/Python Relevant exp should be 5 yrs minimum into Databricks. 10+ Years of Datawarehouse and ETL Hands-on data exp on ADF, Synapse, Python

Role & responsibilities Lead the design, development, and optimization of ETL/ELT pipelines using Databricks , Python, Spark , and Delta Lake . Architect scalable data solutions using Medallion architecture (Bronze, Silver, Gold layers). Design and implement data models and transformations using SQL and Python . Build and maintain audit frameworks to ensure traceability, compliance, and data lineage. Develop data quality monitoring and automated testing frameworks for pipeline reliability. Perform data analysis to support operational data requests and user queries. Collaborate with clinical data teams to analyse IRT/RTSM datasets . Create and maintain dashboards and reports using BI tools (e...

Key Responsibilities: Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical stack. Provide thought leadership by recommending the most appropriate technologies and solutions for a given use case, covering the entire spectrum from the application layer to infrastructure. Demonstrate proficiency in coding skills, utilizing languages such as Python, Java, and Scala to efficiently move solutions into production while prioritizing performance, security, scalability, and robust data integrations. Collaborate seamlessly across diverse technical stacks, including Cloudera...

We are currently seeking a DevOps/Infrastructure Engineer to join our team in Bangalore, Karntaka (IN-KA), India (IN). Job Duties : This is a DevOps and Infrastructure Engineer position in the Federal Risk Infrastructure group. This is an exciting role for a self-starter who has a thirst for new challenges as well as new technologies. This role involves close collaboration with various development, infrastructure, and platform teams across multiple regions. The candidate will develop high-quality DevOps solutions involving cloud and on-prem systems, CI/CD workflows, process automation, release management, and observability implementation. This role is ideal for someone looking for a strong c...

Job Overview: We are seeking an experienced Senior Developer with strong expertise in Python, Node.js, Azure, and a proven track record of migrating cloud applications from AWS to Azure. This role requires hands-on experience in PySpark, Databricks, and Azure data services such as ADF and Synapse Spark. The ideal candidate will lead end-to-end modernization and migration initiatives, code remediation, and deployment of serverless and microservices-based applications in Azure. Key Responsibilities: Lead the migration of Python and Node.js applications from AWS to Azure. Analyze legacy AWS architecture, source code, and cloud service dependencies to identify and implement code refactoring and ...

We are seeking an experienced AI Lead with a minimum of 10 years of industry experience in the field of Artificial Intelligence. The ideal candidate will have a proven track record of successfully leading and delivering multiple projects in Machine Learning, Deep Learning, and Natural Language Processing (NLP). Additionally, they should possess sound knowledge in Generative AI and Large Language Models (LLMs). Responsibilities : Project Leadership: Lead end-to-end AI projects, from conception to delivery, ensuring alignment with business objectives and stakeholder requirements. Technical Expertise: Serve as a subject matter expert in AI, providing guidance and support to the team in the deve...

Key Responsibilities Design, develop, and maintain data pipelines and ETL/ELT workflows using Azure Data Factory, Databricks, and other Azure services. Build and manage data lake and data warehouse solutions (e.g., Azure Data Lake, Synapse Analytics). Optimize data storage, retrieval, and performance across structured and unstructured data sources. Collaborate with data scientists, analysts, and business users to enable self-service BI and advanced analytics . Implement data governance, data quality, and security best practices across all data solutions. Automate processes for monitoring, logging, and performance tuning . Work in an Agile/DevOps environment to support CI/CD pipelines for dat...

Job Description Architect and develop end to end Gen AI and machine learning solutions, focusing on scalability, performance, and modularity, in collaboration with DDIT teams to ensure alignment with enterprise architecture standards. Design, train, and fine tune Large Language Models (LLMs) like GPT, Claude, or Cohere for various applications or pilots, working closely with DDIT to leverage existing data infrastructure and tools . Optimize AI systems for deployment on cloud platforms such as AWS, Azure, Snowflake, or Databricks , ensuring high performance and cost efficiency, in partnership with DDIT to utilize best practices and cloud resources. Develop APIs and integrate AI models into ex...

Job Description Architect and develop end to end Gen AI and machine learning solutions, focusing on scalability, performance, and modularity, in collaboration with DDIT teams to ensure alignment with enterprise architecture standards. Design, train, and fine tune Large Language Models (LLMs) like GPT, Claude, or Cohere for various applications or pilots, working closely with DDIT to leverage existing data infrastructure and tools . Optimize AI systems for deployment on cloud platforms such as AWS, Azure, Snowflake, or Databricks , ensuring high performance and cost efficiency, in partnership with DDIT to utilize best practices and cloud resources. Develop APIs and integrate AI models into ex...

Job Summary: We are seeking a skilled Cloud Migration Consultant with hands-on experience in assessing and migrating complex applications from AWS to Azure. The ideal candidate will work closely with Microsoft business units, participating in application intake, assessment, and migration planning. This role includes creating migration artifacts, leading client interactions, and supporting application modernization initiatives on Azure with occasional AWS exposure. Key Responsibilities: Assess application readiness by documenting architecture, dependencies, and migration strategies Conduct interviews with stakeholders and generate discovery insights using tools like Azure Migrate, CloudockIt,...