137 Databricks Engineer Jobs - Page 4

Role: Azure Specialist-CDM Smith Location:Bangalore Mode: Remote Education and Work Experience Requirements: Key Responsibilities: Databricks Platform: Act as a subject matter expert for the Databricks platform within the Digital Capital team, provide technical guidance, best practices, and innovative solutions. Databricks Workflows and Orchestration: Design and implement complex data pipelines using Azure Data Factory or Qlik replicate. End-to-End Data Pipeline Development: Design, develop, and implement highly scalable and efficient ETL/ELT processes using Databricks notebooks (Python/Spark or SQL) and other Databricks-native tools. Delta Lake Expertise: Utilize Delta Lake for building rel...

Must-Have Skills: 5 to 8 years of backend development experience Strong proficiency in Core Java and Scala Hands-on experience with Spring Framework Cloud technologies and microservices architecture Multithreaded programming and concurrency Scripting (e.g., Shell , Perl ) and UNIX/Linux Working knowledge of relational databases (Sybase, DB2) Excellent communication and problem-solving skills Data Bricks primary Good to Have: Experience with Apache Spark , Hadoop , or other big data tools Familiarity with FIX Protocol , MQ , XML/DTD Exposure to CI/CD tools and Test-Driven Development Domain understanding of Equity or Fixed Income trade lifecycle Strong debugging and performance profiling capa...

We are looking for a skilled and passionate AWS Data Engineer to join our dynamic data engineering team. The ideal candidate will have strong experience in building scalable data pipelines and solutions using AWS, PySpark, Databricks, and Snowflake. Key Responsibilities: Design, develop, and maintain large-scale data pipelines on AWS using PySpark and Databricks. Work with Snowflake to perform data warehousing tasks including data loading, transformation, and optimization. Build efficient and scalable ETL/ELT workflows to support analytics and reporting. Collaborate with data analysts, architects, and stakeholders to understand business requirements and translate them into data solutions. Im...

Role & responsibilities candidate must be Databricks Champion level in terms of expertise, who has proven hands-on experience in a lead engineer’ capacity, who has designed and implemented enterprise-level solutions in Databricks that leverage the core capabilities: Data Engineering (Delta Lake, PySpark framework, Python, PySpark SQL, Notebooks, Jobs, Workflows), Governance (Unity Catalog), Data Sharing (Delta Sharing, maybe even Clean Rooms, Marketplace). This experience must be recent, built up over the past 3 years at least. Must be good command of English language and ability to communicate clearly and to the point are of course a must.

Were Hiring: Senior Data Engineer | Hybrid | All Xebia Locations Apply by sending your resume to vijay.s@xebia.com Locations: Chennai, Hyderabad, Bangalore, Pune, Bhopal, Jaipur, Gurugram Mode: Hybrid 3 days/week from office Experience: 8+ Years Joining: Immediate or within 2 weeks About the Role: Xebia is seeking a Senior Data Engineer to join our Data Warehouse team. Youll be building cloud-native, data-intensive applications using modern tech stacks including Databricks, Airflow, Spark, and Terraform. Ideal for professionals with a strong foundation in Python, AWS, and modern data platforms. Key Responsibilities: Build and optimize robust Data Warehouse solutions Develop cloud-native, dat...

Design scalable data systems, develop analytics-ready models, build ETL pipelines, manage SQL/NoSQL DBs, integrate diverse data sources, orchestrate workflows (Airflow/Glue), and collaborate with teams. Skilled in Databricks, BigQuery, SQL, Python.

Key Responsibilities: Design, develop, and maintain scalable data pipelines and ETRM systems. Work on data integration projects within the Energy Trading and Risk Management (ETRM) domain. Collaborate with cross-functional teams to integrate data from ETRM trading systems like Allegro, RightAngle, and Endur. Optimize and manage data storage solutions in Data Lake and Snowflake. Develop and maintain ETL processes using Azure Data Factory and Databricks. Write efficient and maintainable code in Python for data processing and analysis. Ensure data quality and integrity across various data sources and platforms. Ensure data accuracy, integrity, and availability across various trading systems. Co...

Job description Data Engineer III/ IV - IN Work Location - Remote Job Description Summary The Data engineer is responsible for managing and operating upon Databricks, Dbt, SSRS, SSIS, AWS DWS, AWS APP Flow, PowerBI/Tableau. The engineer will work closely with the customer and team to manage and operate cloud data platform. Job Description Provides Level 3/4 operational coverage: Troubleshooting incident/problem, includes collecting logs, cross-checking against known issues, investigate common root causes (for example failed batches, infra related items such as connectivity to source, network issues etc.) Knowledge Management: Create/update runbooks as needed / Entitlements Governance: Watch ...

Databricks Engineer _ Pan India Role & responsibilities Develop and maintain a metadata driven generic ETL framework for automating ETL code Design, build, and optimize ETL/ELT pipelines using Databricks (PySpark/SQL) on AWS . Insure MO rating engine experience required. Ingest data from a variety of structured and unstructured sources (APIs, RDBMS, flat files, streaming). Develop and maintain robust data pipelines for batch and streaming data using Delta Lake and Spark Structured Streaming. Implement data quality checks, validations, and logging mechanisms. Optimize pipeline performance, cost, and reliability. Collaborate with data analysts, BI, and business teams to deliver fit for purpose...

About Apexon: Apexon is a digital-first technology services firm specializing in accelerating business transformation and delivering human-centric digital experiences. We have been meeting customers wherever they are in the digital lifecycle and helping them outperform their competition through speed and innovation.Apexon brings together distinct core competencies in AI, analytics, app development, cloud, commerce, CX, data, DevOps, IoT, mobile, quality engineering and UX, and our deep expertise in BFSI, healthcare, and life sciences to help businesses capitalize on the unlimited opportunities digital offers. Our reputation is built on a comprehensive suite of engineering services, a dedicat...

We are looking for experienced DBAs worked on multiple database technologies and cloud migration projects. 6+ years of experience working on SQL/NoSQL/Data warehouse platforms on on-premise and cloud (AWS, Azure & GCP) Provide expert-level guidance on cloud adoption, data migration strategies, and digital transformation projects Strong understanding of RDBMS, NoSQL, Datawarehouse, In Memory and Data Lake architecture, features, and functionalities Proficiency in SQL and data manipulation techniques. Experience with data loading and unloading tools and techniques. Expertise in Data Access Management, Database reliability & scalability and Administer, configure, and optimize database resources...

We are looking for experienced DBAs worked on multiple database technologies and cloud migration projects for our clients worldwide. 6+ years of experience working on SQL/NoSQL/Data warehouse platforms on on-premise and cloud (AWS, Azure & GCP) Provide expert-level guidance on cloud adoption, data migration strategies, and digital transformation projects Strong understanding of RDBMS, NoSQL, Datawarehouse, In Memory and Data Lake architecture, features, and functionalities Proficiency in SQL and data manipulation techniques. Experience with data loading and unloading tools and techniques. Expertise in Data Access Management, Database reliability & scalability and Administer, configure, and o...

Identify leads via networking/research, build client relationships, understand needs, pitch solutions, partner with tech firms (Oracle, Microsoft, Databricks), handle negotiations, support, and track sales while staying updated on trends. Perks and benefits Salary + Sales Incentives

Role & responsibilities Clickflow is seeking a meticulous and technically proficient Data Tester to join our growing data analytics team. The ideal candidate will be responsible for ensuring the quality, accuracy, and integrity of our data solutions, with a strong focus on ETL processes, data warehousing, and Power BI reports built on the Microsoft Azure platform. In this role, you will be a critical player in our data governance and quality assurance framework. You will collaborate closely with data engineers, data analysts, and business stakeholders to validate data pipelines and ensure that our data-driven insights are reliable and accurate. If you have a passion for data, a keen eye for ...

Key Responsibilities: Work closely with Data Engineers and ML Engineers to ensure data readiness and model deployment. Present findings and insights to stakeholders using visualizations and dashboards. Productionization & Monitoring: Assist in transitioning models from development to production. Monitor model drift and performance over time. Data Exploration & Querying: Use Databricks SQL for querying and analysing data. Document data lineage and ensure reproducibility Exploratory Data Analysis (EDA): Use Databricks Notebooks (Python, R) to explore structured and unstructured data. Perform hypothesis testing and statistical profiling. Feature Engineering : Create and manage features using Da...

Primarily looking for a Data Engineer with expertise in processing data pipelines using Databricks PySpark SQL on Cloud distributions like AWS Must have AWS Databricks Good to have PySpark Snowflake Talend Requirements- Candidate must be experienced working in projects involving Other ideal qualifications include experiences in Primarily looking for a data engineer with expertise in processing data pipelines using Databricks Spark SQL on Hadoop distributions like AWS EMR Data bricks Cloudera etc. Should be very proficient in doing large scale data operations using Databricks and overall very comfortable using Python Familiarity with AWS compute storage and IAM concepts Experience in working ...

Responsibilities: Collaborate with cross-functional teams on MuleSoft integrations Ensure data accuracy through testing and validation processes Design, develop & maintain ETL solutions using Talend

Strong proficiency in SQL (Structured Query Language)querying, manipulating and optimizing dataExperience in ETL development informatica Data warehousing, ADF,GCP,Databricks Extensive experience with popular ETL tools Required Candidate profile 2+ years of experience in Infomatica, complex SQL queries SQL: Oracle, MS SQL, Teradata, Netezza • ETL: Informatica Power Centre (Must) • Cloud: ADF OR Databricks OR GCP or Google Data Proc

Job Summary We are looking for a highly skilled Cloud Engineer with a strong background in real-time and batch data ingestion and data processing, azure products-devops, azure cloud. The ideal candidate should have a deep understanding of streaming architectures and performance optimization techniques in cloud environments, preferably in subsurface domain. Key Responsibilities Automation experience essential : Scripting, using PowerShell. ARM Templates, using JSON (PowerShell also acceptable) Azure DevOps with CI/CD, Site Reliability Engineering Must be able to understand the concept of how the applications function. The ability to priorities workload and operate across several initiatives s...

Role & responsibilities Developing Modern Data Warehouse solutions using Databricks and AWS/ Azure Stack Ability to provide solutions that are forward-thinking in data engineering and analytics space Collaborate with DW/BI leads to understand new ETL pipeline development requirements. Triage issues to find gaps in existing pipelines and fix the issues Work with business to understand the need in reporting layer and develop data model to fulfill reporting needs Help joiner team members to resolve issues and technical challenges. Drive technical discussion with client architect and team members Orchestrate the data pipelines in scheduler via Airflow Preferred candidate profile Bachelor's and/o...

Job Description: SAC/SAP Data Bricks Consultant Experience: 6+years Job Type: Full Time Location: Hybrid / Chennai Work Timing: 4:30 PM to 12:30 AM IST Skills: Experience in Data bricks for data processing and analytics Hands-on knowledge of SAP Datasphere for data modeling and integration Good understanding of SAP Analytics Cloud (SAC) for building reports and dashboards Strong background in data and analytics Ability to build accelerators and innovative products in the analytics space Can work on end-to-end solutions from data to insights

Key Requirements: A minimum of 5+ years of experience as an ML Engineer is must. Experience in ML model development applying Data Science algorithms and GenAI Are proficient with Python and Databricks , including open-source data libraries (e.g. Pandas, Numpy, Scikit learn, etc.). Strong understanding and experience of DevOps technologies such as Docker/Terraform and ML Ops practices and platforms/ frameworks like ML Flow ( Amazon Sagemaker/Azure Machine Learning) . Strong experience in production using machine learning models. Working experience in any one of predictive modelling, optimisation or recommendation systems. Hands-on experience with agile delivery methodologies and CI/CD. Hands-...

Role & responsibilities As a C++ developer in the Simulation environment unit you will work with: Enablement of advanced large-scale simulation testing for the development of autonomous vehicles Integration of third-party state-of-the-arttools in our simulation platform. Support of software developers and testers throughout the organization with the simulation tools. Contributing to the teams planning and roadmaps. In your role, you will learn how our autonomous vehicle software stack works. Your contributions will be one of the keys to securing the efficient and safe deployment of Scanias next-generation autonomous software. We give high value to cooperation, support to each other and knowl...

Company name: PulseData labs Pvt Ltd (captive Unit for URUS, USA) About URUS We are the URUS family (US), a global leader in products and services for Agritech. SENIOR DATA ENGINEER This role is responsible for the design, development, and maintenance of data integration and reporting solutions. The ideal candidate will possess expertise in Databricks and strong skills in SQL Server, SSIS and SSRS, and experience with other modern data engineering tools such as Azure Data Factory. This position requires a proactive and results-oriented individual with a passion for data and a strong understanding of data warehousing principles. Responsibilities Data Integration Design, develop, and maintain ...

Company name: PulseData labs Pvt Ltd (captive Unit for URUS, USA) About URUS We are the URUS family (US), a global leader in products and services for Agritech. SENIOR DATA ENGINEER This role is responsible for the design, development, and maintenance of data integration and reporting solutions. The ideal candidate will possess expertise in Databricks and strong skills in SQL Server, SSIS and SSRS, and experience with other modern data engineering tools such as Azure Data Factory. This position requires a proactive and results-oriented individual with a passion for data and a strong understanding of data warehousing principles. Responsibilities Data Integration Design, develop, and maintain ...