202 Databricks Engineer Jobs - Page 4

Data Engineering Manager - Azure & Python Experience: 8 - 13 Years Exp. Salary: Competitive Preferred Notice Period : 30 Days Shift : 10:00 AM to 7:00 PM IST Opportunity Type: Noida (Remote for 6 months, Later Hybrid) Placement Type: Permanent (*Note: This is a requirement for one of Uplers' Clients) Must have skills required : Data Mesh, Data Engineering, Python, SQL, Kafka, Airflow, Hadoop, Spark Nuaav (One of Uplers' Clients) is Looking for: An Engineering Manager who is passionate about their work, eager to learn and grow, and who is committed to delivering exceptional results. If you are a team player, with a positive attitude and a desire to make a difference, then we want to hear from...

Data Engineering Manager - Azure & Python Experience: 8 - 13 Years Exp. Salary: Competitive Preferred Notice Period : 30 Days Shift : 10:00 AM to 7:00 PM IST Opportunity Type: Noida (Remote for 6 months, Later Hybrid) Placement Type: Permanent (*Note: This is a requirement for one of Uplers' Clients) Must have skills required : Data Mesh, Data Engineering, Python, SQL, Kafka, Airflow, Hadoop, Spark Nuaav (One of Uplers' Clients) is Looking for: An Engineering Manager who is passionate about their work, eager to learn and grow, and who is committed to delivering exceptional results. If you are a team player, with a positive attitude and a desire to make a difference, then we want to hear from...

Databricks -(SME) with 8+ Yrs exp, Skills: Databricks, Unity Catalog, new Databricks offerings (i.e., Genie), Azure, Data Management, Data Engineering, Responsibilities: Design and build scalable data platforms using Azure and Databricks.

Required Skills & Experience: 7+ years of experience as a Data Engineer who have hands on experience on Databricks . Strong hands-on experience with: Apache Spark Databricks, PySpark & Python SQL AWS S3 AWS Athena Snowflake (Good to have but candidate must be proficient in writing SQL queries for data analysis) GitHub & GitHub Actions Solid understanding of AWS Cloud services related to data engineering. Experience working with Snowflake is an added advantage. Strong understanding of data modelling, data warehousing, and spark jobs performance optimization. Excellent problem-solving and analytical skills. Key Responsibilities: Design, build, and maintain ETL/ELT pipelines using Databricks in...

About Position: We are seeking a Senior Platform Engineer to architect, build, and manage enterprise-scale data platforms that power advanced analytics and AI initiatives. This role blends cloud engineering, DevOps automation, and data platform administration to deliver secure, scalable, and cost-efficient solutions across Azure and AWS environments. You will lead efforts to optimize Databricks and Snowflake platforms, enforce governance and compliance, and implement automation that accelerates delivery and improves reliability. Role: Senior Data Platform Engineer Location: Pune, Hyderabad, Bangalore Experience: 10 to 12 Years Job Type: Full Time Employment What You'll Do: Architect and mana...

Introduction for position Software Engineer on Databricks; working in a global team. Your tasks Develop, test, and maintain software applications using Java, Python, SQL, and Linux on Databricks Design and Implement data integration workflows with business logic in Java Implement Databricks workflows Implement ML Flow based applications Collaborate with cross-functional teams to gather requirements and design efficient and scalable solutions. Implement and manage CI/CD through github enterprise actions Implement and manage data pipelines using Airflow for orchestrating workflows and scheduling tasks. Work with cloud technologies, such as AWS, Azure, or Google Cloud Platform, to deploy and sc...

Must have skills: Hands-on experience with Databricks platform, including Delta Lake/ Lakehouse architecture Person should be familiar with Python / Pyspark code (not needed a developer) Knowledge of data structures, data modeling, ETL/ELT, and data warehousing. SQL basic in data querying and troubleshooting / manipulation. Key asks for the role: We need a candidate who can drive high-level design and solutioning based on established patterns. The person will collaborate closely with Solution Architect team. At this level, the candidate will not be working as a full-time developer but should be familiar with Python code and able to perform code reviews, debugging, and mentoring of junior dev...

Role & responsibilities Preferred candidate profile Design, develop, and deploy machine learning models using techniques such as regression, classification, clustering, and time series forecasting . Perform data analysis, preprocessing, and feature engineering to prepare high-quality datasets for modeling. Build and manage data pipelines and workflows in Databricks for model training and deployment. Utilize Unity Catalog for data governance, access control, and metadata management. Implement MLflow for experiment tracking, model versioning, and lifecycle management. Integrate ML workflows with CI/CD pipelines to ensure automated and reliable deployments. Optimize data processes using SQL and...

Job description Hiring for Databricks with experience range 2 years & above Mandatory Skills: Databricks Education: BE/B.Tech/MCA/M.Tech/MSc./MS Responsibilities A day in the life of an Infoscion As part of the Infosys consulting team, your primary role would be to actively aid the consulting team in different phases of the project including problem definition, effort estimation, diagnosis, solution generation and design and deployment You will explore the alternatives to the recommended solutions based on research that includes literature surveys, information available in public domains, vendor evaluation information, etc. and build POCs You will create requirement specifications from the b...

Responsibilities: Design and implement secure, scalable, and automated Databricks environments to support AI/ML workloads. Develop infrastructure-as-code (IaC) solutions using Terraform for provisioning Databricks, cloud resources, and network configurations. Build automation and self-service capabilities using Python, Java and APIs for platform onboarding, workspace provisioning, orchestration and monitoring. Collaborate with data science and ML teams to define compute requirements, governance policies, and efficient workflows across dev/qa/prod environments. Integrate Databricks offering with cloud-native services on Azure/AWS Champion CI/CD and GitOps for managing ML infrastructure and co...

Role: DataBricks Engineer Notice Period: Immediate joiners only Location: Pune Work Mode: Hybrid Position Overview: We need a skilled Databricks Data Engineer with strong analytical and troubleshooting abilities. The ideal candidate should have hands-on experience in building scalable data pipelines using PySpark on cloud platforms like Azure/AWS along with a solid hands-on experience on ETL tools like Informatica PC/SSIS/DataStage, and relational databases. Mandatory skills needed: 1) Strong hands-on experience with Databricks - PySpark notebooks and Datbricks pipeline development 2) Experience using PySpark with Databricks 3) Strong understanding of SQL and query optimization techniques. 4...

Responsibilities: Experience in SAP, BI, Informatica and Databricks stack

Relevant experience in Pyspark and Azure Databricks. Proficiency in integrating, transforming, and consolidating data from various structured and unstructured data sources. Good experience in SQL or native SQL query languages. Strong experience in implementing Databricks notebooks using Python. Good experience in Azure Data Factory, ADLS, Storage Services, Serverless architecture, Azure functions. Exposure to basic issues in working within a Cloud (Azure) environment. Advanced working SQL knowledge and experience working with relational/non-Relational databases, query. Exposure to Jira and Confluence required

About Tredence: Tredence focuses on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science and software engineering. The largest companies across industries are engaging with us and deploying their prediction and optimization solutions at scale. Head quartered in the San Francisco Bay Area, we serve clients in the US, Canada, Europe, and South East Asia. We are seeking an experienced data scientist who apart from the required mathematical and statistical expertise also possesses the natural curiosity and creative mind to ask questions, connect the dots, and uncover opportunities that lie hidden with the ultimate goal of re...

TCS is Hiring for Senior Data Engineer Role & responsibilities Design, develop, and implement scalable data pipelines for ingesting, processing, and distributing large volumes of data. Apply advanced data modelling techniques to optimise data structures for operational and analytical use cases. Collaborate with stakeholders to understand data requirements and deliver effective solutions. Monitor, troubleshoot, and optimise data infrastructure for performance, reliability, and cost-efficiency. Ensure data quality, governance, and security through best practices and process implementation. Provide technical mentorship to junior engineers and foster a culture of continuous learning. Stay curren...

Job Title: Functional Engineer Reporting (Pune. MH) Job Summary : We are seeking a highly skilled Functional Engineer Reporting with deep experience in building scalable data solutions on the Azure cloud platform. The ideal candidate will have strong architecture-level knowledge, hands-on expertise with Databricks, and proven skills in optimizing large-scale data processing systems. This role will be critical in enabling data-driven decisions within our commercial operations. Key Responsibilities : Design, build, and maintain scalable data pipelines using Azure Data Factory and Databricks. Define and implement data architecture and modeling strategies to support reporting, analytics, and adv...

In this position you will be responsible for providing insights to clients. To do so, you will first meet with our clients to uncover their business needs and challenges. Then, you will use your strong analytical skills to perform quantitative and observational data analyses. From these analyses, you will form and present your recommendations to our clients. About the Role DataBricks Consultant Location: Bangalore Exp: 5+ yrs. Responsibilities Designing and building Databricks data pipelines is required. Experience in transforming the data using Azure Databricks & Delta lake. Hands-on experience implementing Big Data solutions in a cloud ecosystem, including Data/Delta Lakes. SQL experience,...

Data Platform Engineering Databricks Administration Python, PySpark, Bash, Terraform, Git, Azure DevOps Strong skills- Azure Synapse, Data Lake, Snowflake, Fabric IAM, RBAC, Encryption & Governance Controls Databricks Admin Certification preferred

Min. 5 yrs on role Software Engineering + Backend Eng. (one of languages: Python, Java, Scala, Rust - with focus on Python today) practice with high quality codes (unit testing, integration testing, others) + code metrics fast discovery what is in new repository code, asking right technical questions about codebase and code quality, CI/CD as a general rule of work (automatic tasks, instead of manual) Min. 5 yrs on role near "data" subject like Data Engineer or Integrations Engineer strong understanding data pipelines in Apache Spark, Apache Airflow and similar orchestrators understanding on mid. level Databricks or other modern platforms BigData solutions inside (i.e. data catalogs, computes...

Looking For: 7+ yrs experience in data governance, security, compliance Azure AD, Key Vault, Databricks Unity Catalog, Power BI/AAS Strong SQL, regulatory knowledge, metadata skills Relevant cert: AZ-500, DP-203, DP-500, CDMP, CIPP, CISSP

Key Responsibilities Design, develop, and maintain robust ETL/ELT pipelines using SQL, dbt, and orchestration tools. Architect and implement data warehouse and lakehouse solutions leveraging Snowflake, Databricks, and cloud-native services. Work on data modeling, schema design, and query optimization for performance and scalability. Migrate and integrate legacy/on-prem data platforms to cloud environments (Azure or AWS). Implement data governance, quality, and security practices to ensure reliability and compliance. Collaborate with data scientists, BI developers, and business stakeholders to deliver analytics-ready datasets. Optimize pipelines and storage for cost efficiency and cloud-nativ...

Job Description ETL Migration Specialist (Informatica to Databricks) Position Overview We are looking for an experienced ETL Migration Specialist with strong expertise in Informatica PowerCenter and Databricks (PySpark) . The ideal candidate will be responsible for analysing and reverse engineering existing Informatica mappings/workflows, understanding the business logic implemented, and refactoring these pipelines into scalable, efficient data processing workflows on Databricks. This role requires strong analytical skills, hands-on experience in ETL development, and the ability to collaborate with both business and technical teams to ensure seamless migration. Key Responsibilities Reverse E...

Job Description ETL Migration Specialist (Informatica to Databricks) Position Overview We are looking for an experienced ETL Migration Specialist with strong expertise in Informatica PowerCenter and Databricks (PySpark) . The ideal candidate will be responsible for analysing and reverse engineering existing Informatica mappings/workflows, understanding the business logic implemented, and refactoring these pipelines into scalable, efficient data processing workflows on Databricks. This role requires strong analytical skills, hands-on experience in ETL development, and the ability to collaborate with both business and technical teams to ensure seamless migration. Key Responsibilities Reverse E...

Job description Hiring for Databricks with experience range 2 years & above Mandatory Skills: Databricks Education: BE/B.Tech/MCA/M.Tech/MSc./MS Responsibilities A day in the life of an Infoscion As part of the Infosys consulting team, your primary role would be to actively aid the consulting team in different phases of the project including problem definition, effort estimation, diagnosis, solution generation and design and deployment You will explore the alternatives to the recommended solutions based on research that includes literature surveys, information available in public domains, vendor evaluation information, etc. and build POCs You will create requirement specifications from the b...

Data Engineering Manager - Azure & Python Experience: 9 - 15 Years Exp. Salary: Highly Competitive Preferred Notice Period : 30 Days Shift : 10:00 AM to 7:00 PM IST Opportunity Type: Noida (Remote for 6 months, Later Hybrid) Placement Type: Permanent (*Note: This is a requirement for one of Uplers' Clients) Must have skills required : Engineering management, Data Engineering, Azure Data Factory, Python, SQL OR NoSQL OR Azure, Backend OR FullStack Nuaav (One of Uplers' Clients) is Looking for: An Engineering Manager who is passionate about their work, eager to learn and grow, and who is committed to delivering exceptional results. If you are a team player, with a positive attitude and a desir...