2920 Data Bricks Jobs - Page 20

Job Posting TitleSR. DATA ENGINEER Band/Level5-2-C--C Education ExperienceBachelors Degree (High School +4 years) Employment Experience5-7 years At TE, you will unleash your potential working with people from diverse backgrounds and industries to create a safer, sustainable and more connected world. Job Overview Responsible for designing and establishing the solution architecture for analytical platforms and/or data-enabled solutions.Has broad understanding of the entire data and analytics eco-system of tools and technologies, with hands-on experience across all three core data domains of data science, data engineering, and data visualization. Responsible for fleshing out the details of the ...

About the Role: Grade Level (for internal use): 10 The Team: We seek a highly motivated, enthusiastic, and skilled engineer for our Industry Data Solutions Team. We strive to deliver sector-specific, data-rich, and hyper-targeted solutions for evolving business needs. You will be expected to participate in the design review process, write high-quality code, and work with a dedicated team of QA Analysts and Infrastructure Teams. The Impact: Enterprise Data Organization is seeking a Software Developer to create software design, development, and maintenance for data processing applications. This person would be part of a development team that manages and supports the internal & external applica...

We are seeking a skilled and motivated Application Operations Engineer for an SRE role with Java, React JS and Spring boot skillset along with expertise in Data Bricks, particularly with Oracle integration, to join our dynamic SRE team. The ideal candidate should have 3 to 6 years of experience in supporting robust web applications using Java, React JS and Spring boot with a strong background in managing and optimizing data workflows leveraging Oracle databases. The incumbent will be responsible for supporting applications, troubleshooting issues, providing RCAs and suggestive fixes by managing continuous integration and deployment pipelines, automating processes, and ensuring systems reliab...

We are seeking a skilled and motivated Application Operations Engineer for an SRE role with Java, React JS and Spring boot skillset along with expertise in Data Bricks, particularly with Oracle integration, to join our dynamic SRE team. The ideal candidate should have 3 to 6 years of experience in supporting robust web applications using Java, React JS and Spring boot with a strong background in managing and optimizing data workflows leveraging Oracle databases. The incumbent will be responsible for supporting applications, troubleshooting issues, providing RCAs and suggestive fixes by managing continuous integration and deployment pipelines, automating processes, and ensuring systems reliab...

Azure Data Factory: - Develop Azure Data Factory Objects - ADF pipeline, configuration, parameters, variables, Integration services runtime - Hands-on knowledge of ADF activities(such as Copy, SP, lkp etc) and DataFlows - ADF data Ingestion and Integration with other services Azure Databricks: - Experience in Big Data components such as Kafka, Spark SQL, Dataframes, HIVE DB etc implemented using Azure Data Bricks would be preferred. - Azure Databricks integration with other services - Read and write data in Azure Databricks - Best practices in Azure Databricks Synapse Analytics: - Import data into Azure Synapse Analytics with and without using PolyBase - Implement a Data Warehouse with Azure...

Azure Data Factory: - Develop Azure Data Factory Objects - ADF pipeline, configuration, parameters, variables, Integration services runtime - Hands-on knowledge of ADF activities(such as Copy, SP, lkp etc) and DataFlows - ADF data Ingestion and Integration with other services Azure Databricks: - Experience in Big Data components such as Kafka, Spark SQL, Dataframes, HIVE DB etc implemented using Azure Data Bricks would be preferred. - Azure Databricks integration with other services - Read and write data in Azure Databricks - Best practices in Azure Databricks Synapse Analytics: - Import data into Azure Synapse Analytics with and without using PolyBase - Implement a Data Warehouse with Azure...

- Building and operationalizing large scale enterprise data solutions and applications using one or more of AZURE data and analytics services in combination with custom solutions - Azure Synapse/Azure SQL DWH, Azure Data Lake, Azure Blob Storage, Spark, HDInsights, Databricks, CosmosDB, EventHub/IOTHub. - Experience in migrating on-premise data warehouses to data platforms on AZURE cloud. - Designing and implementing data engineering, ingestion, and transformation functions - Azure Synapse or Azure SQL data warehouse - Spark on Azure is available in HD insights and data bricks - Good customer communication. - Good Analytical skill

- Building and operationalizing large scale enterprise data solutions and applications using one or more of AZURE data and analytics services in combination with custom solutions - Azure Synapse/Azure SQL DWH, Azure Data Lake, Azure Blob Storage, Spark, HDInsights, Databricks, CosmosDB, EventHub/IOTHub. - Experience in migrating on-premise data warehouses to data platforms on AZURE cloud. - Designing and implementing data engineering, ingestion, and transformation functions - Azure Synapse or Azure SQL data warehouse - Spark on Azure is available in HD insights and data bricks - Good customer communication. - Good Analytical skill

- Building and operationalizing large scale enterprise data solutions and applications using one or more of AZURE data and analytics services in combination with custom solutions - Azure Synapse/Azure SQL DWH, Azure Data Lake, Azure Blob Storage, Spark, HDInsights, Databricks, CosmosDB, EventHub/IOTHub. - Experience in migrating on-premise data warehouses to data platforms on AZURE cloud. - Designing and implementing data engineering, ingestion, and transformation functions - Azure Synapse or Azure SQL data warehouse - Spark on Azure is available in HD insights and data bricks - Good customer communication. - Good Analytical skill

Urgent Need for Databricks Engineer with 5-10 Yrs of experience for Chennai & Pune Location, need candidates who can join us in short notice . 1. Overview We are building a scalable data ingestion and streaming platform that ingests change data capture (CDC) events from diverse source systems (databases and applications), processes them in real time and lands curated data into our analytics lake. The platform uses Confluent connectors (Debezium/Oracle CDC) to emit Parquet files into cloud storage and leverages Databricks Auto Loader to incrementally ingest, deduplicate and write this data into Delta Lake Bronze table. To ensure broad applicability, the following job description emphasizes ge...

Job Requirements Perform statistical analysis, identify trends, patterns, and anomalies within datasets using Python libraries such as NumPy, SciPy, and Scikit-learn. Develop and implement predictive models or machine learning algorithms to address specific business problems.Looking for a lead engineer for a data anawith good knowledge in Python Programming ,Experience in working with core data analytics libraries in Python (Pandas, Numpy). He / she should have Experience Web Frameworks & APIs (Flask, FastApi) and containerization , Docker. Experienced and having knowledge in building ETL pipelines, data engineering workflows and Data Visualization (spark, plotly, Dash, SQL) Experience in wo...

Job Requirements Perform statistical analysis, identify trends, patterns, and anomalies within datasets using Python libraries such as NumPy, SciPy, and Scikit-learn. Develop and implement predictive models or machine learning algorithms to address specific business problems.Looking for a lead engineer for a data anawith good knowledge in Python Programming ,Experience in working with core data analytics libraries in Python (Pandas, Numpy). He / she should have Experience Web Frameworks & APIs (Flask, FastApi) and containerization , Docker. Experienced and having knowledge in building ETL pipelines, data engineering workflows and Data Visualization (spark, plotly, Dash, SQL) Experience in wo...

The Solution Architect will be responsible for defining the overall architecture and ensuring seamless integration of the C&P platform with the new department. This includes designing scalable solutions using Java Spring Boot, Kafka, APIs, and Databricks, optimizing system performance, ensuring security and compliance, and addressing technical challenges. The role will involve collaborating with stakeholders, guiding development teams, and making key architectural decisions to support future enhancements and scalability. Deploying consent and preferences platform to another division Roles and Responsibilities Optimize Java-based APIs and Kafka consumers to handle large-scale consent and pref...

Role: DataBricks Engineer Notice Period: Immediate joiners only Location: Pune Work Mode: Hybrid Position Overview: We need a skilled Databricks Data Engineer with strong analytical and troubleshooting abilities. The ideal candidate should have hands-on experience in building scalable data pipelines using PySpark on cloud platforms like Azure/AWS along with a solid hands-on experience on ETL tools like Informatica PC/SSIS/DataStage, and relational databases. Mandatory skills needed: 1) Strong hands-on experience with Databricks - PySpark notebooks and Datbricks pipeline development 2) Experience using PySpark with Databricks 3) Strong understanding of SQL and query optimization techniques. 4...

Role & responsibilities Description - External Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by inclusion, talented peers, comprehensive benefits and career development opportunities. Come make an impact on the communities we serve as you help us advance health optimization on a global scale. Join us to start Caring. Connecting. Growing together. Primary Responsibilities: The profile requires the applicant to fulf...

Responsibilities: * Deploy, Configure & Manage AWS data bricks clusters * Optimize performance through tuning & scaling * Collaborate with cross-functional teams Note:Candidate with no prior Databricks admin hands on exp need not apply Work from home

Would being part of a digital transformation excite you Are you passionate about infrastructure security Join our digital transformation team operating at the heart of the digital transformation of our business. Our team is responsible for cybersecurity, architecture, and data protection for our global organization, advising on the design and validation of systems, infrastructure, technologies, and data protection. As a Senior Infrastructure Architect, you will participate in domain technical and business discussions, assist in analysis, design, and development of roadmap and implementation, gather and analyze data, develop architectural requirements, participate in the infrastructure archit...

Role & responsibilities Data Engineer role is to design, build, and maintain scalable data pipelines and infrastructure that ensure reliable, efficient, and secure data flow across systems to support analytics, reporting, and decision-making. Skills : Python, SQL, RESTful APIs, Databricks, Apache Spark, Cloud Platform (Azure)

Position Overview We are looking for an experienced Data Engineer to design and implement a scalable data platform using Databricks . The ideal candidate will have strong expertise in building modern data architecture, integrating diverse data sources (SQL Server, MongoDB, InfluxDB), and enabling analytics and reporting use cases. Key Responsibilities Design, build, and maintain a robust data platform on Databricks. Develop efficient ETL/ELT pipelines to ingest data from SQL Server, MongoDB, and InfluxDB into Databricks Delta Lake. Implement real-time and batch data ingestion strategies using tools such as Kafka, Azure Event Hubs, or similar. Optimize data storage and processing for performa...

At EY, you'll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture, and technology to become the best version of you. And we're counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all. As part of our GDS Consulting team, you will be part of NCLC team delivering specific to Microsoft account. You will be working on latest Microsoft BI technologies and will collaborate with other teams within Consulting services. The opportunity We're looking for resources with expertise in Microsoft BI, Power BI, Azure Data Factory, Data Br...

Job Title: Azure DevOps engineer with Data Engineering capabilities Experience: 4-8 years Location: Pan India Employment Type: Full-Time Technology: Azure DevOps, Terraform, CI/CD, Azure Kubernetes, Kubernetes, Docker, Databricks, ADF, Synapse Key Responsibilities: Job Description: Experience working with cloud-based database platforms such as Azure Synapse Analytics, Azure SQL Database, and Snowflake to enable scalable data warehousing and analytics solutions. Design and develop scalable data pipelines leveraging Azure Data Factory, Azure Databricks, and Synapse Analytics for efficient data ingestion and transformation. Implement ETL workflows to extract data from diverse sourcesincluding r...

Overview Software Engineer - SaaS Platform Team This is an opportunity to join a growing team in a dynamic new business opportunity within Zebra. Zebra Technologies located in Bangalore revolutionizes the way work is done in large warehouses and distribution centers with innovative robotic solutions. Our team members include robotics and software experts with multidisciplinary backgrounds. We are seeking software engineers to join the Zebra Team! As the key backend developer, you will be asked to interpret the business requirements as provided by the product owner and translate those requirements into a design, an application and supporting DB schema. Careful design with solid implementation...

Databricks Developer (5–7 yrs exp) skilled in Apache Spark, Design & Implementation, PySpark, Delta Lake, and cloud platforms (Azure/AWS). Must excel in data pipelines, ETL, governance, and performance tuning. Unity Catalog, ML, and CI/CD experience.

Experience: 5-12 Years Location: Bangalore Employment Type: Full-time Job Summary: We are looking for an experienced ETL/SQL/Python Testing Engineer to design, develop, and execute test cases for data pipelines, ETL processes, and database systems. The ideal candidate should have strong expertise in SQL querying, ETL validation, Python scripting, and test automation to ensure data accuracy, completeness, and performance. Technical Skills Required: - ETL Testing: Strong experience in testing Informatica, Talend, SSIS, Databricks, or similar ETL tools. - SQL: Advanced SQL skills (joins, aggregations, subqueries, stored procedures). - Python: Proficiency in Python for test automation (Pandas, P...

Lead Software Engineer - Apache Nifi, Python, PySpark, Hadoop, Cloudera platforms, and Airflow Title and Summary Lead Software Engineer - Apache Nifi, Python, PySpark, Hadoop, Cloudera platforms, and AirflowWho is Mastercard? Mastercard is a global technology company in the payments industry. Our mission is to connect and power an inclusive, digital economy that benefits everyone, everywhere by making transactions safe, simple, smart, and accessible. Using secure data and networks, partnerships and passion, our innovations and solutions help individuals, financial institutions, governments, and businesses realize their greatest potential. Our decency quotient, or DQ, drives our culture and e...