2919 Data Bricks Jobs

Role: AWS Data Engineer Skills: AWS Cloud, Data Bricks, AWS services, Pyspark, RedShift, SQL , Data Warehouse, Apache Spark, ETL Location: Hyderabad, Chennai, Bangalore, Pune, Mumbai, Delhi, Kolkata, Indore, Noida, Gurugram Roles and Responsibilities : Strong hands-on experience in Python programming and PySpark Experience using AWS services (RedShift, Glue, EMR, S3 & Lambda) Experience working with Apache Spark and Hadoop ecosystem. Experience in writing and optimizing SQL for data manipulation Good Exposure to scheduling tools. Airflow is preferable. Data Warehouse Experience with AWS Redshift or Hive Experience in implementing security measures for data protection. Expertise to build/test...

Role: Backend Developer - Python Experience: 8 -10 Year Salary: 8 -12 LPA Notice: Immediate/ 15 Days Notice Location : Chennai We Need Candidate From Tamil Nadu Only Skill: FastAPI, Rest API,Databricks,AWS,Accessing Data from APIs ,Python,SQL Backend

Position: Databricks/Cloud Devops Engineer Location: Offshore (India) Job Description: Works with developers and the IT staff to oversee the code releases, combining an understanding of both engineering and coding. From creating and implementing systems software to analyzing data to improve existing ones, a DevOps Engineer increases productivity in the workplace. The DevOps Engineer will serve as a Databricks Subject Matter Expert, enabling and automating infrastructure tasks both via the Databricks UI and through code-based approaches (e.g., Terraform, Databricks CLI, REST APIs). This role requires strong expertise in Azure infrastructure and networking, and a solid understanding of DevOps ...

SparkBeyond is a leader in using AI for Enterprise KPI optimization, having delivered 100s of complex Enterprise KPI optimization solutions over the past decade As we move into the new era of GenAI enabled enterprises, SparkBeyond is hiring a Data Scientist to join our client-facing team to deliver outstanding value to our customers Candidates will have proven experience in leading the delivery of end to end technical solutions and operating in complex business environments, What will you need 3 5 years of data science work experience, Experience of successful delivery within a Banking or Telecoms environment, Experience with large datasets and distributed computing (Spark, Data Bricks) Cust...

Role Description: Data Engineer Big Data The ideal candidate is a hands-on technology developer with experience in developing scalable applications and platforms They must be at ease working in an agile environment with little supervision The person should be a self-motivated person with a passion for problem solving and continuous learning Role and responsibilities Strong technical, analytical, and problem-solving skills Strong organizational skills, with the ability to work autonomously as well as in a team-based environment Data pipeline framework development Technical skills requirements The candidate must demonstrate proficiency in, CDH On-premise for data processing and extraction Abil...

Proven experience as a Data Solutions Architect or in a similar role. Strong expertise in Azure cloud services (Data Factory, Synapse, Databricks, Cosmos DB, etc.). Data modeling, data integration data governance, security, and frameworks. Health insurance Annual bonus

Dear Candidate, Greetings from Buzzworks! We are hiring Azure Databricks Engineer for one of our Tier 1 MNC across locations. Role: Azure Databricks Engineer Exp: 5+ yrs Location: Chennai, Bangalore, Coimbatore Note: We are looking for resources who are available on immediate notice and available for to take up Virtual Interview on 22nd Sep. JD: Key Responsibilities: Develop and optimize data pipelines using Azure Databricks , Delta Lake , and Python Design and implement ETL/ELT processes for large-scale data processing Work with Azure Data Lake , Azure Data Factory , and Spark Perform data cleansing, transformation, and validation Collaborate with data scientists and business teams to deliv...

5+ Years of prior experience in Data Engineering and MLOPs. 3+ Years of strong exposure in deploying and managing data science pipelines in production environments. Strong proficiency in Python programming language. Experience with Spark/PySpark and distributed computing frameworks. Hands-on experience with CI/CD pipelines and automation tools. Exposure in deploying a use case in production leveraging Generative AI involving prompt engineering and RAG Framework Familiarity with Kafka or similar messaging systems. Strong problem-solving skills and the ability to iterate and experiment to optimize AI model behavior. Excellent problem-solving skills and attention to detail. Ability to communica...

Job Description Associate Technical Architect (Azure Data Engineering) Experience: 10+ Years Location: Bangalore / Mumbai / Pune Must Have Skills Database (SQL Server / Oracle / MySQL / Azure SQL DB / Cosmos DB etc.) Data Warehouse (Azure Synapse Analytics, Snowflake, etc.) ETL tools (two or more of Azure Data Factory, Azure Databricks, Azure Synapse Pipelines, Event Hub, Azure Stream Analytics, Azure Functions, etc.) Experience in Cloud platforms – Microsoft Azure Python, PySpark, UNIX shell scripting, Project & resource management SVN, GIT, JIRA, Automation workflow (Azure Data Factory orchestration, Apache Airflow, Tidal, Tivoli, or similar) Good to Have Skills UNIX shell scripting, Snowf...

YASH Technologies is a leading technology integrator specializing in helping clients reimagine operating models, enhance competitiveness, optimize costs, foster exceptional stakeholder experiences, and drive business transformation. At YASH, were a cluster of the brightest stars working with cutting-edge technologies. Our purpose is anchored in a single truth bringing real positive changes in an increasingly virtual world and it drives us beyond generational gaps and disruptions of the future. We are looking forward to hireAlation DQ Professionals in the following areas : Experience 5-8 Years Job Description Key Responsibilities 3-4 years exp into Alation DQ Tool exp Data Catalog Management:...

Data Engineer - 8+Years - Bangalore An exciting opportunity to join a global corporate services leader and drive best-in-class data engineering solutions. As a Data Engineer, you will be responsible for designing, developing, and implementing robust data pipelines, models, and architectures while ensuring seamless data integration and analytics for high-impact decision-making. Location: Bangalore Your Future Employer A high-growth organization known for delivering cutting-edge analytics and data engineering solutions. A people-first environment focused on innovation, collaboration, and continuous learning. Responsibilities Design, develop, and optimize ELT pipelines and workflows for large-s...

Who We Are At Kyndryl, we design, build, manage and modernize the mission-critical technology systems that the world depends on every day. So why work at Kyndryl? We are always moving forward – always pushing ourselves to go further in our efforts to build a more equitable, inclusive world for our employees, our customers and our communities. The Role Are you ready to embark on an exhilarating journey as a Data Consultant? Join Kyndryl and become a driving force behind the transformative power of data! We're seeking an exceptionally talented individual to accelerate the competitive performance of our customers worldwide, establishing us as their unrivaled business and technology consulting p...

Role Overview: We are looking for a Lead Data Engineer to own the end-to-end technical delivery of the Data Observability & Monitoring solution. This role involves designing the architecture, leading a small team of engineers, and working with stakeholders to ensure alignment between infrastructure metrics and business dashboards. Responsibilities: Own the architecture for the observability solution (ingestion, storage, serving layers). Lead a team of Data Engineers, reviewing code and ensuring best practices. Define strategy for integrating infrastructure metrics (cost, uptime, CPU, memory) into Delta Lake. Collaborate with Solution Architect (you) to design client-ready dashboards. Establi...

Test Planning and Execution Review technical specifications and data model designs to develop comprehensive test plans and test cases. Execute functional, regression, and integration testing for new data products, transformation logic, and platform enhancements. Validate SQL-based transformations and logic implemented in Azure SQL and Databricks. Data Validation Write SQL queries to validate data transformations, joins, filters, aggregations, and calculations across staging, transformation, and reporting layers. Compare results between source systems and final data products for accuracy and completeness. Ensure data reconciliation and integrity across pipelines and versions. Issue Tracking a...

Collaborate with business analysts and stakeholders to understand business processes and requirements, translating them into data modeling solutions. Design and develop logical and physical data models that effectively capture the granularity of data necessary for analytical and reporting purposes. Migrate and optimize existing data models from traditional on-premises data stores to Azure/Databricks cloud environments, ensuring scalability and performance. Establish data modeling standards and best practices to maintain the integrity and consistency of the data architecture. Work closely with data engineers and BI developers to ensure that the data models support the needs of analytical and ...

BI Development & Data Storytelling Design, build, and maintain BI dashboards and reports using curated datasets. Translate data into actionable insights that inform strategic and operational decisions. Partner with business teams to define KPIs and performance metrics. Data Curation & Quality Work with data engineering and data quality teams to ensure curated datasets are accurate, consistent, and business-ready. Contribute to defining and monitoring data quality metrics (accuracy, completeness, timeliness). Advocate for data governance best practices and maintain awareness of data lineage. AI & ML Alignment Collaborate with data science and ML teams to ensure curated datasets are suitable f...

Role Overview: We are seeking a seasoned Data Architect to design, implement, and optimize enterprise-wide data solutions for our large-scale retail/e-commerce business. The role involves driving the data strategy, building scalable data architectures, ensuring governance, and enabling advanced analytics and AI/ML use cases across omnichannel retail operations. Key Responsibilities: Data Strategy & Architecture Define and implement enterprise-level data architecture, models, and pipelines to support business intelligence, personalization, and real-time decision-making. Develop data lake, data warehouse, and data mesh architectures for structured, semi-structured, and unstructured data. Creat...

Job Description Develop and deliver robust machine learning solutions addressing diverse business challenges (forecasting, classification, optimization, automation) on the Azure Databricks platform. Own the full ML lifecycle: model development, deployment, monitoring, and retraining supported by standardized infrastructure and DevOps practices. Apply strong mathematical and problem-solving skills to translate complex business requirements into effective ML models. Collaborate with Product Owners, data engineers, DevOps, and architecture teams to build scalable, maintainable, and governed ML pipelines. Demonstrate curiosity and an iterative mindset, exploring alternative modeling approaches t...

About The Role : Job Title: Lead Engineer LocationPune, India Corporate TitleVP Role Description DWSs data infrastructure team provides the secure, scalable and trustworthy foundation for storing, processing and distributing critical enterprise data . As Lead Engineer, you drive the design, build, and continuous improvement of our cloud-based and on-prem core data applications. Youll lead a high-impact squad, setting technical direction, mentoring team members and contributing directly to architecture and code. What well offer you As part of our flexible scheme, here are just some of the benefits that youll enjoy Best in class leave policy Gender neutral parental leaves 100% reimbursement un...

Role Description Develop, schedule, and manage ETL processes using SSIS and Azure Data Factory (ADF) Build and optimize data models and OLAP cubes using SSAS and Azure Analysis Services Design and deploy reports using SSRS and Power BI Migrate on-premises SQL workloads to Azure SQL, Data Lake, and Synapse Build scalable data pipelines and processing workflows using Databricks (PySpark) Write complex T-SQL queries, stored procedures, functions, and triggers. Implement DevOps pipelines for data deployment and automation using Azure DevOps Collaborate with stakeholders to convert business requirements into technical solutions. Track and resolve issues through ServiceNow, JIRA, or ALM Maintain t...

We are looking forward to hirePySpark Professionals in the following areas : Experience: 3 to 7 years Location: Bangalore Job Description: Primary Skills - Big Data - PySpark + Databricks + AWS 3+ Years of experience in Design and implement data pipelines, ETL processes, and data storage solutions that support data-intensive applications 3+ years of experience in developing, testing, and maintaining architectures such as databases and large-scale data processing systems using tools such as Spark, Databricks and AWS Experience Python, Data structure and Algorithms 3+ years of experience in cloud development with the AWS platform 3+ years in designing and delivering Transactional, Warehouse, A...

Our Purpose Title and Summary Sr. Analyst, Master Data Management-1 About the Position The Sr. Analyst of Master Data Management (MDM) is responsible for leading the execution of Mastercards MDM strategy across the enterprise. This role is instrumental in shaping and implementing the strategic vision for MDM initiatives, ensuring alignment with broader enterprise data governance goals. In close partnership with business and technology stakeholders, the Sr. Analyst will operationalize MDM and governance practices to uphold the consistency, accuracy, and integrity of mastered data assets. This role demands strong cross-functional collaboration with stakeholders across Franchise, Product, Corpo...

If you like improving and impacting the business with a passion for accounting, reporting and analysis and innovation this could be your chance to make your mark in the energy industry. You will grow in a supportive team working for a significant Shell business powering the lives of millions and ensuring decisions are made based on accurate, timely and insightful analysis. Whats the role? The IGU Par Lead is expected to support the delivery of Performance & Appraisal reporting to one of the IGU organization. This role holder will help the organisation plan and manage their spend for maximum return. The role holder will be expected to render operational support to the month close and PAR rela...

Our Purpose We work to connect and power an inclusive, digital economy that benefits everyone, everywhere by making transactions safe, simple, smart, and accessible Using secure data and networks, partnerships and passion, our innovations and solutions help individuals, financial institutions, governments, and businesses realize their greatest potential Our decency quotient, or DQ, drives our culture and everything we do inside and outside of our company We cultivate a culture of inclusion for all employees that respects their individual strengths, views, and experiences We believe that our differences enable us to be a better team one that makes better decisions, drives innovation, and deli...

Job Summary Synechron is seeking a skilled Data Engineer experienced in Google Cloud Platform (GCP), Databricks, PySpark, and SQL. In this role, you will design, develop, and maintain scalable data pipelines and workflows to enable advanced analytics and business intelligence solutions. You will work within a collaborative environment to integrate diverse data sources, optimize data processing workflows, and ensure data quality and availability. Your contributions will support strategic decision-making and enhance the organizations data-driven initiatives. Software Requirements Required Skills: Hands-on experience with GCP services , specifically BigQuery , Cloud Storage , and Composer for d...