6143 Data Bricks Jobs - Page 34

We are looking for a skilled Lead Analyst-ETL Developer with expertise in Databricks, Kimball, Power BI, and MS Fabric to join our team. The ideal candidate will have a strong background in ETL development and data analysis. Roles and Responsibility Design, develop, and implement ETL processes using various tools and technologies. Collaborate with cross-functional teams to identify business requirements and develop solutions. Develop and maintain databases, data warehouses, and data lakes. Analyze complex data sets to identify trends, patterns, and insights. Create reports and dashboards using Power BI and other visualization tools. Ensure data quality, integrity, and security. Job Requireme...

Job Description: A strong Azure Data Engineer with deep hands-on experience in Databricks, ADF, Spark, and Azure storage/DevOps, capable of designing and deploying large-scale data solutions in an Agile cloud environment, with bonus skills in Kafka and ETL tools. Responsibilities: Spark (Scala/Python), Azure , Databricks, Kafka High proficiency and 6 to10 years of experience in designing/developing data analytics and data warehouse solutions with azure data factory (ADF) and azure data bricks. Experience in designing large data distribution, integration with service-oriented architecture and/or data warehouse solutions, data lake solution using azure data bricks with large and multi-format d...

Role & responsibilities Technologies: Azure Data Factory, Data Bricks, SQL, Azure DevOps, Azure Azure Devops, gitlab, Power BI Key Responsibilities : Design and implement Extract, Transform, Load (ETL) processes to move data from various sources (on-premises, cloud, and third-party APIs) to Azure data platforms. Integrate data from diverse sources into Azure-based systems like Azure Data Lake/Azure SQL Database. Use Azure Data Factory or Data Bricks orchestration tools to automate and schedule data pipelines/Job workflows Design efficient data models (e.g., star or snowflake schema) for use in analytical applications and reporting systems. Optimize SQL queries and scripts for performance, en...

JD:-Must Have: 1. MLOPS- deployent expirence 2. Machine Learning -Algorithms 3. Python - NumPy, Pandas 3. Statistics 4. Keras, Tensors, Pytorch 5. SQL 6. Azure or AWS Good to Have: 1. Computer vision 2. Anomaly detection 3. Data Bricks Key Responsibilities Model Development & Engineering Build, train, and optimize machine learning models. Collaborate with data scientists to refine model logic and performance. Implement feature engineering pipelines and model versioning. MLOps & Deployment Design and manage CI/CD pipelines for ML workflows. Deploy ML models to production (on cloud/on-prem). Monitor model performance, drift, accuracy, and system health. Automate retraining, logging, and model ...

Urgent hiring for a ClickHouse Pro at Kognitive Networks We're building the connectivity brain for the AI-everywhere world massive data, real-time analytics, and smart networks that power ships, planes, and remote sites across the globe. Now were looking for a ClickHouse (or OLAP/vector DB) expert who loves fast queries, big data, and clean design. If youve scaled multi-TB databases, tuned performance until it sings, and enjoy working across front- and back-ends — we want to talk. What you’ll do: Architect and optimize large-scale ClickHouse or OLAP databases Design for speed, reliability, and insights — not just tables and joins Integrate with our analytics, dashboards, and AI pipelines Lea...

Databrick Architect - Solution Architect : Databricks Certifcations Is Mandatory. Databricks Technical Architect

Job Type: Full-Time Experience Level: 6-10 Years About the Role: We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. The ideal candidate will have a strong background in Python, Azure, CI/CD, deployment, and writing efficient data pipelines. You will be responsible for designing, developing, and maintaining robust data infrastructure and pipelines that support our data-driven decision-making processes. Key Responsibilities: AI Integration: Implement LLM-based workflows, RAG pipelines, and agentic orchestration using frameworks like LangChain, LangGraph, CrewAI, or similar. Data Pipeline Development: Design, develop, and maintain efficient and scalab...

Warm Greetings from SP Staffing!! Role: Azure Data Engineer Experience Required :5 to 7 yrs Work Location :Pune/Mumbai/Bangalore/BBSR/Kolkata Required Skills, Azure Databricks Pyspark Interested candidates can send resumes to nandhini.spstaffing@gmail.com

Job description Hiring for Azure Databrick Engineer Mandatory Skills: Databrick, Data lake, Azure Responsibilities A day in the life of an Infoscion As part of the Infosys consulting team, your primary role would be to actively aid the consulting team in different phases of the project including problem definition, effort estimation, diagnosis, solution generation and design and deployment You will explore the alternatives to the recommended solutions based on research that includes literature surveys, information available in public domains, vendor evaluation information, etc. and build POCs You will create requirement specifications from the business needs, define the to-be-processes and d...

Job description Hiring for Azure Databrick Engineer Mandatory Skills: Databrick, Data lake, Azure Responsibilities A day in the life of an Infoscion As part of the Infosys consulting team, your primary role would be to actively aid the consulting team in different phases of the project including problem definition, effort estimation, diagnosis, solution generation and design and deployment You will explore the alternatives to the recommended solutions based on research that includes literature surveys, information available in public domains, vendor evaluation information, etc. and build POCs You will create requirement specifications from the business needs, define the to-be-processes and d...

Hi, This is regarding a job opportunity for the position of Senior Software Engineer Interop with our client (US Based Health Care Domain client) . This opportunity is under the direct pay roll of (US Based Health Care Domain client) . Job Title: Senior Software Engineer Interop Location: Mysuru, Karnataka Mode of Work: Work From Office (WFO) 5 days a week Shift Timings: 1:00 PM to 10:00 PM Employment Type: Full-time (Direct Payroll of US Based Product Company) About the Company Join a leading product company in the US healthcare domain that is transforming the healthcare payer industry. The organization focuses on creating personalized patient experiences, improving health outcomes, and red...

Job Title: Data Engineer Location: Kolkata, India Experience: Minimum 5 years in Data Engineering Joining: Immediate Job Description: We are looking for a skilled Data Engineer to design, build, and maintain scalable data architectures and pipelines. The ideal candidate will have hands-on experience in data transformation, data lake solutions, and analytics enablement, along with strong problem-solving and collaboration skills. Key Responsibilities: Develop & Maintain: Design, build, and maintain scalable data architectures and pipelines to support analytics and business requirements. Ensure proper documentation of solutions. Monitor & Troubleshoot: Support stakeholders with data issues, mon...

If interested please share your resume to contact@integeltechnology.com Experience: 3 to 8 Years Job Location: Hyderabad, Chennai, Bangalore Employment Type: Full Time Interview Mode: Virtual Job Description: We are hiring experienced professionals in Data Engineer. Candidates with 3 - 8 years of experience, strong analytical skills, and a passion for technology are encouraged to apply. Roles & Responsibilities Design, build, and maintain ETL/ELT data pipelines for batch and real-time processing. Develop scalable data workflows using Python, SQL, PySpark/Spark SQL . Implement and manage data lakes and data warehouses (Snowflake, Redshift, BigQuery, Synapse). Integrate data from multiple sour...

About the Role We are looking for a Senior Data Engineer I with 7 to 10 years of experience to lead cloud-based data engineering initiatives. This role includes project execution, presales involvement, stakeholder management, and guiding small teams within larger data platform engagements. What You'll Do & The Impact You'll Have Participate in RFI/RFP processes, contribute to proposals, and help define SOWs. Apply industry expertise (Telco, Banking, FSI) to deliver business-relevant solutions. Lead small teams or workstreams (35 members) within larger data platform projects. Collaborate with stakeholders to handle escalations, risk assessments, and resolve project issues. Maintain a Cloud Da...

ob Title: Senior Data Engineer Location: Bangalore, Chennai, Hyderabad, Pune Job Type: Full-Time Experience Level: 6-10 Years About the Role: We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. The ideal candidate will have a strong background in Python, Azure, CI/CD, deployment, and writing efficient data pipelines. You will be responsible for designing, developing, and maintaining robust data infrastructure and pipelines that support our data-driven decision-making processes. Qualifications: Education: Bachelor's or Master's degree in Computer Science, Information Technology, or equivalent in related field. Experience: 6-8 years of experience in d...

Role & responsibilities Job Title: Technical Lead Analytics Role Overview: We are seeking an experienced Technical Lead to oversee the technical delivery and solution architecture for data analytics and engineering projects within our Analytics Department. The ideal candidate will bring strong technical expertise in SQL, Python, Azure Data Flows, and Power BI , combined with hands-on experience guiding teams through end-to-end project execution from data ingestion and transformation to visualization and reporting. This is a senior, client-facing role responsible for providing technical direction, mentoring the team, and ensuring high-quality delivery across multiple projects. Key Responsibil...

Job Location: Kochi Looking for Immediate joiners only Qualifications: 8+ years of experience in data engineering, with a focus on scalable architecture design. Strong proficiency in Python, PySpark, Python-based UI libraries and Gradio or Streamlit. Strong proficiency in Python, especially in Pandas and NumPy. Strong proficiency in Databricks environment and Native Apps Hands-on experience with Databricks (notebooks, jobs, lakehouse architecture). Role & responsibilities Analyze existing SAS web-based forecasting and reporting applications. Convert SAS stored processes and PROC logic into PySpark equivalent Native Apps. Translate SAS data handlers and preprocessing routines to Python-based ...

Skill: Pyspark + Databricks Experience : 4 to 9 Years Location : AIA - Bangalore Job Summary We are seeking a highly skilled Technical Lead with 4 to 9 years of experience to join our dynamic team. The ideal candidate will have expertise in Databricks Workflows Unity Catalog and Databricks with a preference for experience in Research and Development. This hybrid role offers the opportunity to work on cutting-edge projects during day shifts with no travel required. Responsibilities Lead the design and implementation of scalable data solutions using Databricks Workflows to enhance data processing capabilities. Oversee the integration of Databricks Unity Catalog to ensure seamless data governan...

Skill: Azure Data bricks Experience: 4 to 9 years Location: AIA Bangalore Job Summary We are seeking a highly skilled Sr. Developer with 7 to 10 years of experience to join our dynamic team. The ideal candidate will have expertise in Databricks SQL Databricks Delta Lake Databricks Workflows and PySpark. This role involves working in a hybrid model with day shifts focusing on developing and optimizing data solutions to drive business success. Secondary Skill - SQL and ETL development Responsibilities Develop and implement data solutions using Databricks SQL to enhance data processing capabilities. Optimize data storage and retrieval processes with Databricks Delta Lake for improved performanc...

Skill: Azure Databricks Experience: 4 to 9 years Location: AIA Chennai Job Summary We are seeking a Sr. Developer with 6 to 10 years of experience to join our team. The ideal candidate will have expertise in Databricks SQL Delta Lake Workflows and PySpark. This role involves working in a hybrid model during day shifts focusing on developing and optimizing data solutions. Experience in Research and Development Manufacturing or Supply Chain is a plus. Responsibilities Develop and optimize data solutions using Databricks SQL to enhance data processing capabilities. Implement and manage Databricks Delta Lake to ensure efficient data storage and retrieval. Design and automate workflows using Data...

Dear Candidates, Greetings from Sunware Technologies! Hiring - Senior Databricks Experts! (6 to 10 Years) If Databricks is your playground, this is the opportunity youve been waiting for! Responsibilities: Design, develop, optimize & support data pipelines in Databricks Work with Python, PySpark, Azure/AWS/GCP Build CI/CD pipelines with GitHub & GitHub Actions Implement Databricks Jobs, Bundles, Orchestrations Follow Agile & DevOps practices Improve performance, scalability & cost efficiency Troubleshoot issues & remove technical blockers Contribute to coding standards & best practices Mandatory Skills: Strong hands-on Databricks + PySpark Strong Python coding Cloud: Azure / AWS / GCP Data l...

Our Client(BFSI sector) hiring for Data Engineer at Pune Only imm joiners Min 4+ yrs exp as Data Engineer End-to-end data architecture and complex pipelines Skills:Databricks,SQL,Power BI CTC: 10 to 13 LPA Interested call or Whatsapp to 9037097978

Job responsibilities : Lead execution of initial queries and feasibility requests Be at the forefront of understanding what life science companies are interesting in leveraging real-world data for Inform in a data-driven whether like questions are a good match and well aligned Present and communicate findings to internal partners, supporting decision-making and innovation Contribute to a culture of learning and scientific rigor, continuously improving methodological standards Skills and Experience that Will Help You Succeed Proven expertise coding and analyzing healthcare datasets to generate metrics based on real-world data Demonstrated ability to execute implementation requirements that in...

Role & responsibilities Expert in Python, PySpark, SQL Azure Databricks , Unity Catalog, Delta Live Tables Data Modelling & Medallion Architecture ETL pipeline design & development Azure Data Factory Azure DevOps Logging & Monitoring using Azure / Databricks Strong understanding of software engineering best practices Nice-to-Have Skills Azure Synapse, Fabric, PowerBI Azure Functions, Azure Logic Apps GCP & AWS cloud services knowledge Azure Networking Databricks Online Tables Jira Shell scripting / Azure CLI Key Responsibilities Design, develop, and maintain scalable data pipelines and ETL processes Build high-performing big data solutions using Azure & Databricks Monitor and optimize data i...

Sr Data Engineer SR DE-I Highly skilledDataEngineerwith minimum 5+ years of relevant experience in SQL, PySpark, ETL,DataLakes and Azure Tech Stack. Responsibilities 3+ years of experience in buildingdataPipelines with Python/PySpark. 4+ years of experience in Azure ETL stack ( eg. Blog Storage,DataLake,DataFactory, Synapse). 4+ years of experience with SQL. Proficient understanding of code versioning tools such as Git and PM tool like Jira. Qualifications Excellent verbal and written communication skills. UG: B.Sc in Any Specialization, BCA in Any Specialization, B.Tech/B.E. in Any Specialization. A good internet connection is a must. Azure certifications will be a bonus