6138 Data Bricks Jobs - Page 27

Design scalable data pipelines in Databricks/Snowflake, build data models and ETL/ELT, optimize performance, ensure data quality, collaborate with Ad Sales teams, document workflows, manage offshore teams, and mentor junior engineers Required Candidate profile Expert in Snowflake, Databricks, SQL, cloud orchestration. Strong Ad Sales domain. Skilled in collaboration, leading offshore teams, CI/CD. CS degree with 10 yrs delivering scalable data solutions.

Job Description We are seeking a highly skilled Data Engineer with hands-on experience in Python, Apache technologies, and Apache Spark, along with strong expertise in Cloud Data Platforms and Modern Data Lake/Lakehouse architectures. The ideal candidate will be responsible for designing, building, and maintaining scalable data pipelines, supporting data ingestion, transformation, and analytics across the organization. Key Responsibilities Develop and optimize scalable ETL/ELT pipelines using Python and Spark. Design and implement data solutions leveraging Data Lake / Datalake / Delta Lake / Lakehouse architectures. Work with cloud data warehouses such as Amazon Redshift, Snowflake, or Postg...

ACG is the worlds only integrated pharma manufacturing solutions company. We are headquartered in Mumbai , India. ACG has a presence in over 100 countries with its products and services that strive to provide world-class technology across multiple domains. We offer a complete range of solutions beginning with empty capsules; granulation and tablet coating; capsule filling; tabletting; packaging films; blister packing and carton packing to the end-of-line solutions and track and trace systems. Role & responsibilities As a Senior Data Science & AI Engineer (Solution Architect), you will play a key role in designing, building, and scaling data-driven AI systems that integrate industrial IoT, SA...

Job Summary Azure Big Data Engineer role involves building scalable data ingestion pipelines for batch and streaming datasets using Azure technologies like ADF, PySpark, and Databricks. Requires 4-9 years IT experience, including 2+ years in big data engineering on Azure. Focuses on data processing, orchestration, collaboration with data science and app dev teams, and delivering analytics solutions. Job Description Design and build metadata-driven data ingestion pipelines for structured/unstructured data, including harmonization and high-performance processing. Schedule, orchestrate, validate pipelines; handle exceptions, log monitoring, and debugging for reliable operations. Collaborate wit...

Responsibilities: * Design data solutions using Azure Databricks, Synapse & DW. * Collaborate with cross-functional teams on project delivery. * Optimize performance through data modeling and ETL processes.

Preferred candidate profile Hands-on experience in Azure stack (Azure Data Lake, Azure Data Factory, Azure Databricks ) -- Mandatory Good understanding of Azure Databricks platform and can build data analytics solutions to support the required performance & scale Good understanding of other Azure services like Azure Data Lake Analytics & U-SQL, Azure SQL DW Demonstrated analytical and problem-solving skills, particularly those that apply to a big data environment Good knowledge of Data Warehousing concepts & Data Modelling Should have experience working on complex data architecture Experience in working for a Lifes science / Pharma client is a plus Working experience in ETL testing including...

Preferred candidate profile Hands-on experience in Azure stack (Azure Data Lake, Azure Data Factory, Azure Databricks ) -- Mandatory Good understanding of Azure Databricks platform and can build data analytics solutions to support the required performance & scale Good understanding of other Azure services like Azure Data Lake Analytics & U-SQL, Azure SQL DW Demonstrated analytical and problem-solving skills, particularly those that apply to a big data environment Good knowledge of Data Warehousing concepts & Data Modelling Should have experience working on complex data architecture Experience in working for a Lifes science / Pharma client is a plus Working experience in ETL testing including...

Preferred candidate profile Hands-on experience in Azure stack (Azure Data Lake, Azure Data Factory, Azure Databricks ) -- Mandatory Good understanding of Azure Databricks platform and can build data analytics solutions to support the required performance & scale Good understanding of other Azure services like Azure Data Lake Analytics & U-SQL, Azure SQL DW Demonstrated analytical and problem-solving skills, particularly those that apply to a big data environment Good knowledge of Data Warehousing concepts & Data Modelling Should have experience working on complex data architecture Experience in working for a Lifes science / Pharma client is a plus Working experience in ETL testing including...

Role & responsibilities Job Overview: We are looking for a Senior Data Engineer with strong expertise in SQL, Python, Azure Synapse, Azure Data Factory, Snowflake, and Databricks . The ideal candidate should have a solid understanding of SQL (DDL, DML, query optimization) and ETL pipelines while demonstrating a learning mindset to adapt to evolving technologies. Key Responsibilities: Collaborate with business and IT stakeholders to define business and functional requirements for data solutions. Design and implement scalable ETL/ELT pipelines using Azure Data Factory, Databricks, and Snowflake . Develop detailed technical designs, data flow diagrams, and future-state data architecture . Evang...

Role & responsibilities Job Overview: We are looking for a Senior Data Engineer with strong expertise in SQL, Python, Azure Synapse, Azure Data Factory, Snowflake, and Databricks . The ideal candidate should have a solid understanding of SQL (DDL, DML, query optimization) and ETL pipelines while demonstrating a learning mindset to adapt to evolving technologies. Key Responsibilities: Collaborate with business and IT stakeholders to define business and functional requirements for data solutions. Design and implement scalable ETL/ELT pipelines using Azure Data Factory, Databricks, and Snowflake . Develop detailed technical designs, data flow diagrams, and future-state data architecture . Evang...

Role & responsibilities Job Overview: We are looking for a Senior Data Engineer with strong expertise in SQL, Python, Azure Synapse, Azure Data Factory, Snowflake, and Databricks . The ideal candidate should have a solid understanding of SQL (DDL, DML, query optimization) and ETL pipelines while demonstrating a learning mindset to adapt to evolving technologies. Key Responsibilities: Collaborate with business and IT stakeholders to define business and functional requirements for data solutions. Design and implement scalable ETL/ELT pipelines using Azure Data Factory, Databricks, and Snowflake . Develop detailed technical designs, data flow diagrams, and future-state data architecture . Evang...

Role & responsibilities Job Overview: We are looking for a Senior Data Engineer with strong expertise in SQL, Python, Azure Synapse, Azure Data Factory, Snowflake, and Databricks . The ideal candidate should have a solid understanding of SQL (DDL, DML, query optimization) and ETL pipelines while demonstrating a learning mindset to adapt to evolving technologies. Key Responsibilities: Collaborate with business and IT stakeholders to define business and functional requirements for data solutions. Design and implement scalable ETL/ELT pipelines using Azure Data Factory, Databricks, and Snowflake . Develop detailed technical designs, data flow diagrams, and future-state data architecture . Evang...

Role & responsibilities Job Overview: We are looking for a Senior Data Engineer with strong expertise in SQL, Python, Azure Synapse, Azure Data Factory, Snowflake, and Databricks . The ideal candidate should have a solid understanding of SQL (DDL, DML, query optimization) and ETL pipelines while demonstrating a learning mindset to adapt to evolving technologies. Key Responsibilities: Collaborate with business and IT stakeholders to define business and functional requirements for data solutions. Design and implement scalable ETL/ELT pipelines using Azure Data Factory, Databricks, and Snowflake . Develop detailed technical designs, data flow diagrams, and future-state data architecture . Evang...

Role & responsibilities Job Overview: We are looking for a Senior Data Engineer with strong expertise in SQL, Python, Azure Synapse, Azure Data Factory, Snowflake, and Databricks . The ideal candidate should have a solid understanding of SQL (DDL, DML, query optimization) and ETL pipelines while demonstrating a learning mindset to adapt to evolving technologies. Key Responsibilities: Collaborate with business and IT stakeholders to define business and functional requirements for data solutions. Design and implement scalable ETL/ELT pipelines using Azure Data Factory, Databricks, and Snowflake . Develop detailed technical designs, data flow diagrams, and future-state data architecture . Evang...

Senior Software Engineer JLL Technologies, Bangalore We are seeking an experienced Backend Developer with strong expertise in the Java ecosystem to join our team. This role requires a solid technical foundation in building scalable, distributed systems and will involve working with building management systems while supporting our production environment across global time zones. Key Responsibilities Design, develop and maintain backend services with a focus on API development and WebSocket implementations that can handle heavy traffic and scale efficiently Build robust, scalable Java applications using Spring Boot, Spring Framework, and related technologies Develop and deploy microservices in...

Role & responsibilities We are looking for a Senior Data Engineer with strong expertise in SQL, Python, Azure Synapse, Azure Data Factory, Snowflake, and Databricks . The ideal candidate should have a solid understanding of SQL (DDL, DML, query optimization) and ETL pipelines while demonstrating a learning mindset to adapt to evolving technologies. Key Responsibilities: Collaborate with business and IT stakeholders to define business and functional requirements for data solutions. Design and implement scalable ETL/ELT pipelines using Azure Data Factory, Databricks, and Snowflake . Develop detailed technical designs, data flow diagrams, and future-state data architecture . Evangelize modern d...

Role & responsibilities We are looking for a Senior Data Engineer with strong expertise in SQL, Python, Azure Synapse, Azure Data Factory, Snowflake, and Databricks . The ideal candidate should have a solid understanding of SQL (DDL, DML, query optimization) and ETL pipelines while demonstrating a learning mindset to adapt to evolving technologies. Key Responsibilities: Collaborate with business and IT stakeholders to define business and functional requirements for data solutions. Design and implement scalable ETL/ELT pipelines using Azure Data Factory, Databricks, and Snowflake . Develop detailed technical designs, data flow diagrams, and future-state data architecture . Evangelize modern d...

Role & responsibilities We are looking for a Senior Data Engineer with strong expertise in SQL, Python, Azure Synapse, Azure Data Factory, Snowflake, and Databricks . The ideal candidate should have a solid understanding of SQL (DDL, DML, query optimization) and ETL pipelines while demonstrating a learning mindset to adapt to evolving technologies. Key Responsibilities: Collaborate with business and IT stakeholders to define business and functional requirements for data solutions. Design and implement scalable ETL/ELT pipelines using Azure Data Factory, Databricks, and Snowflake . Develop detailed technical designs, data flow diagrams, and future-state data architecture . Evangelize modern d...

Role & responsibilities SQL Expertise Strong hands-on experience with DDL, DML, query optimization, and performance tuning . Programming Languages – Proficiency in Python or Java for data processing and automation. Data Modelling – Good understanding of entity-relationship modelling, star schema, and Kimball methodology . Cloud Data Engineering – Hands-on experience with Azure Synapse, Azure Data Factory, Azure Data Lake, Databricks and Snowflake ETL Development – Experience building scalable ETL/ELT pipelines and data ingestion workflows. Ability to learn and apply Snowflake concepts as needed. Communication Skills : Strong presentation and communication skills to engage both technical and ...

Role & responsibilities SQL Expertise Strong hands-on experience with DDL, DML, query optimization, and performance tuning . Programming Languages – Proficiency in Python or Java for data processing and automation. Data Modelling – Good understanding of entity-relationship modelling, star schema, and Kimball methodology . Cloud Data Engineering – Hands-on experience with Azure Synapse, Azure Data Factory, Azure Data Lake, Databricks and Snowflake ETL Development – Experience building scalable ETL/ELT pipelines and data ingestion workflows. Ability to learn and apply Snowflake concepts as needed. Communication Skills : Strong presentation and communication skills to engage both technical and ...

Role & responsibilities SQL Expertise Strong hands-on experience with DDL, DML, query optimization, and performance tuning . Programming Languages – Proficiency in Python or Java for data processing and automation. Data Modelling – Good understanding of entity-relationship modelling, star schema, and Kimball methodology . Cloud Data Engineering – Hands-on experience with Azure Synapse, Azure Data Factory, Azure Data Lake, Databricks and Snowflake ETL Development – Experience building scalable ETL/ELT pipelines and data ingestion workflows. Ability to learn and apply Snowflake concepts as needed. Communication Skills : Strong presentation and communication skills to engage both technical and ...

Role & responsibilities Design, develop, and maintain scalable and robust data pipelines on Databricks. Collaborate with data scientists and analysts to understand data requirements and deliver solutions. Optimize and troubleshoot existing data pipelines for performance and reliability. Ensure data quality and integrity across various data sources. Implement data security and compliance best practices. Monitor data pipeline performance and conduct necessary maintenance and updates. Document data pipeline processes and technical specifications. Qualifications 5+ years of experience in data engineering. Proficiency with Databricks and python. Strong SQL skills and experience with relational da...

Role & responsibilities Design, develop, and maintain scalable and robust data pipelines on Databricks. Collaborate with data scientists and analysts to understand data requirements and deliver solutions. Optimize and troubleshoot existing data pipelines for performance and reliability. Ensure data quality and integrity across various data sources. Implement data security and compliance best practices. Monitor data pipeline performance and conduct necessary maintenance and updates. Document data pipeline processes and technical specifications. Qualifications 5+ years of experience in data engineering. Proficiency with Databricks and python. Strong SQL skills and experience with relational da...

Preferred candidate profile Overall experience of 15+ years. Demonstrated considerable experience (minimum 5-7 Years) implementing Data platform/Big data projects on Hyperscalars platform. (Primarily on AWS/Databricks & Google cloud) Extensive working experience on implementing data warehouse, data lake, data mart projects (5-8 years) Strong solution/architect skills in building Data engineering pipelines. (> 5 Years) Hands on experience working in AWS (glue, redshift, s3, athena)/Databricks/Spark (pyspark preferred) /Snowflake/Google cloud (GCS, Bigquery, dataproc, dataflow, composor). Experience working on Real team data engineering projects Having Data engineering Certifications will be a...

Work Mode: Hybrid (3 days per week) Location: Bangalore/ Pune/ Chennai Role & responsibilities Databricks platform engineer As a Databricks Platform engineer, you will work with various business facing functions on their Big Data Challenges using the Databricks Platform. You will be maintaining the platform's stability, performance, and security, ensuring that it enables our data analysts, data scientists, and other users to effectively work with big data and machine learning Preferred candidate profile 7+ years of experience with Big Data Technologies such as Apache Spark, cloud native Data lakes and Data mesh platforms technical Architecture or consulting role Strong experience in administ...