Databricks Engineer

Experience: 5 - 10 Years

Location: Kochi

Work Mode: Hybrid

Job Type: Fulltime

Mandatory Skills:Python, Pyspark (Scala or Spark), SQL, Rest APIs, Orchestration, Delta Live tablesDelta Lake, Databricks, Datafactory, SSIS, ETL, Data PipelinesSnowflake, Snowsql, Snowpipe, Performance TuningMicrosoft Fabric: Dataflows, pipelines, OneLake, integration with Power BIInfrastructure as Code (Terraform, Bicep)Certifications: Databricks, Snowflake, and/or Fabric certification is a plus

Qualifications

• Education: Bachelor's degree in Computer Science, Data Engineering, Information
  

• Experience:
• 5+ years of professional experience in data engineering
• Proven experience with Databricks, Snowflake, and Microsoft Fabric
• Experience working with on-premise relational databases (SQL Server,
  

• Strong understanding of ETL/ELT processes, data warehousing, and data
  

• Demonstrated ability to work with both structured and unstructured data
• Technical Skills:
• Databricks: PySpark/Scala/Spark SQL, Delta Lake, MLflow integration,
  

• Snowflake: SnowSQL, Snowpipe, performance tuning, security/role
  

• Microsoft Fabric: Dataflows, pipelines, OneLake, integration with Power BI
• Advanced SQL skills
• Python, Scala, Java
• Git, CI/CD for data solutions, Infrastructure as Code (Terraform, Bicep)
• Experience with metadata management and data lineage documentation
• Experience with SSIS, ADF, and other ETL/data pipeline tools
• Real-world experience using Databricks notebooks to interact with REST APIs
• Soft Skills:
• Strong communication and collaboration skills, with the ability to work
  

• Detail-oriented and committed to maintaining high data quality and reliability
• Ability to manage multiple priorities and deliver results in a fast-paced
  

Preferred Qualifications

• Certifications: Databricks, Snowflake, and/or Fabric certification is a plus
• Additional Skills: Experience in CI/CD practices for deploying data pipelines and
  

Key Responsibilities

• Design, develop, and optimize data pipelines and ETL jobs across cloud and on-
  

• Integrate and manage data between Databricks, Snowflake, Fabric, and on-prem
  

• Collaborate with business and analytics teams to understand data needs and
  

• Adhere to data governance standards and ensure compliance with data security
  

• Support real-time, streaming, and batch data processing use cases
• Partner with architects to define scalable data lakehouse and warehouse strategies
• Ensure data quality, consistency, and performance through monitoring,
  

• Collaborate with cross-functional teams, including data governance, analytics, and
  

• Document processes, pipeline configurations, and data models to ensure
  

• Identify and implement process improvements for data ingestion, transformation,
  

• Stay updated with the latest features and best practices in Databricks, Snowflake,