Application Support Engineer

 About The Role  

Project Role :Application Support Engineer

Project Role Description :Act as software detectives, provide a dynamic service identifying and solving issues within multiple components of critical business systems.
Must have skills :Data Engineering

Good to have skills :NA
Minimum 3 year(s) of experience is required

Educational Qualification :15 years full time education
Key Responsibilities Design and build efficient data ingestion pipelines from multiple sources using Databricks and Spark.Develop and implement strategies that integrate data ingestion, processing, governance, and analytics.Store and process raw, unstructured, semi-structured, and structured data in Databricks (Delta Lake).Define and enforce data quality rules, cleansing processes, and retention policies to ensure compliance and data integrity.Implement and manage metadata catalogs (e.g., Unity Catalog) to make data searchable, understandable, and trustworthy by tracking data origin, transformations, and lineage.Build and optimize pipelines for both batch and real-time streaming data from diverse sources such as databases, APIs, and applications.Monitor and optimize storage usage, query performance, data quality, access logs, and system health to ensure efficiency and prevent data swamps. Required Skills & Experience 4+ years of experience in data engineering, with at least 2+ years on Databricks.Strong proficiency in Python, SQL, and PySpark.Hands-on experience with Databricks Delta Lake, Unity Catalog, and MLflow.Experience with streaming technologies (Structured Streaming, Kafka, Event Hubs, or Kinesis).Strong knowledge of data governance, lineage, and security practices.Experience working in cloud environments (Azure, AWS, or GCP).Excellent problem-solving and debugging skills. Qualification 15 years full time education