TECHNICAL ARCHITECT

6 - 11 years

12 - 17 Lacs

Posted:2 days ago| Platform: Naukri logo

Apply

Work Mode

Work from Office

Job Type

Full Time

Job Description

Roles and Responsibility
The Senior Tech Lead - Databricks leads the design, development, and implementation of advanced data solutions. Has To have extensive experience in Databricks, cloud platforms, and data engineering, with a proven ability to lead teams and deliver complex projects. Responsibilities:
  • Lead the design and implementation of Databricks-based data solutions.
  • Architect and optimize data pipelines for batch and streaming data.
  • Provide technical leadership and mentorship to a team of data engineers.
  • Collaborate with stakeholders to define project requirements and deliverables.
  • Ensure best practices in data security, governance, and compliance.
  • Troubleshoot and resolve complex technical issues in Databricks environments.
  • Stay updated on the latest Databricks features and industry trends.
  • Key Technical Skills & Responsibilities
  • Experience in data engineering using Databricks or Apache Spark-based platforms.
  • Proven track record of building and optimizing ETL/ELT pipelines for batch and streaming data ingestion.
  • Hands-on experience with Azure services such as Azure Data Factory, Azure Data Lake Storage, Azure Databricks, Azure Synapse Analytics, or Azure SQL Data Warehouse.
  • Proficiency in programming languages such as Python, Scala, SQL for data processing and transformation.
  • Expertise in Spark (PySpark, Spark SQL, or Scala) and Databricks notebooks for large-scale data processing.
  • Familiarity with Delta Lake, Delta Live Tables, and medallion architecture for data lakehouse implementations.
  • Experience with orchestration tools like Azure Data Factory or Databricks Jobs for scheduling and automation.
  • Design and implement the Azure key vault and scoped credentials.
  • Knowledge of Git for source control and CI/CD integration for Databricks workflows, cost optimization, performance tuning.
  • Familiarity with Unity Catalog, RBAC, or enterprise-level Databricks setups.
  • Ability to create reusable components, templates, and documentation to standardize data engineering workflows is a plus.
  • Ability to define best practices, support multiple projects, and sometimes mentor junior engineers is a plus.
  • Must have experience of working with streaming data sources and Kafka (preferred)
  • Eligibility Criteria:
  • Bachelors degree in Computer Science, Data Engineering, or a related field
  • Extensive experience with Databricks, Delta Lake, PySpark, and SQL
  • Databricks certification (e.g., Certified Data Engineer Professional)
  • Experience with machine learning and AI integration in Databricks
  • Strong understanding of cloud platforms (AWS, Azure, or GCP)
  • Proven leadership experience in managing technical teams
  • Excellent problem-solving and communication skills
  • Our Offering
  • Global cutting-edge IT projects that shape the future of digital and have a positive impact on environment.
  • Wellbeing programs & work-life balance - integration and passion sharing events.
  • Attractive Salary and Company Initiative Benefits
  • Courses and conferences
  • Attractive Salary
  • Hybrid work culture
  • Mock Interview

    Practice Video Interview with JobPe AI

    Start PySpark Interview
    cta

    Start Your Job Search Today

    Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

    Job Application AI Bot

    Job Application AI Bot

    Apply to 20+ Portals in one click

    Download Now

    Download the Mobile App

    Instantly access job listings, apply easily, and track applications.

    coding practice

    Enhance Your Python Skills

    Practice Python coding challenges to boost your skills

    Start Practicing Python Now
    Atos logo
    Atos

    Information Technology & Services

    Essex

    RecommendedJobs for You

    Pune, Maharashtra, India

    Pune, Maharashtra, India

    Thiruvananthapuram, Kerala, India