Jobs

Interviews
Job Alerts
Tools

Upskill and Grow with AI

Mock Interview Practice interviews in realistic simulations

Coding Practice Improve your coding skills with challenges

Certification Earn certifications to validate your skills

AI Learning Get trained with AI expert sessions

Career Path AI insights for smarter career decisions

AI Job Match Score AI-Powered Job Match Against Your Resume and Optimize Your Resume

Career Tools and Resources

Resume Builder Build Professional Resume with Ease

ATS Friendliness Check Check Resume Friendliness for Applicant Tracking Systems

Auto Apply Apply to hundreds of jobs on any platform effortlessly

Co-Pilot (Chrome Extension) Your AI Assistant for Seamless Browsing Efficiency

Interview Questions Streamline interviews with ready-to-use questions

Salaries Discover market-driven salary insights across skillsets and geographies

Companies Explore leading companies actively hiring talent
For Employers

Home
>
Jobs in chennai
>
Decision Minds
>
Databricks Architect

Databricks Architect

Decision Minds

5 years

0 Lacs

chennai tamil nadu india

Posted:1 day ago| Platform:

Apply

Skills Required

databricks flexibility software architecture migration oracle data integrity reliability spark pyspark efficiency processing checks reconciliation hadoop hive sqoop integration aws storage deployment governance security compliance engineering connect unity etl tuning orchestration airflow design management ai ml communication collaboration

Work Mode

Remote

Job Type

Full Time

Job Description

Role Description

This is a full-time hybrid role ( Multiple roles) for a Databricks lead and Architect located in Chennai and Pondicherry, with the flexibility to work remotely on occasion. The Databricks Architect will be responsible for designing scalable architectures, developing software solutions, integrating Databricks with other platforms, and creating efficient architectural designs. Additionally, the role involves collaborating with cross-functional teams, managing projects to ensure timely delivery, and supporting the implementation of Databricks solutions that align with business goals.

Key Responsibilities:

Be the go to person for everything related to solutioning and Architecture. Should be leading the the team.
Lead the
migration of Oracle Data Warehouse to Databricks
, ensuring minimal downtime and data integrity.
Work on data pipelines using
Databricks best practices
for performance, cost, and reliability, while guiding junior engineers.
Optimize Spark/PySpark jobs
for performance and efficiency in processing large datasets.
Implement data quality checks, validation, and reconciliation processes during migration.
Work on Hadoop ecosystem (HDFS, Hive, Sqoop) for legacy data integration where needed.
Leverage AWS cloud services (S3, EMR, EC2, Lamda, RDS, Glue) for data storage and processing.
Implement CI/CD pipelines for automated deployment of Databricks workflows.
Ensure data governance, security, and compliance in the cloud environment.

Mandatory Skills & Experience:

5+ years in Data Engineering, with strong expertise in Databricks, Oracle, and Data Warehousing.
Hands-on experience in migrating on-prem data warehouses (Oracle) to Databricks.
Hands on expertise using key features of Databricks ( Lakeflow connect, Lakebridge, Autoloader, Unity Catalog, Spark Declarative Pipelines, Lakehouse Architecture)
Proficiency in
PySpark, SQL
, and ETL/ELT frameworks.
Strong knowledge of Hadoop ecosystem (HDFS, Hive, Sqoop).
Experience with AWS cloud services (S3, EMR, Glue, Lambda, RDS).
Familiarity with data modeling, CDC, and performance tuning in Databricks.
Good understanding of orchestration tools (Airflow, Control-M) and CI/CD pipelines.
Proficiency in Architecture, Architectural Design, and Integration
Strong Project Management skills to lead and ensure project milestones are met
Ability to work with cloud-based platforms and familiarity with AI/ML and Big Data technologies
Excellent problem-solving and analytical skills
Strong communication and collaboration skills to work effectively in a hybrid environment
Experience with Databricks and end-to-end deployment of data solutions is highly desirable
Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field

More Jobs at Decision Minds

Imm Joiner Tech/ Semi-Tech Support (International Voice) @ Hyderabad

Hyderabad

3 - 5 yrs

INR 5 - 14 Lacs

Imm Joiner! Sr. Business Analyst(SQL, Data Modeling) @ Chennai

Bengaluru

9 - 10 yrs

INR 15 - 18 Lacs

Imm Joiner! Lead Data Engg (Azure DB, DF, DL) B'LORE, HYD, CHE

Bengaluru

9 - 14 yrs

INR 30 - 37 Lacs

Imm Joiner! Sr. Automation Test Engg(Java, Selenium)@India

Kolkata, Hyderabad, Pune, Chennai, Bengaluru, Delhi / NCR, Mumbai (All Areas)

5.0 - 9.0 yrs

INR 10 - 16 Lacs

Imm Joiner International Voice B2B Tech @ Hyderabad

Hyderabad

3.0 - 5.0 yrs

INR 5 - 14 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now

Decision Minds

Data Analytics / Software

Analytics City

Login to

Please Verify Your Phone or Email

Confirm Action

Databricks Architect