Senior Lead Data Engineer

Company Description

TerraFinn Technologies outsources scholars from various top business schools in India and experienced employees to Fintech companies globally. The company focuses on providing expert employees to help fintech companies grow their business and achieve their goals efficiently. TerraFinn Technologies values long-term relationships with both candidates and clients to understand their needs and support their success.

Role Description

We are seeking a skilled Data Engineer to design, build, and maintain scalable data pipelines and infrastructure. You will work closely with data scientists, analysts, and software engineers to ensure high-quality, reliable, and accessible data for business decision-making and product development. 

Qualifications

• Bachelor’s degree in computer science, Engineering, Information Systems, or related field.
• Strong programming skills in Python, SQL, and/or Java/Scala.
• Hands-on experience with ETL tools and frameworks (Airflow). 
• Experience with big data technologies (Hadoop, Spark).
• Proficiency in cloud platforms (AWS, Azure) and data storage solutions (Redshift).
• Knowledge of data modeling, warehousing, and distributed systems.
• Understanding of CI/CD pipelines, containerization (Docker, Kubernetes) is a plus. 
• Minimum of 3 years of experience working with core AWS Services  
• 5 years of experience developing and deploying container-based microservices (Docker and AWS Fargate) 
• Extensive experience with open-source technology, software development, and system engineering  
• Exceptionally self-motivated, self-directed, and detail-oriented 
• Excellent communication, analytical, and problem-solving skills. 

We expect below from the candidates

1. Experience with real-time streaming data and event-driven architectures.
2. Knowledge of machine learning pipelines and MLOps practices. 
3. AWS lambda functions. 
4. Good understanding of PostgreSql/mysql. Data migration from mysql to postgresql
5. Experience on AWS S3
6. Strong problem-solving, debugging, and performance optimization skills.

What We Offer 

1. Competitive salary and benefits package. 
2. Opportunity to work with modern data tech stacks. 
3. Collaborative and innovative work environment.
4. Professional development and career growth opportunities.

Salary : 25 + Lacs

Exp : 5+ Years

Notice Period : Very Immediate

Regards,

TerraFinn Technologies