Data Engineer

We are looking for a Data Engineer responsible for gathering, processing, and analyzing data to solve complex business problems. The role includes building scalable data pipelines, performing data modelling and transformations, and applying ML/AI technologies to deliver high-value insights and drive business outcomes.

Key Responsibilities

Functional Responsibilities

• Gather and process raw data at scale (scripts, web scraping, API integrations, SQL queries, etc.).
• Design, implement, and maintain high-performance data pipelines for structured and unstructured business requirements.
• Build web services / API-based interfaces to modularize capabilities across lending products.
• Develop prototypes and proof-of-concepts using AWS, Oracle Cloud, Azure, etc.
• Conduct data investigations and resolve technical, procedural, or operational issues.
• Perform research, data collection, summarization, analysis, and synthesis on request.
• Enhance and optimize data migration procedures for analytic systems.
• Collaborate with domain experts, data scientists, and developers to identify relevant data and build Big Data solutions.
• Continuously learn and adapt to new Big Data ecosystem technologies while supporting team growth.

Job Requirements

Qualifications

• B.Tech in Computer Science, Engineering (CS, ECE, IT, etc.).

Experience

• 1-4 years in data engineering or data warehousing.
• Minimum 2+ years in high-performance data engineering roles.
• Functional Skills
• Python, PL/SQL, MS SQL, Spark, Data Lake concepts, Apache Airflow, Docker.
• Building data pipelines using Python, RESTful APIs, API Gateways.
• Experience with OCI (Oracle Cloud), AWS, Relational Databases, DBT, MongoDB, NoSQL.
• Programming: Python, PL/SQL, Shell scripting.
• Software development practices: Agile, DevOps, CI/CD, automated testing/deployment, Web Services, MLOps.

Behavioral Competencies

• Hands-on and passionate about applying technology to solve business problems.
• Strong attention to detail.
• Excellent analytical and interpersonal skills.