Data Engineer

We are seeking a skilled and detail-oriented Data Engineer with strong expertise in Python, data extraction, file handling, and API integrations. The ideal candidate will be responsible for building robust data pipelines, handling large datasets, and integrating multiple systems using REST APIs. You will work closely with cross-functional teams to ensure seamless data flow across platforms and support business intelligence needs.

Key Responsibilities:

• • Design, develop, and maintain data pipelines using Python.

• • Perform data extraction from various sources (structured, semi-structured, and unstructured).

• • Implement efficient file handling mechanisms for large-scale data processing.

• • Develop and test REST APIs for data ingestion and consumption.

• • Conduct API testing (manual and automated) to ensure system reliability and data integrity.

• • Work with stakeholders to gather requirements and provide scalable data solutions.

• • Monitor, troubleshoot, and optimize data workflows and API performance.

• • Document code, workflows, and API usage for internal and external stakeholders.

Required Skills:

• • Strong proficiency in Python, including libraries like pandas, requests, json, etc.

• • Experience in data extraction techniques (web scraping, APIs, databases).

• • Proficient in file handling (CSV, JSON, XML, Excel, etc.).

• • Hands-on experience with RESTful API development and integration.

• • Experience in API testing using tools like Postman, Swagger, or Python-based frameworks.

• • Familiarity with version control (e.g., Git), basic SQL, and cloud environments is a plus.

Nice to Have:

• • Experience with cloud data platforms (AWS, GCP, or Azure).

• • Knowledge of ETL/ELT frameworks.

• • Basic understanding of data privacy and security practices.