Data Engineer

Experience Level

About Forage AI

About the Role

Key Responsibilities

• Design and develop new features and enhancements for our core platforms and services.
• Contribute to the modernization and refactoring of existing systems and code bases.
• Propose, experiment with, and implement GenAI-based innovations, tools, or workflows to solve business problems and create new value.
• Drive technical improvements, suggest and lead platform upgrades, and champion engineering best practices.
• Investigate, debug, and resolve production issues, to deliver robust solutions that improve performance and maintainability.
• Collaborate with product, engineering, and business teams to deliver impactful end-to end solutions.
• Help maintain the reliability, scalability, and security of our systems as we evolve our platform.

Technical Skills & Requirements:

• Python: Strong hands-on experience with core Python and its standard libraries
• Web Framework: Experience developing backend APIs and services using FastAPI/Flask.
• RabbitMQ: Proficiency in implementing message queues and task distribution.
• Docker & Docker Compose: Experience containerizing applications and managing services.
• WebScraping: Demonstrated expertise with webscraping tools and techniques.
• Playwright & Selenium: Practical experience with browser automation frameworks.
• PostgreSQL & SQLAlchemy: Proficient in SQL and ORM-based data access.
• MongoDB & PyMongo: Experience with NoSQLdata using PyMongo.
• Redis: Practical use for caching and lightweight messaging.
• AWS: Hands-on experience with services such as S3, Secrets Manager, and Auto Scaling Groups(using boto3).
• Linux/Unix: Comfort with command-line operations and scripting.
• Git: Proficient in version control and team collaboration.
• Concurrency: Experience with multithreading and asynchronous programming in Python.
• API Integrations: Familiarity with integrating third-party APIs, including authentication, data handling, and rate limiting.
• Good to have: Exposure to GenAI/LLMs (OpenAI, HuggingFace, etc.), prompt engineering, or integrating GenAI-powered features into products

Other Infrastructure Requirements

Since this is a completely work-from-home position, you will also require the following -

● High-speed internet connectivity for video calls and efficient work.

● Capable business-grade computer (e.g., modern processor, 8 GB+ of RAM, and

no other obstacles to interrupted, efficient work).

● Headphones with clear audio quality.

● Stable power connection and backups in case of internet/power failure.