Data Engineer

About Trademo

Trademo is a Global Supply Chain Intelligence SaaS Company, headquartered in Palo-Alto, US. Trademo collects public and private data on global trade transactions, sanctioned parties, trade tariffs, ESG and other events using its proprietary algorithms.Trademo analyzes and performs advanced data processing on billions of data points (50Tb+) using technologies like Graph Databases, Vector Databases, ElasticSearch, MongoDB, NLP and Machine Learning (LLMs) to build end-to-end visibility on Global Supply Chains. Trademo’s vision is to build a single truth on global supply chains to different stakeholders in global supply chains - discover new commerce opportunities, ensure compliance with trade regulations, and automation for border security.

12.5 mn

—----------------------------------------------------------------------------------------

Role:

Website:

Location:

What will you be doing here?

• Responsible for the maintenance and growth of a 50TB+ data pipeline serving global SaaS products for businesses, including onboarding new data and collaborating with pre-sales to articulate technical solutions
• Solves complex problems across large datasets by applying algorithms, particularly within the domains of Natural Language Processing (NLP) and Large Language Models (LLM)
• Leverage bleeding-edge technology to work with large volumes of complex data
• Be hands-on in development - Python, Pandas, NumPy, ETL frameworks.
• Preferred exposure to distributed computing frameworks like Apache Spark , Kafka, Airflowj
• Along with individual data engineering contributions, actively help peers and junior team members on architecture and code to ensure the development of scalable, accurate, and highly available solutions
• Collaborate with teams and share knowledge via tech talks and promote tech and engineering best practices within the team.

Requirement

• B-Tech/M-Tech in Computer Science from IIT or equivalent Tier 1 Colleges.
• 3+ years of relevant work experience in data engineering or related roles.
• Proven ability to efficiently work with a high variety and volume of data (50TB+ pipeline experience is a plus).
• Solid understanding and preferred exposure to NoSQL databases, including Elasticsearch, MongoDB, and GraphDB.
• Basic understanding of working within Cloud infrastructure and Cloud Native Apps (AWS, Azure, IBM , etc.).
• Exposure to core data engineering concepts and tools: Data warehousing, ETL processes, SQL, and NoSQL databases.
• Great problem-solving ability over a larger set of data and the ability to apply algorithms, with a plus for experience using NLP and LLM.
• Willingness to learn and apply new techniques and technologies to extract intelligence from data, with prior exposure to Machine Learning and NLP being a significant advantage.
• Sound understanding of Algorithms and Data Structures.
• Ability to write well-crafted, readable, testable, maintainable, and modular code.

Desired Profile:

• A hard-working, humble disposition.
• Desire to make a strong impact on the lives of millions through your work.
• Capacity to communicate well with stakeholders as well as team members and be an effective interface between the Engineering and Product/Business team.
• A quick thinker who can adapt to a fast-paced startup environment and work with minimum supervision

What we offer:

At Trademo, we want our employees to be comfortable with their benefits so they focus on doing the work they love.

• Parental leave - Maternity and Paternity
• Health Insurance
• Stock Options