Data Engineer

As a Data Engineer at BuildingBlocks, you will play a crucial role in owning the data pipeline that powers our LLM training and fine-tuning process. Your responsibilities will involve designing ETL pipelines for text, PDFs, and structured data, implementing data deduplication, filtering, and normalization, training and managing tokenizers, building datasets for supervised fine-tuning and evaluation, and collaborating closely with domain experts to generate instruction/response pairs. Key Responsibilities: - Design ETL pipelines for text, PDFs, and structured data. - Implement data deduplication, filtering (toxicity, PII), and normalization. - Train and manage tokenizers (SentencePiece/BPE). - Build datasets for supervised fine-tuning and evaluation. - Work closely with domain experts to generate instruction/response pairs. Qualifications Required: - Strong proficiency in Python, SQL, and data wrangling frameworks (Pandas, Spark). - Experience working with large text datasets, cleaning, and preprocessing. - Familiarity with NLP-specific preprocessing techniques such as chunking and embeddings. - Knowledge of cloud data storage platforms like S3, GCS, and Blob. - Bonus: Prior experience in AI/ML pipelines. About BuildingBlocks: At BuildingBlocks, our diverse team shares a common mission of creating beautiful experiences that have a positive impact on people's lives and the businesses we serve. Our culture is rooted in purpose, blending genuine human connection with a meticulous approach to our craft. We are a company that embraces youthfulness, fun, defiance, boldness, and drive to make a significant mark in the industry. As a Data Engineer at BuildingBlocks, you will play a crucial role in owning the data pipeline that powers our LLM training and fine-tuning process. Your responsibilities will involve designing ETL pipelines for text, PDFs, and structured data, implementing data deduplication, filtering, and normalization, training and managing tokenizers, building datasets for supervised fine-tuning and evaluation, and collaborating closely with domain experts to generate instruction/response pairs. Key Responsibilities: - Design ETL pipelines for text, PDFs, and structured data. - Implement data deduplication, filtering (toxicity, PII), and normalization. - Train and manage tokenizers (SentencePiece/BPE). - Build datasets for supervised fine-tuning and evaluation. - Work closely with domain experts to generate instruction/response pairs. Qualifications Required: - Strong proficiency in Python, SQL, and data wrangling frameworks (Pandas, Spark). - Experience working with large text datasets, cleaning, and preprocessing. - Familiarity with NLP-specific preprocessing techniques such as chunking and embeddings. - Knowledge of cloud data storage platforms like S3, GCS, and Blob. - Bonus: Prior experience in AI/ML pipelines. About BuildingBlocks: At BuildingBlocks, our diverse team shares a common mission of creating beautiful experiences that have a positive impact on people's lives and the businesses we serve. Our culture is rooted in purpose, blending genuine human connection with a meticulous approach to our craft. We are a company that embraces youthfulness, fun, defiance, boldness, and drive to make a significant mark in the industry.