Data Engineer

Ciklum

We are a custom product engineering company that supports both multinational organizations and scaling startups to solve their most complex business challenges. With a global team of over 4, 000 highly skilled developers, consultants, analysts and product owners, we engineer technology that redefines industries and shapes the way people live.

About the role:

As a Data Engineer, become a part of a cross-functional development team who is working with GenAI solutions for digital transformation across Enterprise Products. The prospective team you will be working with is responsible for the design, development, and deployment of innovative, enterprise technology, tools, and standard processes to support the delivery of tax services. The team focuses onthe ability to deliver comprehensive, value-added, and efficient tax services to our clients. It is a dynamic team with professionals of varying backgrounds from tax technical, technology development, change management, and project management. The team consults and executes on a wide range of initiatives involving process and tool development and implementation including training development, engagement management, tool design, and implementation.

• Responsible for the building, deployment, and maintenance of mission-critical analytics solutions that process terabytes of data quickly at big-data scales


• Contributes design, code, configurations, manage data ingestion, real-time streaming, batch processing, ETL across multiple data storages


• Responsible for performance tuning of complicated SQL queries and Data flows

• Experience coding in SQL/Python, with solid CS fundamentals including data structure and algorithm design


• Hands-on implementation experience working with a combination of the following technologies: Hadoop, Map Reduce, Kafka, Hive, Spark, SQL and NoSQL data warehouses


• Experience in Azure cloud data platform


• Experience working with vector databases (Milvus, Postgres, etc. )


• Knowledge of embedding models and retrieval-augmented generation (RAG) architectures


• Understanding of LLM pipelines, including data preprocessing for GenAI models


• Experience deploying data pipelines for AI/ML workloads(*), ensuring scalability and efficiency


• Familiarity with model monitoring(*), feature stores (Feast, Vertex AI Feature Store), and data versioning


• Experience with CI/CD for ML pipelines(*) (Kubeflow, MLflow, Airflow, SageMaker Pipelines)


• Understanding of real-time streaming for ML model inference (Kafka, Spark Streaming)


• Knowledge of Data Warehousing, design, implementation and optimization


• Knowledge of Data Quality testing, automation and results visualization


• Knowledge of BI reports and dashboards design and implementation (PowerBI)


• Experience with supporting data scientists and complex statistical use cases highly desirable

• Strong community: Work alongside top professionals in a friendly, open-door environment


• Growth focus: Take on large-scale projects with a global impact and expand your expertise


• Tailored learning: Boost your skills with internal events (meetups, conferences, workshops), Udemy access, language courses, and company-paid certifications


• Endless opportunities: Explore diverse domains through internal mobility, finding the best fit to gain hands-on experience with cutting-edge technologies


• Care: We ve got you covered with company-paid medical insurance, mental health support, and financial & legal consultations