Senior Data Engineer – Dataiku

Job Title: Senior Data Engineer – Dataiku

Experience:

6–10 Years

Location:

[Remote]

Employment Type:

[Contract]

Shift Timing:

[General]

Immediate Joiners Preferred

Role OverviewWe are seeking a highly skilled and motivated Senior Data Engineer with hands-on experience in Dataiku, advanced data modeling, ETL/ELT processes, and Python/SQL development. The ideal candidate will have a strong data engineering foundation, exposure to cloud platforms, and a working understanding of Generative AI concepts. This role is pivotal in designing and building robust, scalable, and production-grade data solutions.Key Responsibilities

• Leverage Dataiku to build end-to-end data pipelines, prepare and transform data, and deliver insightful visualizations and analytics.
• Design and implement scalable data models using best practices such as dimensional modeling (Kimball/Inmon methodologies).
• Develop and maintain ETL/ELT workflows using Dataiku, and optionally tools like Apache Airflow, Talend, or SSIS.
• Integrate and process large datasets from diverse sources into cloud-based environments (AWS / Azure).
• Write robust and optimized Python scripts and complex SQL queries to automate data workflows and support analytics.
• Collaborate with cross-functional teams to understand data requirements and translate them into efficient data architecture.
• Explore and prototype Gen AI and LLM Mesh frameworks to enhance data engineering capabilities.
• Follow best practices for data quality, governance, and documentation.
  

Required Skills & Experience

• Proficiency in Dataiku for pipeline creation, data transformation, and analytics workflows.
• Strong expertise in data modeling techniques (e.g., star schema, snowflake schema, normalized/denormalized models).
• Hands-on experience with ETL/ELT processes and tools (Dataiku, Airflow, Talend, SSIS, etc.).
• Solid programming knowledge in Python and strong SQL skills.
• Experience working with cloud platforms such as AWS or Azure (e.g., S3, EC2, Data Lake, Synapse).
• Familiarity with LLM Mesh or similar Gen AI frameworks.
• Understanding of Generative AI use cases in data engineering.
• Strong problem-solving and debugging capabilities.
• Excellent communication and stakeholder collaboration skills.
  

Nice to Have

• Experience with big data technologies like Apache Spark, Hadoop, or Snowflake.
• Understanding of data governance and data security principles.
• Familiarity with MLOps tools and workflows.
• Contributions to open-source data engineering or AI/ML projects.
  

Skills: data,data engineering,dataiku,python,etl/elt,generative ai,cloud platforms (aws, azure),data modeling,stakeholder collaboration,etl,aws,cloud,problem-solving,sql,modeling,analytics