Data Engineer

Chennai, India

5+ years

Full-time (9am-6:30pm), In-office (Monday to Friday)

Asign Data Sciences

About Us:

At Asign, we are revolutionizing the art sector with our innovative digital solutions. We are a passionate and dynamic startup dedicated to enhancing the art experience through technology. Join us in creating cutting-edge products that empower artists and art enthusiasts worldwide.

Role Overview

Data Engineer

The ideal candidate will be responsible for sourcing data, ingesting, transforming, storing, and making data accessible and reliable for data analysis, machine learning, and reporting. You will play a key role in maintaining and evolving our data architecture and ensuring that our data flows efficiently and securely.

Key Responsibilities:

• Design, develop, and maintain efficient and scalable ELT data pipelines.
• Work closely with the data science and backend teams to understand data needs and transform raw inputs into structured datasets.
• Integrate multiple data sources including APIs, web pages, spreadsheets, and databases into a central warehouse.
• Monitor, test, and continuously improve data flows for reliability and performance.
• Create documentation and establish best practices for data governance, lineage, and quality.
• Collaborate with product and tech teams to plan data models that support business and AI/ML applications.

Required Skills:

• Minimum 5 years of hands-on experience in data engineering.
• Solid understanding and experience with

  ELT pipelines

  and modern data stack tools.
• Practical knowledge of one or more orchestrators (Dagster, Airflow, Prefect, etc.).
• Proficiency in Python and SQL.
• Experience working with APIs and data integration from multiple sources.
• Familiarity with one or more cloud data warehouses (e.g., Snowflake, BigQuery, Redshift).
• Strong problem-solving and debugging skills.

Qualifications:

Must-have:

• Bachelors/Masters degree in Computer Science, Engineering, Statistics, or a related field
• Proven experience (5+ years) in data engineering, data integration, and data management
• Hands-on experience in data sourcing tools and frameworks (e.g. Scrapy, Beautiful Soup, Selenium, Playwright)
• Proficiency in Python and SQL for data manipulation and pipeline development
• Experience with cloud-based data platforms (AWS, Azure, or GCP) and data warehouse tools (e.g. Redshift, BigQuery, Snowflake)
• Familiarity with workflow orchestration tools (e.g. Airflow, Prefect, Dagster)
• Strong understanding of relational and non-relational databases (PostgreSQL, MongoDB, etc.)
• Solid understanding of data modeling, ETL best practices, and data governance principles
• Systems knowledge and experience working with Docker.
• Strong and creative problem-solving skills and the ability to think critically about data engineering solutions.
• Effective communication and collaboration skills
• Ability to work independently and as part of a team in a fast-paced, dynamic environment.

Good-to-have:

• Experience working with APIs and third-party data sources
• Familiarity with version control (Git) and CI/CD processes
• Exposure to basic machine learning concepts and working with data science teams
• Experience handling large datasets and working with distributed data systems

Why Join Us?

• Innovative Environment:

  Be part of a forward-thinking team that is dedicated to pushing the boundaries of art and technology.

• Career Growth:

  Opportunities for professional development and career advancement.

• Creative Freedom:

  Work in a role that values creativity and encourages new ideas.

Company Culture: