Data Catalog Engineer

As a Data Catalog Engineer at Seekify Global, you will play a crucial role in improving data discoverability, governance, and lineage across enterprise data assets. Your responsibilities will include: - Leading the end-to-end implementation of a data cataloging solution within AWS, preferably AWS Glue Data Catalog or third-party tools like Apache Atlas, Alation, Collibra, etc. - Establishing and managing metadata frameworks for structured and unstructured data assets in data lake and data warehouse environments. - Integrating the data catalog with AWS-based storage solutions such as S3, Redshift, Athena, Glue, and EMR. - Collaborating with data Governance/BPRG/IT projects teams to define metadata standards, data classifications, and stewardship processes. - Developing automation scripts for catalog ingestion, lineage tracking, and metadata updates using Python, Lambda, Pyspark, or Glue/EMR custom jobs. - Working closely with data engineers, data architects, and analysts to ensure metadata is accurate, relevant, and up to date. - Implementing role-based access controls and ensuring compliance with data privacy and regulatory standards. In addition to the above responsibilities, you will be expected to create detailed documentation and conduct training/workshops for internal stakeholders on effectively utilizing the data catalog. Qualifications Required: - 7-8 years of experience in data engineering or metadata management roles. - Proven expertise in implementing and managing data catalog solutions within AWS environments. - Strong knowledge of AWS Glue, S3, Athena, Redshift, EMR, Data Catalog, and Lake Formation. - Hands-on experience with metadata ingestion, data lineage, and classification processes. - Proficiency in Python, SQL, and automation scripting for metadata pipelines. - Familiarity with data governance and compliance standards (e.g., GDPR, RBI guidelines). - Experience integrating with BI tools (e.g., Tableau, Power BI) and third-party catalog tools is a plus. - Strong communication, problem-solving, and stakeholder management skills. Preferred Qualifications: - AWS Certifications (e.g., AWS Certified Data Analytics, AWS Solutions Architect). - Experience with data catalog tools like Alation, Collibra, or Informatica EDC, or open-source tools hands-on experience. - Exposure to data quality frameworks and stewardship practices. - Knowledge of data migration with data catalog and data-mart is a plus.,