Senior Data Infrastructure Engineer

As a Senior Data Infrastructure Engineer at Hivels, you will play a crucial role in scaling and evolving the data backbone that drives the analytics and AI insights of the company. Your responsibilities will revolve around optimizing how engineering data flows through the systems, ensuring speed, reliability, and readiness for insight generation. **Key Responsibilities:** - Build and scale multi-source data ingestion from Git, Jira, and other developer tools using APIs, webhooks, and incremental syncs. - Refactor and harden existing Java-based ETL pipelines for modularity, reusability, and scale. - Implement parallel and event-driven processing with Kafka/SQS for both batch and streaming data. - Optimize Postgres schema design, partitioning, and query performance for datasets exceeding 100GB. - Design and manage data orchestration, lineage, and observability using tools like Airflow, Temporal, or OpenTelemetry. - Collaborate with backend, product, and AI teams to ensure data is easily consumable for insights and ML workflows. - Maintain cost efficiency and scalability across AWS infrastructure components such as S3, ECS, Lambda, RDS, and CloudWatch. - Create self-healing and monitored pipelines to ensure uninterrupted data flow. **Qualifications Required:** - 6-10 years of experience as a Backend Engineer or Data Engineer in data-heavy or analytics-driven startups. - Strong hands-on experience with Java and AWS services such as S3, ECS, RDS, Lambda, and CloudWatch. - Demonstrated experience in fetching and transforming data from various external APIs like GitHub, Jira, Jenkins, and Bitbucket. - Profound understanding of data modeling, incremental updates, and schema evolution. - Deep knowledge of Postgres optimization including indexing, partitioning, and query tuning. - Experience in building data pipelines or analytics platforms at scale with multi-tenant systems handling over 100M records. - Bonus points for exposure to tools like dbt, ClickHouse, Kafka, Temporal, or developer-analytics ecosystems. In addition to the technical challenges and responsibilities, you will have the opportunity to: - Build the foundation for AI-driven engineering insights used globally. - Collaborate directly with CxOs and senior architects. - Witness the impact of your work through dashboards viewed by CTOs and CEOs. - Shape how thousands of engineers measure productivity in the AI era. - Contribute to the core architecture supporting AI-native engineering intelligence. - Be part of a dynamic, collaborative culture that values ownership and craftsmanship.,