ELK Developer

As a Data Engineer at amIT Global Solutions Sdn Bhd, you will be responsible for designing, implementing, and optimizing ETL pipelines using Elasticsearch to facilitate data ingestion, transformation, and loading processes. You will collaborate closely with data architects and business stakeholders to comprehend data requirements and ensure that data is well-structured and readily available for analysis. Your role will involve writing and maintaining complex SQL queries, developing scripts, and constructing data pipelines to process data efficiently. In this role, you will be expected to implement data transformation logic using Elasticsearch tools and frameworks to ensure that data is appropriately prepared for analytics. You will also be involved in developing and managing data models for real-time analytics, integrating data from diverse sources while ensuring consistency and accuracy. Troubleshooting issues related to data pipelines, performance, and data quality will be a key aspect of your responsibilities. Working in coordination with data science and business intelligence teams, you will support the creation of reporting mechanisms, dashboards, and drive data-driven decision-making processes. Monitoring and optimizing ETL jobs for scalability, performance, and reliability will be crucial to enhance data processing efficiency. Upholding data integrity and compliance with data governance and security standards will also be a part of your role. This is a contractual/temporary position with a duration of 12 months located at Coplace2, Cyberjaya. The role requires a commute or willingness to relocate to Chennai G.P.O, Chennai, Tamil Nadu. Desired experience includes a minimum of 3 years in Elasticsearch and 2 years in ETL. The candidate should be willing to work in Malaysia and provide information about their notice period.,