Data Analyst

You are required for the position of Data Analyst with 5 to 8 years of experience. Your primary responsibilities include maintaining and enhancing the current ETL pipeline. You will be tasked with designing, developing, and managing ETL processes to extract data from source systems, transform it into the necessary format, and load it into target databases or data warehouses. Additionally, you will create and optimize data pipelines for real-time, batch, and near-real-time data processing. Writing complex SQL queries, scripts, and stored procedures for data manipulation and transformation will also be part of your role. Your role will involve integrating data from various sources such as APIs, flat files, databases, and cloud platforms into centralized storage. You must ensure that the data is appropriately transformed according to business logic and validation rules. Implementing data quality checks and validation routines to guarantee data accuracy and reliability, as well as detecting and resolving data discrepancies, inconsistencies, or errors, are crucial aspects of your job. Monitoring ETL jobs for performance and efficiency, optimizing ETL processes to reduce processing time and resource utilization, and troubleshooting and resolving performance issues related to ETL pipelines will be within your purview. The technical expertise required for this role includes proficiency in Python and SQL, as our current pipeline is a combination of both. Experience with relational databases such as SQL Server and PostgreSQL, as well as cloud platforms like AWS (Athena, Kubernetes), is essential. Preferred skills for this position include designing, implementing, and managing CI/CD pipelines, automating manual processes related to software build, testing, deployment, and configuration management, deploying and managing applications on cloud platforms like AWS, building and maintaining scalable, resilient cloud-based infrastructure using services like EC2, S3, Kubernetes, and Docker, and implementing container orchestration solutions with Kubernetes and Docker. This is a full-time position that offers health insurance and a performance bonus. The work schedule is during the day, and the preferred experience level is a minimum of 2 years. The work location is in person. Please share your profiles urgently for consideration.,