ETL Developer

As a skilled ETL Developer, you will be responsible for developing and optimizing scalable data pipelines to efficiently extract, transform, and load data from various sources. Leveraging technologies like Spark, Dask, and other modern ETL frameworks, you will play a key role in ensuring the smooth operation of data processes. Your duties will include implementing data quality controls, monitoring processes, and providing mentorship to junior ETL developers. Collaboration with the infrastructure team is vital to ensure the availability, reliability, and scalability of ETL solutions. Additionally, you will participate in code reviews, contribute to coding standards, and stay updated on emerging trends in ETL development and data management. Architecting and implementing advanced data models for both NoSQL (e.g., HBase) and relational databases will be part of your responsibilities. Establishing robust systems to ensure data quality, implementing monitoring tools, and designing high-performance APIs for seamless data access are crucial tasks. You will oversee the assembly of large, complex data sets, conduct root cause analysis on data and processes, and collaborate closely with cross-functional teams to ensure alignment on data architecture and delivery goals. In terms of technical requirements, you should have at least 2 years of experience in developing applications using Python, Bash, and SQL. Strong expertise in writing clean, efficient code, knowledge of SQL and NoSQL databases, and experience with parallel processing and distributed computing frameworks are essential. Familiarity with ETL orchestration frameworks and proficiency in backend frameworks like Django or Flask are desirable. Experience with cloud platforms and exposure to data analytics, data science, or machine learning workflows will be beneficial for this role.,