Associate Data Engineer

Your role at WRD involves working on cutting-edge data engineering challenges by merging human expertise with cutting-edge AI technology. As part of the team, you will be responsible for the following key responsibilities: - Develop & Maintain data pipelines to support business and analytical needs. - Work with structured and unstructured data to ensure high data quality and availability. - Build scalable and efficient data workflows using SQL, Python, and Java/Scala. - Manage and process large datasets on AWS EMR and other cloud platforms. - Develop and maintain batch and stream data processing jobs using tools like Spark (preferred). - Deploy, monitor, and troubleshoot workflows on orchestration platforms like Airflow (preferred). - Ensure compliance with data governance and security standards. To excel in this role, you are required to have the following skills: Required Skills: - Strong Proficiency in SQL for data extraction, transformation, and reporting. - Strong understanding of ETL pipelines. - Very good programming skills in Java/Scala and Python. - Strong problem-solving and analytical skills. - Experience with Apache Spark for large-scale data processing. Preferred Skills: - Hands-on experience with AWS EMR or similar distributed data processing frameworks. - Familiarity with Airflow for workflow orchestration. - Knowledge of AWS ecosystem services like S3, Redshift, and Athena. - Experience with version control systems like Git. - Understanding of distributed systems and big data processing. - Knowledge of data lake and data warehouse concepts. - Familiarity with Agile methodologies and team collaboration tools like JIRA. At WRD, you will have the opportunity to work on the forefront of AI-powered innovation, where your skills will drive real impact and creativity meets advanced technology. Additionally, you will be part of a collaborative and inclusive work environment with professional growth and upskilling opportunities, along with a competitive salary and benefits package. Your future in AI and IT innovation begins here.,