Bigdata Developer

We are looking for a highly motivated and enthusiastic Intermediate Software Developer to join our growing engineering team. This role is suitable for an individual with 3-5 years of experience who is eager to learn and excel within a fast-paced environment. You will have the opportunity to work on exciting projects involving large-scale data processing, analytics, and software development, utilizing technologies such as Java, Apache Spark, Python, and Apache Iceberg. This position provides a unique chance to gain hands-on experience with cutting-edge data lake technologies and play a vital role in enhancing critical data infrastructure. As an Intermediate Software Developer, your responsibilities will include collaborating with senior developers and data engineers to design, develop, test, and deploy scalable data processing pipelines and applications. You will be required to write clean, efficient, and well-documented code in Java and Python for various data ingestion, transformation, and analysis tasks. Additionally, you will use Apache Spark for distributed data processing, focusing on performance optimization and resource management. Working with Apache Iceberg tables to manage large, evolving datasets in our data lake will be a key aspect of your role, ensuring data consistency and reliability. You will also assist in troubleshooting, debugging, and resolving issues in existing data pipelines and applications. Participation in code reviews to maintain a high standard of code quality and best practices, along with learning and adapting to new technologies and methodologies as project requirements evolve, are also part of the job. Contribution to the documentation of technical designs, processes, and operational procedures is expected from you. To qualify for this role, you should have 2-5 years of relevant experience and hold a Bachelor's degree in Computer Science, Software Engineering, Data Science, or a related technical field. Strong foundational knowledge of object-oriented programming principles, proficiency in Java or Python, and a basic understanding of data structures, algorithms, and software development lifecycles are essential. Familiarity with version control systems like Git, eagerness to learn, and a strong passion for software development and data technologies are also required. Excellent problem-solving skills, attention to detail, good communication, and teamwork abilities are key qualifications for this position. Education requirements include a Bachelor's degree or equivalent experience. Familiarity with distributed computing concepts, understanding of Apache Spark or experience with data processing frameworks, exposure to cloud platforms like AWS, Azure, or GCP, knowledge of SQL and database concepts, as well as any experience or coursework related to data lakes, data warehousing, or Apache Iceberg would be advantageous. Please note that this job description provides an overview of the work performed, and additional job-related duties may be assigned as required.,