Senior Data Engineer

Responsibilities

• Design, build, and test ETL processes using Python and SQL
• Develop Python scripts to extract information from different data sources for business analytics
• Build and maintain high-performance, reusable, and reliable Java/Python code
• Create secure RESTful-based web services using XML, JSON, JavaScript, and jQuery
• Work on data pipelines and data-centric applications using distributed storage platforms
• Implement process automation using Python, VBA, and appropriate technologies
• Collaborate with senior developers to implement Python code
• Design, develop, and integrate Java services using the Spring Boot framework
• Build and deploy ML models using Python on platforms like SageMaker or Azure ML
• Identify and resolve performance issues in data systems
• Support installation, configuration, and implementation of Java-based technologies
• Collaborate with highly skilled Data Science teams to provide the best possible solutions for clients
  

Requirements

• Bachelor's in Electrical Engineering or Computer Science required
• 5+ years of industry experience with hands-on experience in Apache technologies
• Expertise in Python with knowledge of the Django web framework
• Proficient in Java with strong fundamentals in object-oriented programming
• Experience in creating test automation using Java/.NET, Selenium, etc.
• Strong background in core Java, Spring framework, microservices, and Spring Boot
• Knowledge of popular design patterns and Java frameworks
• Ability to perform complex data analysis on large volumes of data
• Experience with containerization using Docker and Kubernetes
• Working knowledge of Linux/Unix administration and scripting languages like Python, Shell, etc.
• Familiarity with relational databases and web-based data sources
• Hands-on experience with MongoDB, MySQL, Java, JavaScript, etc.
• Strong understanding of big data domains like Hadoop/MapReduce and ETL architectures
  

Desired Skills

• Hands-on experience with Python and Linux shell scripting
• Proficiency in scripting and programming languages like Python, YAML, etc.
• Experience with creating Jenkins pipelines and working with CI/CD tools
• Knowledge of front-end technologies like HTML, CSS, JavaScript, React.js, etc.
• Certification as an AWS Developer Associate or Solutions Architect Associate
  

Education

• Bachelor's or Master's in Computer Science or a related technical discipline
• Familiarity with software engineering skills including Java, Spark, Python, Scala, etc.