Job Description

As a Big Data Engineer, you will be responsible for the design, implementation, Security and on- going support of Scality data storage. You will partner with Data Scientists as well as product stakeholders to create an advanced analytics eco-system. Obtain an overall understanding of data and processes Partner with the Product Owner on requirements and brainstorm implementation options Participate in planning session to determine technical designs and estimates Develop and deliver solutions using Big Data/Spark tools and technologies Collaborate effectively with other teams (internal and external) in a very dynamic agile environment Learn new tools and implement continuous improvements in support of the Products strategic visionKey Responsibilities Partners closely with team members on Big Data solutions for our data science community and analytic users Partners with 360F teams on Big Data efforts Executes moderately complex functional work tracks for the team Contributes to the development of moderately complex prototypes and department applications that integrate big data and advanced analytics to make business decisions Develops innovative solutions to Big Data issues and challenges within the team Contributes to the development of moderately complex technical solutions using Big Data techniques in data & analytics processes Leverages and uses Big Data best practices / lessons learned to develop technical solutions Understands the Big Data related problems and requirements to identify the correct technical approach Uses new areas of Big Data technologies, (ingestion, processing, distribution) and research delivery methods that can solve business problems Key Skills Experience in Spark, Scala, Python, SQL, Unix, Kubernetes, Airflow. Preferable if experience in PowerBI and MS Fabric. Additionally, need to support oncall jobs during India day time on rotation basis. Education 4 year Bachelors Degree (Preferred) Experience 2 or more years of experience (Preferred) Supervisory Responsibilities This job does not have supervisory duties. Education & Experience (in lieu) In lieu of the above education requirements, an equivalent combination of education and experience may be considered. Primary Skills Big Data Engineering, Big Data Systems, Big Data Technologies, Data Science, Influencing Others Shift Time Shift B (India)