Data Platform Engineer

Job Description

Role Purpose A result-oriented Software Developer to develop solutions powered by Fujitsus new processor, which helps solve real-world challenges facing society and businesses across different industries. As a software developer, you are passionate about developing solutions and should be comfortable with back-end coding languages, technologies, frameworks and third-party/opensource libraries. You will play a role in developing innovative advanced solutions and services to support business outcomes. Responsibilities Improve and analyze performance of software applications. Enable and optimize OSS/ISV applications for Fujitsus new processor, starting with AI and Big Data Analytics-related applications. Develop new algorithms for Big Data Analytics frameworks, tuning technologies and work on software based on the proposed approaches using Big Data engineering. Designing and developing data analysis workflows, applications, effective APIs and the system architectures Deploying and Testing applications to ensure functionality, performance, responsiveness, and efficiency. Creating test cases, test plans and automated test scripts for unit tests Troubleshooting, debugging, and fixing bugs and upgrading software/applications. Creating security and data protection settings and measures Writing technical documentation Working and communicating well with product managers, business analysts, and data scientists, and other software developers to collaborate, review and deliver high quality applications. Learning continually, sharing knowledge, and fostering exchange of skills Working using agile methods (planning meetings, review meetings, standup meetings, development, etc.) Working on multiple projects at once while keeping focused on project timeline Experience You will be able to demonstrate that you have: Degree in computer science or relevant field Proven experience as a software developer or similar role, and familiarity with common stacks for software applications using Data analytics technologies. Minimum 4 years experience in production application/solution development Experience in Big Data using Databricks, PySpark etc. and statistical analysis with Data Analytics tools and technologies. Experience with Data Intelligence Platforms, Large Scale Distributed processing with Spark Understanding of Java, JVM, VectorAPI, HotSpot, JNI, Vectorization techniques & SIMD optimization Knowledge of Spark Accelerator frameworks like Comet, Velox, TrinoDB, ClickHouse etc. Knowledge of ETL (AWS Glue, etc.) & database (RDB, Vector DB, etc.) Knowledge related to DWH Ecosystem (Palantir, Snowflake, Databricks, BigQuery, Redshift, etc.) Experience with SQL/Postgres SQL/Python data processing with SW Development Skills in Java/C++/Scala ( especially Java ) Experience in data analysis using parallel processing. (Apache Spark, PySpark etc.) In depth understanding and knowledge of the specified data analytic tools and technologies with Framework engineering experience. Proficiency with fundamental back-end server-side languages such as Python, C/C++, etc. Knowledge of OSS as an alternative to cloud computing for each layer Excellent writing, verbal communication, and teamwork skills Experience in Big Data using Databricks, PySpark etc. and statistical analysis with Data Analytics tools and technologies. Experience in software development in agile approach Excellent writing, verbal communication, and teamwork skills Preferred Experience You will be able to demonstrate that you have: Experience in developing and deploying APIs. Preferred experience in performance tuning & optimization techniques for Data Analytics tools, SQL, and NoSQL databases. Knowledge and experience in Cloud service (Azure/AWS) features such as Functions, VM, Container, DevOps (CI/CD) Great skills in evaluating performance and security of software applications and delivering solutions which are efficient and performant. HPC and computer architecture understanding. Skills in AI-related technology