Officer-Pyspark Developer

The Applications Development Intermediate Programmer Analyst role at our organization involves actively participating in the establishment and implementation of new or revised application systems and programs in collaboration with the Technology team. Your primary objective will be to contribute to applications systems analysis and programming activities. You will be expected to utilize your knowledge of applications development procedures and concepts, along with a basic understanding of other technical areas, to identify and define necessary system enhancements. This includes leveraging script tools, analyzing, and interpreting code. Additionally, you will consult with users, clients, and other technology groups on issues, recommend programming solutions, and provide installation and support for customer exposure systems. As an Intermediate Programmer Analyst, you will apply your fundamental knowledge of programming languages to create design specifications and analyze applications to detect vulnerabilities and security issues. Testing and debugging will also be part of your responsibilities. Furthermore, you will serve as an advisor or coach to new or lower-level analysts, identify problems, analyze information, and make evaluative judgments to recommend and implement solutions. In this role, you will need to resolve issues by selecting solutions based on your technical experience, guided by precedents. You should be able to operate with a limited level of direct supervision, exercise independence of judgment and autonomy, and act as a subject matter expert to senior stakeholders and/or other team members. It is essential to appropriately assess risk when making business decisions, with a focus on safeguarding the firm's reputation and ensuring compliance with applicable laws and regulations. This includes adhering to policies, demonstrating ethical judgment in personal behavior and business practices, and reporting control issues transparently. Qualifications: - 4-8 years of relevant experience in Data Analytics or Big Data - Hands-on experience with SQL, Python, and Pyspark, including Spark components - 2-4 years of experience as a Big Data Engineer developing, optimizing, and managing large-scale data processing systems and analytics platforms - 4 years of experience in distributed data processing and near real-time data analytics using PySpark - ETL experience is preferred over Abinitio - Strong understanding of PySpark execution plans, partitioning, and optimization techniques Education: - Bachelor's degree or equivalent experience This is a full-time position within the Technology job family group, specifically in the Applications Development job family. If you possess the necessary skills and experience, we encourage you to apply and become part of our dynamic team.,