Job
Description
As a Data Services Engineering Lead joining our innovative development team, you will have the opportunity to lead the design and implementation of cutting-edge data solutions that drive business intelligence and analytics. Your responsibilities will include: - Leading the design, development, and deployment of scalable Java applications integrated with Databricks for big data processing - Architecting and optimizing distributed computing solutions using Apache Spark within the Databricks environment to handle large-scalable datasets efficiently - Implementing and managing data lake house architecture using Databricks, ensuring data integrity, security, and accessibility - Developing and maintaining ETL pipelines using Databricks and Apache Spark, automating data workflows to improve processing efficiency - Providing technical leadership in system architecture design, making informed decisions to meet business requirements and scalability needs - Optimizing cloud resource utilization on platforms like Azure, ensuring cost-effective and reliable data processing solutions - Establishing best-in-class engineering practices through solid design decisions, conducting regular code reviews, and resolving defects at the code and platform level - Ensuring alignment, buy-in, and support of diverse stakeholders by building and maintaining trusting relationships with internal customers, third-party vendors, and senior management - Managing multiple services or applications and providing resources in support of the applications by leveraging partnerships with technology teams, vendors, and business leaders - Leading the team through all technology solution development phases, ensuring adherence to org policies, methodologies, standards, and controls - Educating and aligning the team on departmental standard operating procedures, objectives, key results, and overall operationalization of assigned services - Resolving escalated issues throughout the development, configuration, and modification of integrated business or enterprise application solutions Qualifications required for this role: - Bachelor's degree in Computer Science / Information Technology, or a related field - Proven ability to work in a high-paced environment, be flexible, follow tight deadlines, organize, and prioritize work - 15+ years of experience in Core Java/J2EE development, Solution design & Architecture - 5+ years of experience in Spring, Spring Boot, UI Technologies & SQL/PLSQL (Preferably Snowflake/Databricks) - Expertise in designing scalable, reliable, and secure software architectures including Microservices, APIs, and containerization (Docker, Kubernetes, Helm) - Expertise in Public Cloud (Azure and AWS) technologies - Strong knowledge in modern software development technologies and frameworks - Ability to work closely with cross-functional teams to deliver high-impact solutions - Strong analytical and problem-solving skills with the ability to make critical technical and business decisions - Excellent verbal and written communication skills with the ability to explain complex technical issues to technical and non-technical stakeholders - Strong experience with cloud platforms, especially Microsoft Azure, including services like Azure Data Lake Storage (ADLS) and Azure Data Factory - Solid understanding of data warehousing concepts and hands-on experience with Snowflake & Databricks - Demonstrated excellent Communication Skills with the ability to effectively run meetings and collaborate across teams and functions - Demonstrated intermediate to high level of skill in team management - Experience with version control systems such as Github and familiarity with CI/CD pipelines - Excellent problem-solving skills, attention to detail, and the ability to work effectively in a collaborative team environment Good to have skills include experience with additional programming languages such as Python or Scala, understanding of agile development methodologies, cloud development/architect certification, JAVA certifications, and contributions to open-source projects or active participation in relevant technical communities. Please note that the Job ID for this position is R-771723.,
