Data Engineer

Working in our Data Engineering teams, you will collect and analyze data to develop robust IT solutions that deliver advanced data analytics capabilities to the organization. You will develop database architectures to address business requirements, ensuring system scalability, security, performance, and reliability. Additionally, you will design and document database applications such as interfaces, data transfer mechanisms, and data partitions to enable efficient access of the generic database structure.

Duties

• Has complete knowledge, skills, and understanding of practices for complex programs and initiatives demonstrating creativity and substantial understanding of specialized techniques, processes, procedures.

• Troubleshoot issues and problems of medium complexity for major software applications; break down complex tasks, make reasonable decisions, investigate and fix bugs, and operate independently.

• Initiate independent designs that impact and influence the department’s delivery and approach. Lead reviewing design alternatives, problems, and solutions with an eye on limiting the need for later problem solving.

• Consistently influence and make significant decisions within a project, demonstrating good judgment in selecting methods and techniques for obtaining solutions based in a solid understanding of business strategy and best practices with minimal instructions for difficult or unpredictable situations.

• Contribute individual capabilities to the achievement of group objectives, and work effectively with others in a group setting. This includes mentoring, coaching, and technical guidance for junior members of the team.

• Build successful internal and external partnerships with peers, SMEs, stakeholders, and decision-makers.

• Communicate clear and concise project plans/designs and status updates for a project.

• Ability to work nights and/or weekends, as needed.

• Uphold company mission and values through accountability, innovation, integrity, quality, and teamwork.

• Support and comply with the company’s Quality Management System policies and procedures.

• Maintain regular and reliable attendance.

• Ability to act with an inclusion mindset and model these behaviors for the organization.

Minimum Qualifications

• Bachelor’s Degree in Data Science, Computer Science, Information Systems, Mathematics, or Engineering; or High School Diploma/General Education Degree and 4 years of relevant experience as outlined in the essential duties in lieu of Bachelor’s Degree.

• Complete knowledge and full understanding of software development design and development, and relevant domain specific skills (see below).

• Spark on Snowflake or Databricks.

• Python, Scala, SQL development.

• ETL data pipelines.

• Designing and implementing data modeling solutions using relational, dimensional, and/or NoSQL databases.

• Database architecture testing methodology, including execution of test plans, debugging, and testing scripts and tools.

• Big Data file formats (Parquet, Avro, Delta Lake).

• Cloud Infrastructure services (i.e., AWS, SQS, S3, and GitLab).

• Agile development tools; including, but not limited to, JIRA, Confluence repository.

• RestAPI development.

• Tableau, ideally including performance optimization.

• Demonstrated ability to perform the essential duties of the position with or without accommodation.

Mandatory skills

Databrick

AWS

Pyspark/Python

Thanks

HCL TECH