Data Engineer 2

Position Summary

We are seeking a skilled engineer to support our fab automation initiative within semiconductor manufacturing. This role will focus on designing and implementing data engineering solutions to build and maintain an Industrial Engineering (IE) database, as well as developing interactive applications that enable end-users to view, edit, and analyze manufacturing data. The ideal candidate will have hands-on experience with ETL processes (Excel Oracle), Python-based data transformation (using pandas or similar), and full-stack development for database-driven web applications.

Key Responsibilities

• Analyze existing Excel worksheets and map them to normalized Oracle tables
• Develop and maintain automated Python/SQL pipelines (using pandas, SQLAlchemy, etc.) to load new Excel exports into the database on a scheduled basis
• Write Python scripts to standardize, clean, and transform raw data (e.g., handle missing values, normalize formats)
• Write efficient SQL queries (including joins, window functions, aggregates) and create views to support analysis
• Build backend APIs (Flask, Django, or FastAPI) to expose database operations securely
• Develop front-end interfaces (HTML/CSS/JavaScript or React/Vue) that allow users to query, visualize, and update data
• Integrate plotting or dashboard libraries (e.g., Plotly, Bokeh) for interactive analytics
• Automate recurring tasks (scheduled data loads, report generation) using cronjobs, Airflow, or similar tools
• Work closely with IE, simulation, and IT teams to gather requirements and incorporate feedback: Collaborate with cross-functional stakeholders to understand needs and iterate on solutions based on their input.

Required Experience and Skills

• Bachelor’s degree in Technical Fields (IT, Computer Science, Data Engineering or equivalent experience). The degree should from an accredited university.
• ETL & Data Integration: Excel Oracle (or another RDBMS) using Python, PL/SQL/T-SQL, and bulk‐load tools (e.g., SQL*Loader). Handling incremental updates, data integrity checks, and performance optimization.
• Data Cleaning & Python: Expertise in Python 3.x, especially pandas and NumPy for data wrangling. Building robust data‐validation pipelines and modular transformation scripts.
• Database Design & SQL: Designing normalized schemas, defining keys/constraints, and indexing strategies. Writing optimized SQL queries (complex joins, window functions, aggregates) and troubleshooting performance.
• Web Application Development: Experience with Python web frameworks (Flask, Django, or FastAPI) and RESTful API design. Familiarity with front-end technologies (HTML5, CSS3, JavaScript) and at least one JS framework (React or Vue). Integrating interactive visualizations (Plotly, Bokeh, or similar).
• Strong documentation skills to enhance the project maintenance.
• Strong written/verbal communication to translate technical concepts for non-technical stakeholders.
• Detail-oriented, with a focus on clean, maintainable code and thorough documentation.

Desired Experience and Skills

• Semiconductors manufacturing experience, IE/manufacturing background
• 5 years of experience preferred