BI- Data Engineer

Collaborate with cross-functional teams to understand data requirements, define data standards, and design efficient data models and architectures. Develop and implement strategies for data acquisition, transformation, and storage. Evaluate, recommend, and select data warehouse components, including hardware, database management systems, ETL software and data mining tools. Coordinate and work with other IT staff to develop database architectures, coding standards and quality assurance policies and procedures. Build and optimize large-scale data processing sytems for batch and real-time data pipelines. Implement data integration solutions to collect and combine data from various sources. Design and manage databases, ensuring performance, security, and scalability. Conduct regular database maintenance, backups, and updates. Design and implement redundant systems, policies and procedures for disaster recovery and data archiving to ensure availability, protection, and integrity of data assets. Develop and maintain ETL (extract, transform, load) processes to ensure smooth flow of data from source to destination. Troubleshoot and optimize ETL workflows for efficiency. Implement data quality checks and ensure data integrity throughout the data lifecycle. Enforce data governance policies and best practices. Work closely with data analysts, data governance and other stakeholders to understand their data requirements and provide support. Collaborate with IT and business teams to integrate data engineering solutions into existing systems. Identify and resolve Performance bottlenecks in data pipelines and databases. Optimize queries and processes for improved efficiency. Maintain comprehensive documentation for data processes, workflows, and systems. Provide training and support to other team members as required.

Essential Skills:

Excellent English communication skills, both verbal and written.
Proficient with Microsoft applications and computer skills Strong understanding of business processes and data flows. Strong interpersonal, communication and collaboration skills. Excellent problem solving, troubleshooting and analytical skills. Demonstrated successful ability to organize and prioritize work to ensure timely deadlines. Thrives in a team-oriented environment while capable of working autonomously. Strong attention to detail and ability to navigate ambiguous situations. Good time management and ability to manage multiple concurrent projects/tasks within time constraints.

Must Have Technical Skills:
Minimum of 5 years in data engineering, database design and ETL development Hands on experience with data architecting, data mining, large scale data modeling and business requirements gathering/analysis. Proficiency in programming languages such as Python, Java or SQL. Strong knowledge of database management systems (i.e., SQL, NoSQL). Familiarity with big data technologies (i.e., Hadoop, Spark, Kafka) and cloud platforms (i.e., AWS, Azure, GCP). Understanding of data modeling and design principles. Advanced data manipulation skills: read in data, process and clean it, transform and recode it, merge different data sets, reformat data between wide and long, etc. Technical expertise in data models, data mining, and segmentation techniques. Experience with data processing flowcharting techniques

Preferred Skills:
Power BI visualization experience Experience with data warehousing solutions. Knowledge of data security, compliance and applicable data privacy practices and laws. Understanding of machine learning concepts and data analytics. Familiarity with ERP systems and integrations (JDE) a plus. Experience Power BI a plus. Experience with ServiceNow ticketing system a plus. Experience in Microsoft platforms, Data Bricks and Azure Data Factor preferred.

Education:
Bachelor s degree in Information Technology, Computer Science, or related field