Apache NiFi Data Engineer

As a NiFi Data Engineer at the company, your role will involve designing, developing, and maintaining scalable data pipelines using NiFi. Your primary responsibility will be to ensure the efficient flow and transformation of data to support the organization's innovative platform and analytical needs. **Responsibilities:** - **Core Competencies:** - Bring guiding principles to life by enhancing experiences for dealerships and customers. - Collaborate with colleagues across A2Z Sync to try new ideas with purpose. - Take responsibility for your work and adapt to change as the company grows. - **Leadership Competencies:** - Collaborate with cross-functional teams to understand data requirements and deliver solutions. - Champion data quality and integrity across the organization. - **Job Family Competencies - Knowledge:** - Apply deep technical knowledge of data engineering principles and practices. - Synthesize insights from complex data sets to inform business and product decisions. - **Functional Competencies - Skills and Execution:** - Design, build, and optimize robust data pipelines using Apache NiFi. - Develop and maintain data-processing scripts using Java and Python. - Manage and troubleshoot data ingestion, transformation, and distribution processes to ensure reliability and performance. - Ensure precision in data handling and execution of data-related tasks. **Qualification Required:** - **Preferred Skills:** - Expertise in building high-performance data pipelines using Apache NiFi, Python, Java, and SQL. - Extensive experience working with AWS services like S3, Athena, Glue, EMR, and AWS Batch. - Comfortable designing and implementing custom data transformations using scripting languages like Groovy or Python with a focus on governance and security controls. - Strong background in data modeling, designing APIs for data access, and implementing monitoring/alerting strategies for production data pipelines. - Strong problem-solving skills and ability to collaborate within a team environment. Immediate joiners are preferred for this role.,