NiFi Data Engineer

As a NiFi Data Engineer at the company, your role involves designing, developing, and maintaining scalable data pipelines using NiFi. You will ensure the efficient flow and transformation of data to support the platform's analytical needs. Responsibilities: - Bring the guiding principles to life by enhancing experiences for dealerships and customers, collaborating with colleagues, experimenting with new ideas, taking ownership of work, and adapting to growth and changes. - Collaborate with cross-functional teams to understand data requirements and deliver solutions. - Champion data quality and integrity across the organization. - Apply deep technical knowledge of data engineering principles and practices. - Synthesize insights from complex data sets to drive business and product decisions. - Design, build, and optimize robust data pipelines using Apache NiFi. - Develop and maintain data-processing scripts using Java and Python. - Manage and troubleshoot data ingestion, transformation, and distribution processes to ensure reliability and performance. - Ensure precision in data handling and execution of data-related tasks. Qualifications: - Expertise in building high-performance data pipelines using Apache NiFi, Python, Java, and SQL. - Extensive experience with AWS services like S3, Athena, Glue, EMR, and AWS Batch. - Proficiency in designing and implementing custom data transformations using scripting languages with a focus on governance and security controls. - Strong background in data modeling, designing APIs for data access, and implementing monitoring/alerting strategies for production data pipelines. - Strong problem-solving skills and ability to collaborate effectively within a team environment.,