Hadoop Developers

Translates business requirements and specifications into logical program designs, modules, stable application systems, and data solutions with occasional guidance from senior colleagues; partners with Product Team to understand business needs and functional specifications Develops, configures, or modifies integrated business and/or enterprise application solutions within various computing environments by designing and coding component-based applications using various programming languages Conducts the implementation and maintenance of complex business and enterprise data solutions to ensure successful deployment of released applications Supports systems integration testing (SIT) and user acceptance testing (UAT), provides insight into defining test plans, and ensures quality software deployment Participates in the end-to-end product lifecycle by applying and sharing an in-depth understanding of company and industry methodologies, policies, standards, and controls Understands Computer Science and/or Computer Engineering fundamentals; knows software architecture and readily applies this to Data or Platform solutions Automates and simplifies team development, test, and operations processes; develops conceptual, logical and physical architectures consisting of one or more viewpoints (business, application, data, and infrastructure) required for business solution delivery Solves difficult technical problems; solutions are testable, maintainable, and efficient Data Engineering Responsibilities Supports the build, maintenance and enhancements of data lake development; supports simple to medium complexity API, unstructured data parsing and streaming data ingestion Excels in one more domain; understands pipelines and business metrics Builds, tests and enhances data curation pipelines integration data from a wide variety of sources like DBMS, File systems and APIs for various KPIs and metrics development with high data quality and integrity Supports the development of feature / inputs for data models in an Agile manner Works with Data Science team to understand mathematical models and algorithms; participates in continuous improvement activities including training opportunities; continuously strives to learn analytic best practices and apply them to daily activities Handles data manipulation (extract, load, transform), data visualization, and administration of data and systems securely and in accordance with enterprise data governance standards Maintains the health and monitoring of assigned analytic capabilities for a specific data engineering solution; ensures high availability of the platform; monitors workload demands; works with Infrastructure Engineering teams to maintain the data platform; serves as an SME of one or more application BI Engineering Responsibilities Supports the build, maintenance and enhancements of BI solutions; creates standard and ad hoc reports; uses basic report formatting like sorting, totaling, and exporting Excels in one or more domains; understands pipelines and business metrics Demonstrates database skill (Teradata/Oracle/Db2/Hadoop) by constructing Logical SQL statements, validating MicroStrategy Report SQL and DB SQL for data testing, and using MicroStrategy Web