8One Technologies

Experience: 4 – 8 years Must-Have: Design and develop features in the existing Data Lake/ Data Warehouse. Connect structured, semi-structured and unstructured data from sources like databases, flat files and streaming platforms. Normalise, enrich and cleanse raw data to make it usable for analytics, machine learning and reporting. Building streaming and batch pipelines Tune pipelines, queries and storage systems for speed, reliability and cost-efficiency Familiarity with data orchestration Nice to Have: AWS Cloud Platform, managed Data services such as Kinesis, S3, EMR, AWS Glue. Hands-on experience in Data modelling is required. Hands-on experience in Lakehouse / Iceberg / Parquet required. Create visualisations from databases, spreadsheets etc Create dashboards, charts, and reports using tools like Tableau, Power BI, or matplotlib to communicate insights clearly Responsibilities: Participate in the design and help drive the implementation of our data platform based on AWS Cloud. Design, implement, and operate streaming and batch pipelines that scale. Handle developing services, connecting dots by writing scripts in Python using various libraries and python frameworks. Partner with both engineers and data analysts to build reliable datasets that can be trusted, understood, and used by the rest of the company. Familiarity with data orchestration (Apache Airflow, Dagster, Prefect or any current orchestration tool) Embrace a fast-paced start-up environment. You should be passionate about your job and enjoy a fast-paced international working environment.