UMG - Sr. Data Engineer

Job Description

Primary skills- Python, SQL Coding skills, Big Query, Dataflow, Airflow, Kafka and Airflow Dags. Bachelors Degree or equivalent experience in Computer Science or related field Required- Immediate or 15 days Job Description 7+ years experience as a software engineer or equivalent designing large data-heavy distributed systems and/or high-traffic web-apps Experience in at least one programming language (Python strongly preferred) Hands-on experience designing & managing large data models, writing performant SQL queries, and working with large datasets and related technologies Experience designing & interacting with APIs (REST/GraphQL) Experience working with cloud platforms such as AWS, GCP, or Azure (GCP preferred) Experience in DevOps processes/tooling (CI/CD, GitHub Actions), using version control systems (Git strongly preferred), and working in a remote software development environment Strong analytical, problem solving and interpersonal skills, have a hunger to learn, and the ability to operate in a self-guided manner in a fast-paced rapidly changing environment Preferred: Experience using infrastructure as code frameworks (Terraform) Preferred: Experience using big data tools such as Spark/PySpark Preferred: Experience using or deploying MLOps systems/tooling (eg. MLFlow) Preferred: Experience in pipeline orchestration (eg. Airflow) Preferred: Experience using infrastructure as code frameworks (Terraform) Preferred: Experience in an additional programming language (JavaScript, Java, etc) Preferred: Experience developing UI/UX with modern tools (React, etc) Preferred: Experience using data science/machine learning technologies