We are seeking a highly skilled and experienced Intermediate Level
Automation Engineer
to join our team. The ideal candidate will specialize in designing, developing, and maintaining robust automation solutions, with a strong emphasis on cloud-native orchestration tools like Cloud Composer/Airflow. This role requires deep proficiency in Python for complex scripting, solid expertise in SQL for data integration, and a comprehensive understanding of cloud automation techniques to streamline our data pipelines and infrastructure management across cloud environments. Qualified individuals must be able to embrace, learn and use home grown tools and open source software to support daily development activity.
What You Will Do
- Design, develop, and implement complex automated workflows and ETL/ELT pipelines using Cloud Composer and Airflow for scheduling, monitoring, and managing tasks.
- Leverage advanced Python scripting to build robust, scalable, and maintainable automation tools and services that interact with cloud APIs and services.
- Write, optimize, and manage complex SQL queries and stored procedures for data manipulation, transformation, and integration within automated processes.
- Lead the integration of automated solutions with various cloud platforms (e.g., AWS, Azure, GCP) and third-party systems.
- Collaborate with Sales, Customers and DevOps teams to define requirements and implement best practices for workflow management and cloud automation.
- Troubleshoot and resolve complex issues within Airflow DAGs, cloud infrastructure, and data pipelines, ensuring high reliability and performance.
- Drive the adoption of Infrastructure as Code (IaC) principles and tools (e.g., Terraform) for automating infrastructure provisioning.
- Mentor junior team members and participate in regular, thorough code reviews.
- Lead and develop a repeatable framework enabling automation across Operations delivery channels (Snowflake, AWS, Google) and batch platforms
- Ability to apply and use Agile methodologies
What Experience You Need
- BS or Associate's Degree/Technical Certification
- 3-5 years related experience
- Experience tracking project costs, schedules, scope, and risk, with appropriate reporting of status and variance.
- Working knowledge of Google Suite Tools, Confluence and JIRA
- Experience with scripting tools
- Excellent verbal, written and ‘attention to detail’ skills
- Ability to work independently and with minimal supervision
- Strong interpersonal and time management skills
- A basic understanding of infrastructure and application components
- A sound understanding of SDLC Methodologies including Scrum and Agile Principles
- Ability and desire to work with people all over the world, with the probability of a varying work schedule to accommodate different time zones
What Could Set You Apart
- Experience using tools/technologies to develop infrastructure as code (IAC) such as Terraform, Chef, Ansible, Puppet
- Experience using or integrating CI/CD technologies such as Jenkins, GitHub, Sonar, Nexus
- Experience designing/developing Policy as Code
- Software development experience in 2 or languages
- Experience in system administration for OS (Linux, Windows) and/or middleware (web servers, application servers, database, etc)
- Experience working in a hybrid cloud environment or transforming applications from on-premise data centers to public cloud
- Experience with one or more Public Cloud Providers (Google, Amazon, Azure)
