Job
Description
About the Team: Join the Usage Service and OPUS teams to innovate with impact, building scalable, modern solutions that power millions worldwide. As a Data Engineer , you will excel in a data-driven environment, shaping the future with advanced analytics, real-time processing, and AI-driven insights. Partner with top talent, use the latest technologies, and accelerate your career in a culture that values learning, creativity, and new ideas. Candidate will report to Sr. Manager, Software Engineering. Responsibilities: Design, develop, and maintain scalable data pipelines to collect, process, and analyze security-related data from various sources. Apply best practices for data integrity, reliability, and scalability in security data pipelines. Collaborate with partner security teams, leadership, and engineering to implement security solutions that effectively reduce risks in Avalara's cloud environments. Develop automated, cloud-native solutions across multiple hyperscale cloud providers ( AWS, GCP, Azure, OCI ). Ensure compliance with security standards, regulations, and industry best practices , working closely with compliance teams to implement necessary controls and reporting mechanisms. Conduct code and design reviews for internal and customer-facing software solutions. Maintain comprehensive documentation of pipeline architecture, configurations, and processes. Generate regular reports on pipeline performance, data quality, and security incidents. Qualifications: Bachelor's degree in Computer Science, Information Security, or relevant experience. 5+ years of professional experience in data engineering, design, and development roles. Expert-level proficiency in SQL. Strong experience in architecting complex data marts using dbt and Airflow. Proven ability to design and implement data solutions that ensure high data quality and anomaly detection. Hands-on experience with Snowflake for production analytics. Strong understanding of DevOps/DataOps practices , including Git and Terraform. Experience with containerization and orchestration technologies (Docker, Kubernetes, CI/CD). Extensive knowledge of AWS data engineering ecosystem and data security best practices. Experience designing secure cloud architectures across AWS, GCP, Azure, or OCI. Deep understanding of Identity and Access Management (IAM), RBAC Automation, and data security frameworks. Good to Have: Familiarity with global data security requirements such as GDPR, SOC 2, US privacy regulations, and PII protection. Experience in analyzing website traffic and network data. Ability to drive program maturity by evangelizing modern secure architectures and services. AWS or other professional data security certifications. Experience in data modeling. Proficiency in data visualization tools (Power BI, Tableau, Hex, R-Shiny) and data storytelling.
