As a member of the Data Engineering team, you will: Implement continuous improvements to our data governance practices and implement data quality improvements. Partner with key stakeholders to understand and refine data product requirements. Design and develop reliable data product pipelines that transform data at scale, orchestrated via Azure Data Factory, using SQL and Python in Azure Databricks. What you will bring to Databerry Technologies: Experience with relational and MPP databases such as SQL Server and Azure Synapse Analytics. Experience with data modeling techniques (Kimball/Star, Datavault, etc). Experience with SQL and query design on large, complex datasets. Experience with cloud and big-data tools and frameworks like Azure Databricks and Azure Data Factory. Expertise in designing and developing with distributed data processing platforms. Experience using Azure Data Factory to develop data pipelines. Experience using ELT/ETL tools such as Azure Data Factory and Azure Databricks (with Python/PySpark). Familiarity with API ingestion processes. CI/CD with Terraform (Nice to have). Ability to learn new technical concepts quickly. Ability to operate in a fast-paced and dynamic environment. Strong collaboration and communication skills. Passion! We are passionate about our mission and technology, and we want you to demonstrate that too. Ownership! We want you to own your work, be accountable, and push it through to the finish line. Expertise! We do not need you to know everything, but we hope you have deep knowledge in at least one area and can start contributing quickly. We would love to learn from you in your area(s) of expertise. Key Attributes Required: People Skills: Ability to work effectively in cross-functional teams and collaborate openly with data engineers, software engineers, and other stakeholders. Proven track record in conflict resolution, effective communication, and fostering a positive work environment. Customer Service / External Impact: Strong focus on internal customer service to assist software and data engineering teams in achieving their objectives. The ability to effectively communicate with external vendors, client-facing teams, and sometimes clients themselves to ensure seamless deployment and maintenance of services. Decision-Making: Capacity for high-level, strategic decision-making to choose appropriate tools and technologies, while also being capable of low-level technical decisions required for immediate problem solving. Ability to weigh pros and cons and consult with teams for decisions that impact system uptime, security, and the delivery process. Initiative and Independence: Self-starter who can independently identify issues and formulate solutions with minimal supervision. Comfortable taking the initiative to lead projects or research and introduce new technologies that can benefit the system's efficiency, security, and performance. Show more Show less
Role Overview We are seeking a highly skilled Azure Cloud Engineer with deep expertise in designing, automating, and managing enterprise-grade cloud infrastructure. The ideal candidate will have extensive hands-on experience with Terraform, Azure DevOps CI/CD pipelines, and Azure services (Databricks, App Services, AKS, SQL Server, and security frameworks). This role requires close collaboration with developers, data engineers, and security teams to deliver secure, scalable, and high-performing cloud solutions. Key Responsibilities Infrastructure as Code (IaC) Design, provision, and manage Azure infrastructure using Terraform (complex module development, lifecycle management). Maintain reusable infrastructure modules with strong version control practices. CI/CD & Automation Implement and manage CI/CD pipelines using Azure DevOps (YAML-based) for both infrastructure and applications. Automate application deployments, including React.js, Next.js, and ASP.NET Core applications with Entity Framework Core migrations. Develop automation scripts using PowerShell/Python for operational tasks. Azure Services Management Deploy, configure, and administer Azure Databricks (clusters, Unity Catalog, jobs, access controls). Build and maintain application hosting environments using App Services, Virtual Machines, Containers, and AKS . Manage SQL Server including automated backups, restore operations, and performance optimization. Networking & Security Define and enforce secure cloud networking ( VNet peering, DNS, routing, private endpoints, NSGs, ExpressRoute, firewalls ). Integrate and manage cloud security controls: Azure AD, Key Vault, Defender for Cloud, Sentinel, Privileged Identity Management (PIM) . Apply governance and compliance controls ( tagging standards, Azure policies, CIS benchmarks, NIST, ISO frameworks ). Monitoring & Reliability Build and operationalize monitoring, logging, and alerting using Azure Monitor, Log Analytics, and Application Insights . Support operational excellence and ensure high availability in production environments. Collaboration Work closely with developers, data engineers, and security stakeholders to support end-to-end delivery. Document infrastructure designs, standards, and operating procedures. Required Skills & Experience 5+ years of hands-on experience in Azure Cloud Infrastructure Engineering . Strong expertise in Terraform for automating Azure services (mandatory). Proven experience with Azure DevOps and YAML pipelines for full-stack CI/CD (infrastructure + applications). Hands-on experience deploying and managing Next.js, React.js, and ASP.NET Core applications with database migrations. Strong working knowledge of SQL Server administration . Expertise in Azure App Services, Containers, and AKS orchestration . Demonstrated experience in Azure Databricks administration (Unity Catalog, clusters, jobs, access controls). Strong cloud networking expertise ( DNS, routing, VNet peering, ExpressRoute, Private Link ). Knowledge of enterprise security frameworks and role-based access design. Experience building enterprise-grade monitoring and logging in Azure. Proficiency in PowerShell or Python scripting . Nice to Have Familiarity with Azure Bicep . Knowledge of cost management and optimization . Exposure to compliance frameworks ( CIS Benchmarks, NIST, ISO ). Soft Skills Strong problem-solving and infrastructure design abilities. High accountability and independence in handling production workloads. Excellent communication across technical and business stakeholders. Strong documentation, collaboration, and knowledge-sharing habits.