Azure Data Engineer

About ProArch:

Founded in 2006, ProArch began as a tight-knit team of business-minded IT professionals passionate about delivering exceptional cloud-based technology solutions. Today, we ve grown into a global force spread across US, UK and India into multidisciplinary experts spanning cloud, infrastructure, data analytics, cybersecurity, compliance, and software development. Organizations turn to ProArch for forward-thinking guidance, seamless implementation, and dependable ongoing support partnering with us to reach every milestone on the path to their vision.

Our services consist of specific practice areas that are methodically designed to complement and enhance each others effectiveness. This interconnected approach removes roadblocks and drives rapid growth and financial stability. Many of our clients leverage the full scope of our services, creating a supply chain of value that impacts the entire organization from IT to customer experience.

At our core, we believe in the power of technology to transform. We re passionate about inspiring innovation that shapes our people, our clients, our partners, and the communities we serve.

About Role:

Azure Data Engineer

Responsibilities

• Design, develop, and optimize data pipelines using Azure Synapse Analytics, Spark Pools, and Azure Data Factory.
• Write efficient Python and SQL code with a focus on scalability, performance, and optimization.
• Manage Azure Data Lake for structured and unstructured data ingestion at scale (volume, variety, velocity).
• Implement CI/CD pipelines and follow DataOps practices for automation and reliability.
• Optimize data partitioning, versioning, and storage/compute costs for large-scale workloads.
• Ensure high-quality solutions through unit testing frameworks and automated validation.
• Collaborate with business teams to support analytics, reporting, and data science initiatives.
• Mentor junior engineers, sharing knowledge and promoting engineering excellence.

• Bachelor s degree in computer science, IT, Data Engineering, or a related field.
• 5+ years of experience in data engineering roles with proven expertise in cloud data platforms.
• Expert in Python and SQL, with strong performance optimization skills.
• Proficiency in Azure Synapse Analytics, Spark Pools, and Azure Data Factory (ADF).
• Hands-on experience with Azure Data Lake and structured ingestion at scale.
• Experience in CI/CD pipelines and applying DataOps principles.
• Ability to manage large datasets with diverse structures, velocity, and volume.

Good to Have Skills

• Experience with Delta Lake, versioned data, and advanced partitioning strategies.
• Knowledge of data governance and security implementations across platforms.
• Strong understanding of advanced data modelling (e. g. , slowly changing dimensions).
• Exposure to cost optimization strategies for cloud storage and compute.
• Experience mentoring or providing technical leadership to junior engineers.

Life @ ProArch

• At ProArch, we believe our people are the key to our success. That s why we foster an environment where every employee known proudly as a ProArchian can grow, thrive, and make a meaningful impact.
• We empower employees to develop at their own pace through

  Career Pathways

  , a clear and supportive guide to professional progression.
• Our culture is one of

  positivity, inclusivity, and respect

  . Titles don t define how we treat each other

  every ProArchian is valued equally

  , and collaboration across roles and teams is the norm.
• We understand that great work starts with balance. That s why we

  prioritize work-life harmony

  , offering flexible work schedules and encouraging time for what matters most.
• Beyond the workplace, ProArchians actively give back organizing

  volunteer efforts and charitable initiatives

  that empower the communities we call home.
• And because we know that extraordinary efforts deserve recognition, we celebrate those who go above and beyond with appreciation programs.
• At ProArch, we re not just using technology to transform businesses

  we re using it to create a better experience for our people, our clients, and our communities.

Competencies:

• Excellent Communication
• Analytical Skills
• Negotiation Skills
• Problem Solving Skills
• Client Engagement
• Relationship Building