Job
Description
Love turning raw data into powerful insights? Join us! We're partnering with global brands to unlock the full potential of their data. As a Data Engineer, you'll be at the heart of these transformationsâbuilding scalable data pipelines, optimizing data flows, and empowering analytics teams to make real-time, data-driven decisions. We are seeking a highly skilled Data Engineer with hands-on experience in Databricks to support data integration, pipeline development, and large-scale data processing for our retail or healthcare client. The ideal candidate will work closely with cross-functional teams to design robust data solutions that drive business intelligence and operational efficiency. Key Responsibilities Develop and maintain scalable data pipelines using Databricks and Spark. Build ETL/ELT workflows to support data ingestion, transformation, and validation. Collaborate with data scientists, analysts, and business stakeholders to gather data requirements. Optimize data processing workflows for performance and reliability. Manage structured and unstructured data across cloud-based data lakes and warehouses (e.g., Delta Lake, Snowflake, Azure Synapse). Ensure data quality and compliance with data governance standards. Required Qualifications 4+ years of experience as a Data Engineer. Strong expertise in Databricks, Apache Spark, and Delta Lake. Proficiency in Python, SQL, and data pipeline orchestration tools (e.g., Airflow, ADF). Experience with cloud platforms such as Azure, AWS, or GCP. Familiarity with data modeling, version control, and CI/CD practices. Experience in the retail or healthcare domain is a plus. Benefits Health Insurance, Accident Insurance. The salary will be determined based on several factors including, but not limited to, location, relevant education, qualifications, experience, technical skills, and business needs. Additional Responsibilities Participate in OP monthly team meetings, and participate in team-building efforts. Contribute to OP technical discussions, peer reviews, etc. Contribute content and collaborate via the OP-Wiki/Knowledge Base. Provide status reports to OP Account Management as requested. About Us OP is a technology consulting and solutions company, offering advisory and managed services, innovative platforms, and staffing solutions across a wide range of fields â including AI, cyber security, enterprise architecture, and beyond. Our most valuable asset is our people: dynamic, creative thinkers, who are passionate about doing quality work. As a member of the OP team, you will have access to industry-leading consulting practices, strategies & and technologies, innovative training & education. An ideal OP team member is a technology leader with a proven track record of technical excellence and a strong focus on process and methodology. Show more Show less
