Data Engineer - Databricks

As a Data Engineer at our company, your role will involve designing, developing, and maintaining data pipelines to extract data from Oracle Symphony via APIs, process and store it in the Databricks Lakehouse platform, and integrate it into Oracle EPM for financial planning, reporting, and analytics. Key Responsibilities: - Design and implement end-to-end pipelines from Oracle Symphony into Databricks Lakehouse. - Develop efficient ETL/ELT processes in Databricks (PySpark, Delta Lake) to transform, cleanse, and enrich data. - Build and maintain data flows from Databricks into Oracle EPM to support reporting, forecasting, and planning. - Ensure data quality, consistency, and governance across Symphony, Databricks, and EPM. - Optimize pipeline performance, scalability, and reliability. - Collaborate with data architects, finance teams, and Oracle specialists to meet business needs. - Troubleshoot pipeline issues and provide production support for data integration processes. - Document architecture, pipeline logic, and integration workflows. - Stay current on Databricks, Oracle, and API integration best practices. Qualifications Required: - Bachelors or Masters degree in Computer Science, Data Engineering, or related field. - 10+ years of experience in data engineering, ETL/ELT, and data pipeline development. - Hands-on experience with Databricks (PySpark, Delta Lake, MLflow). - Strong experience with APIs (REST, SOAP, JSON, XML) for data extraction and integration. - Proficiency in SQL, Python, and Spark for data processing. - Experience with cloud platforms (Azure, AWS, or GCP) for hosting Databricks and related services. - Knowledge of data modeling, data governance, and performance tuning. - Strong problem-solving skills and ability to work in cross-functional teams. This is a Full-time/Contract position. If you are interested, kindly share your updated profile to pavani@sandvcapitals.com or reach us on 7995292089. Thank you. As a Data Engineer at our company, your role will involve designing, developing, and maintaining data pipelines to extract data from Oracle Symphony via APIs, process and store it in the Databricks Lakehouse platform, and integrate it into Oracle EPM for financial planning, reporting, and analytics. Key Responsibilities: - Design and implement end-to-end pipelines from Oracle Symphony into Databricks Lakehouse. - Develop efficient ETL/ELT processes in Databricks (PySpark, Delta Lake) to transform, cleanse, and enrich data. - Build and maintain data flows from Databricks into Oracle EPM to support reporting, forecasting, and planning. - Ensure data quality, consistency, and governance across Symphony, Databricks, and EPM. - Optimize pipeline performance, scalability, and reliability. - Collaborate with data architects, finance teams, and Oracle specialists to meet business needs. - Troubleshoot pipeline issues and provide production support for data integration processes. - Document architecture, pipeline logic, and integration workflows. - Stay current on Databricks, Oracle, and API integration best practices. Qualifications Required: - Bachelors or Masters degree in Computer Science, Data Engineering, or related field. - 10+ years of experience in data engineering, ETL/ELT, and data pipeline development. - Hands-on experience with Databricks (PySpark, Delta Lake, MLflow). - Strong experience with APIs (REST, SOAP, JSON, XML) for data extraction and integration. - Proficiency in SQL, Python, and Spark for data processing. - Experience with cloud platforms (Azure, AWS, or GCP) for hosting Databricks and related services. - Knowledge of data modeling, data governance, and performance tuning. - Strong problem-solving skills and ability to work in cross-functional teams. This is a Full-time/Contract position. If you are interested, kindly share your updated profile to pavani@sandvcapitals.com or reach us on 7995292089. Thank you.