Custom Software Engineer

 About The Role  

Project Role :Custom Software Engineer

Project Role Description :Develop custom software solutions to design, code, and enhance components across systems or applications. Use modern frameworks and agile practices to deliver scalable, high-performing solutions tailored to specific business needs.
Must have skills :Palantir Foundry, MySQL, Python (Programming Language), PySpark

Good to have skills :NA
Minimum 5 year(s) of experience is required

Educational Qualification :15 years full time education
Position OverviewWe are seeking a skilled and motivated Data Engineer to join our dynamic analytics and data transformation team. The ideal candidate will have hands-on experience with Palantir Foundry, PySpark, Python, and advanced SQL. As a key contributor, you will help design, develop, and optimize data solutions that empower business stakeholders and drive impactful data-driven decisions.Key Responsibilities¢"¢Develop and maintain robust data pipelines and workflows within the Palantir Foundry platform.¢"¢Leverage PySpark and Python for large-scale data processing, transformation, and integration across diverse data sources.¢"¢Design, implement, and optimize advanced SQL queries for data extraction, manipulation, and analysis.¢"¢Collaborate closely with business analysts, data scientists, and other engineers to translate business requirements into scalable data solutions.¢"¢Ensure data quality, integrity, and security throughout the data lifecycle.¢"¢Troubleshoot, debug, and optimize data workflows for performance and reliability.¢"¢Document architecture, processes, and best practices for ongoing support and knowledge sharing.Required Skills & Qualifications¢"¢Palantir Foundry:Proven experience building data pipelines, managing datasets, and deploying applications within Foundry. Specifics required are as follows:Practical skills required to build and maintain production-grade data pipelines, data connections, and ontologiesGeneral knowledge of platform capabilities and specific applications within the Foundry suite that are useful for performing the job of data engineerDATA PIPELINE DEVELOPMENT IN FOUNDRYDevelop transforms on structured (tabular) and unstructured datasets in FoundryApply best practices when building data pipelinesDATA PIPELINE MAINTENANCE IN FOUNDRYEffectively investigate and fix common issues in data pipelinesContribute to logic changes and performance improvements to transform pipelines feeding mission critical workflowsFamiliarity with recommended support structuresDATA CONNECTION AND INTEGRATION IN FOUNDRYFamiliarity with architecture and capabilities of Data ConnectionSet up sources and syncs ingesting tabular data or raw files from external systems to FoundryONTOLOGY DESIGN AND DEVELOPMENT IN FOUNDRYProvide data engineering context during ontology design and implement pipelines backing ontology objects and links based on application requirements¢"¢Spark/PySpark:Strong expertise in distributed data processing and transformation using Spark/PySpark.¢"¢Python:Proficiency in Python for scripting, automation, and data wrangling tasks.¢"¢SQL:Advanced skills in writing efficient SQL queries for complex data manipulation and reporting.¢"¢Familiarity with data modeling, ETL processes, and best practices in data engineering.¢"¢Experience working with large and complex data sets from multiple sources.¢"¢Excellent problem-solving, communication, and collaboration skills.Preferred Qualifications¢"¢Bachelors or Masters degree in Computer Science, Engineering, Mathematics, or a related field.¢"¢Prior experience in a data engineering or analytics-focused role within a fast-paced environment.¢"¢Knowledge of additional big data technologies or cloud platforms (e.g., AWS, Azure, Databricks) is a plus.¢"¢Certification in Palantir Foundry (Foundational/Professional) will be an added advantage Qualification 15 years full time education