Data Platform Engineer

Job Description

Project Role : Data Platform Engineer Project Role Description : Assists with the data platform blueprint and design, encompassing the relevant data platform components. Collaborates with the Integration Architects and Data Architects to ensure cohesive integration between systems and data models. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : A Engineering graduate preferably Computer Science graduate 15 years of full time education Summary :Overall, 4+ years of experience In Industry including 2 Years of experience As Developer using Big Data Technologies like Databricks/Spark and Hadoop Ecosystems - Hands on experience on Spark Scala streaming, Kafka and NoSQL databases is mandatory. Writing SQL scripts in ADLS using Hive or any other application is a Must. Expert in collecting, parsing, managing, analysing and visualizing large sets of data to turn information into insights using multiple platforms. Working knowledge on distributed processing, data warehouse concepts, NoSQL, huge amount of data processing, RDBMS, Testing, data management principles, data mining and data modellingAs a Data Platform Engineer, you will be responsible for assisting with the blueprint and design of the data platform components using Databricks Unified Data Analytics Platform. Your typical day will involve collaborating with Integration Architects and Data Architects to ensure cohesive integration between systems and data models. Roles & Responsibilities: Assist with the blueprint and design of the data platform components using Databricks Unified Data Analytics Platform. Collaborate with Integration Architects and Data Architects to ensure cohesive integration between systems and data models. Develop and maintain data pipelines using Databricks Unified Data Analytics Platform. Troubleshoot and resolve issues related to data pipelines and data platform components. Ensure data quality and integrity by implementing data validation and testing procedures. Professional & Technical Skills: Must To Have Skills:Experience with Databricks Unified Data Analytics Platform. Must To Have Skills:Strong understanding of data modeling and database design principles. Good To Have Skills:Experience with Apache Spark and Hadoop. Good To Have Skills:Knowledge of SQL and NoSQL databases. Experience with data integration and ETL processes. Experience with cloud-based data platforms such as AWS or Azure. Additional Information: The candidate should have a minimum of 3 years of experience in Databricks Unified Data Analytics Platform. The ideal candidate will possess a strong educational background in computer science, software engineering, or a related field, along with a proven track record of delivering impactful data-driven solutions. This position is based at our Chennai, Bengaluru, Hyderabad and Pune office. Qualification A Engineering graduate preferably Computer Science graduate 15 years of full time education