Databricks developer

Job Description

Job Title : Databricks Developer Experience - 4 to 7Location: PuneRelevant Experience Required (in Yrs.)3+ years direct experience in analyzing and deriving source systems, data governance, metadata management, data architecture, data quality and metadata related outputStrong experience in different type of “Data Analysis” covering business data, metadata, master data, analytical data.Language RequirementEnglishKey words to search in resumeDatabricks, AZURE Data FactoryTechnical/Functional Skills -MUST HAVE SKILLS3+ years hands-on experience with DatabricksThis role will be responsible for conducting assessment of the existing systems in the land scapeDevise a strategy for SAS to Databricks migration activitiesWork out on a plan to perform the above said activitiesWork closely with customer on daily basis and present the progress made and the plan of actionInteract with onsite and offshore cognizant associates to ensure that the project deliverables are on trackSecondary SkillsData Management solutions with capabilities, such as Data Ingestion, Data Curation, Metadata and Catalog, Data Security, Data Modeling, Data WranglingResponsibilitiesHands on experience in installing, Configuring and using MS Azure Data bricks and Hadoop ecosystem components like DBFS, Parquet, Delta Tables, HDFS, Map Reduce programming, Kafka, Spark & Event Hub.In depth understanding of Spark Architecture including Spark Core, Spark SQL, Data Frames, Spark Streaming, RDD caching, Spark MLib.Hands on experience in Scripting languages like Scala & Python.Hands on experience in Analysis, Design, Coding & Testing phases of SDLC with best practices.Expertise in using Spark SQL with various data sources like JSON, Parquet and Key Value Pair.Experience in creating tables, partitioning, bucketing, loading and aggregating data using Spark SQL/Scala.