Data engineers are responsible for building reliable and scalable data infrastructure that enables organizations to derive meaningful insights, make data-driven decisions, and unlock the value of their data assets.The primary focus is to help organizations design, develop, and optimize their data infrastructure and systems. They help organizations enhance data processes, and leverage data effectively to drive business outcomes.Skills (competencies)Industry Standard Data Modeling (FSLDM)Ab InitioIndustry Standard Data Modeling (IBM FSDM))Agile (Software Development Framework)InfluencingApache HadoopInformatica IICSAWS AirflowInmon methodologyAWS AthenaJavaScriptAWS Code PipelineJenkinsAWS EFSKimballAWS EMRLinux - RedhatAWS RedshiftNegotiationAWS S3NetezzaAzure ADLS Gen2NewSQLAzure Data FactoryOracle ExadataAzure Data Lake StoragePerformance TuningAzure DatabricksPerlAzure Event HubPlatform Update ManagementAzure Stream AnalyticsProject ManagementAzure SunapsePySparkBitbucketPythonChange ManagementRClient CentricityRDD OptimizationCollaborationSantOsContinuous Integration and Continuous Delivery (CI/CD)SaSData Architecture PatternsScala SparkData Format AnalysisShell ScriptData GovernanceSnowflakeData ModelingSPARKData ValidationSPARK Code OptimizationData Vault ModelingSQLDatabase Schema DesignStakeholder ManagementDecision-MakingSun SolarisDevOpsSynapseDimensional ModelingTalendGCP Big TableTeradataGCP BigQueryTime ManagementGCP Cloud StorageUbuntuGCP DataFlowVendor ManagementGCP DataProcGitGoogle Big TabelGoogle Data ProcGreenplumHQLIBM Data StageIBM DB2