Data Engineer (SME) CK22
View all jobsData Engineer (SME) CK22McLean, VIRGINIAFuelData Engineer (SME), McLeanDuties And ResponsibilitiesCreate and maintain a data pipeline architectureAssembling large, complex sets of data that meet mission requirementsIdentify, design, and implement improvements including re-designing infrastructure for greater scalability, optimizing data delivery, and automating manual processesBuild required infrastructure for optimal extraction, transformation and loading of data from various data sources using AWS, SQL, NiFi technologiesBuild analytical tools to utilize the data pipeline, providing actionable insight into data performance including operational efficiency and customer acquisitionWorking with mission stakeholders and assist them with data-related technical issuesWorking with technology stakeholders to support their data infrastructure needs while assisting with data-related technical issuesSkills And ExperienceAbility to build and optimize data sets, 'big data' data pipelines and architecturesAbility to perform root cause analysis on external and internal processes and data to identify opportunities for improvement and answer questionsExcellent analytic skills associated with working on unstructured datasetsAbility to build processes that support data transformation, workload management, data structures, dependency and metadataBachelor’s degree in information systems, informatics, statistics, or computer science/software engineeringMinimum of five years of experience using some of the below software and tools:Big data tools like Kafka, Spark and HadoopRelational NoSQL and SQL databases including Cassandra and PostgreSQLWorkflow management and pipeline tools such as Airflow, Luigi and AzkabanAWS close services including Redshift, RDS, EMR and EC2Stream-processing systems like Spark-Streaming and StormObject function/object-oriented scripting languages including Scala, C++, Java and Python.Data workflow orchestration tools including Pentahoe or Apache NiFiAbout Fuel Fuel Consulting LLC helps clients create the path to their future. Clients get expertise that needs no ramp-up time to deliver the best practices, customized tools, and methodologies to help them achieve their vision and leave a legacy. If helping others and working with a team of exceptionally talented individuals excites you, then look no further than Fuel. Fuel offers