Senior Data Engineer

Job PostingJob InformationJob Opening ID 5725Date Opened 08/19/2019Job Type ContractLanguage Skills EnglishLocation Beaverton, OregonIndustry IT ServicesCity BeavertonState/Province OregonCountry United StatesZip/Postal Code 97006Job DescriptionResponsibilitiesDesign and implement distributed data processing pipelines using Spark, Hive, Sqoop, Python, and other tools and languages prevalent in the Hadoop ecosystem. Ability to design and implement end to end solution.Build utilities, user defined functions, and frameworks to better enable data flow patterns.Research, evaluate and utilize new technologies/tools/frameworks centered around Hadoop and other elements in the Big Data space.Build and incorporate automated unit tests, participate in integration testing efforts.Work with teams to resolving operational & performance issuesWork with architecture/engineering leads and other teams to ensure quality solutions are implemented, and engineering best practices are defined and adhered to.QualificationsMS/BS degree in a computer science field or related discipline6+ years' experience in large-scale software development2+ year experience in Hadoop2+ year experience in Data ScienceStrong development skills around Hadoop, Spark, MapReduce, HiveStrong Java programming, Python, shell scripting, and SQLGood understanding of file formats including Parquet, Avro, JSON and othersGood understanding of R, TensorFlow, SAS or similarExperience with performance/scalability tuning, algorithms and computational complexityExperience (at least familiarity) with data warehousing, dimensional modeling and ETL developmentProven ability to work cross functional teams to deliver appropriate resolutionNice to haveExperience with AWS components and services, particularly, EMR, S3, and LambdaFront end UI development experience, specifically Node JS or Angular JSMachine learning frameworks