Data Engineer
ARCHIVED
We can't find an active application page for this role right now. It may reopen or be listed elsewhere. Use Next Steps to search for an active apply link and similar live jobs.
Title: Data Engineer 5Location: Beaverton, OR
Duration: 8 months contract
Role Responsibilities:
- Contribute to Design and implement data products and features in collaboration with product owners, data analysts, and business partners using Agile / Scrum methodology
- Contribute to overall architecture, frameworks and patterns for processing and storing large data volumes
- Contribute to evaluation of new technologies/tools/frameworks centered around high-volume data processing
- Translate product backlog items into logical units of work in engineering
- Implement distributed data processing pipelines using tools and languages prevalent in the big data ecosystem
- Build utilities, user defined functions, libraries, and frameworks to better enable data flow patterns
- Work with engineering leads and other teams to ensure quality solutions are implemented, and engineering best practices are defined and followed
- Build and incorporate automated unit tests and participate in integration testing efforts
- Utilize and advance continuous integration and deployment frameworks
- Troubleshoot data issues and perform root cause analysis
- Work across teams to resolve operational & performance issuesWHAT YOU BRINGBachelor’s degree in Computer Science, or related technical discipline 10+ years of experience in large-scale software development, 5+ years of big data experience
- Programming experience, Python or Scala preferred.
- Experience working with Hadoop and related processing frameworks such as Spark, Hive, etc.
- Experience with messaging/streaming/complex event processing tooling and frameworksExperience with data warehousing concepts, SQL and SQL Analytical functions
- Experience with workflow orchestration tools like Apache Airflow
- Experience with source code control tools like Github or Bitbucket
- Ability to communicate effectively, both verbally and written, with team members
- Interest in and ability to quickly pick up new languages, technologies, and frameworksExperience in Agile/Scrum application developmentnice to have:
- Experience with Java
- Experience working in a public cloud environment, particularly AWS, databricks
- Experience with cloud warehouse tools like Snowflake
- Experience working with NoSQL data stores such as HBase, DynamoDB, etc.
- Experience building RESTful API’s to enable data consumption
- Experience with build tools such as Terraform or Cloud
- Formation and automation tools such as Jenkins or Circle CIExperience with practices like Continuous Development, Continuous Integration (CI/CD) and Automated Testing