Data Integration Engineer (Mid)
At Dataonez, we value innovation, hard work, and creativity in our employees. If you're looking for a company that values these qualities and provides a supportive work culture, we encourage you to apply. We offer competitive salaries, excellent health benefits, and a team of colleagues who will support you in your career journey.
As a Dataonez employee, you'll have the opportunity to work on some of the most pressing challenges facing government and industry. Whether you're just starting your career or looking for a new opportunity to advance, we have a range of roles that offer both challenges and rewards.
We believe that our employees are our greatest asset, and we are committed to creating a work environment that helps them succeed. If you're interested in joining our team, we encourage you to apply.
Data Integration Engineer (Mid)
Location: Ashburn, VA
Roles & Responsibilities:
Assist in the initial design and build of the foundational data pipeline infrastructure
You should know how to set up test/production environments, including how to monitor/troubleshoot, etc.
You will be an expert advisor who is able to help them build out the foundations in this area.
Install/configure prototype environments as needed, and install/configure development & production environments after technology is selected.
Develop guidelines for data pipeline operations.
Other duties as assigned.
Requirements:
Minimum 5 years of experience working with large data sets using SQL, Python & Python packages (Pandas & Pyspark).
Minimum 3 years of strong experience installing, configuring and deploying data pipeline solutions using Airflow & Prefect, (very important to have).
Minimum 3 years of experience with code hosting platforms for version control and collaboration (I.e. GitHub).
Bachelors degree OR additional related experience is required.
Familiarity with CI/CD tools, like Jenkins X.
Familiarity with container tools (Docker, Kubernetes, etc.)