IDF Dataflow Analyst

Description: SFI is seeking an IDF Dataflow Analyst to support a large-scale data modernization initiative transitioning legacy, on-premise systems into a centralized, high-availability cloud data platform. This role is part of a Dataflow Team that serves as the critical bridge for the movement of real-time, high-volume data across a complex enterprise environment. Over the next 6–12 months, the primary focus will be on supporting the development and population of a centralized, real-time data repository designed to enable scalable data access, advanced analytics, and future AI/ML capabilities. Key Responsibilities Support the ingestion and migration of large-scale datasets into a cloud-based data platform Assist in modernizing legacy dataflow pipelines into automated, cloud-native solutions Maintain high availability and reliability of real-time data delivery across hybrid environments Monitor, troubleshoot, and optimize data ingestion and routing processes Primary Responsibilities Data Lifecycle Management: Manage the end-to-end flow of real-time data, including validation, quality control, archival, and retrieval Cloud Data Ingest Support: Execute and support ingestion processes for mission-critical datasets into the cloud environment Pipeline Modernization: Assist in transitioning legacy workflows into API-driven and automated scripting solutions (Python/Bash) Operational Monitoring & Support: Ensure continuous data flow in a 24/7 environment; troubleshoot and resolve data delivery issues System Integration & Performance: Monitor and optimize data routing applications and cloud services to ensure performance and low latency Scripting & Maintenance: Maintain and enhance scripts and legacy tools (Bash, Perl, SQL) while supporting migration to modern solutions CI/CD & Automation: Support automated deployment, testing, and monitoring of dataflow applications and pipelines Tier 2 Support: Serve as a technical escalation point for complex data ingestion and formatting issues Documentation: Develop and maintain technical documentation, processes, and configuration standards On-Call Support: Participate in a 24/7 on-call rotation to support mission-critical operations Stakeholder Collaboration: Work with internal teams and external partners to resolve data access, formatting, and integration challenges Requirements: Education & Experience Bachelor’s degree in Computer Science, Information Systems, or related field (or equivalent experience) 5–8 years of experience in a technical, data, or systems support role 1–2 years of hands-on experience with cloud platforms (AWS, Azure, or GCP) Strong scripting experience in Python and Bash (Perl experience a plus) Experience supporting data pipelines, ETL processes, or system integrations Familiarity with CI/CD tools and automated workflows Minimum 2 years of Linux/Unix system administration or support experience Ability to obtain and maintain a Public Trust clearance Desired Skills & Qualifications Meteorological Domain Expertise: Experience working with scientific data dissemination and observation systems within NOAA, NASA, or Department of Defense environments; familiarity with standard meteorological data formats such as METAR, TAF, GRIB, and BUFR. System Monitoring: Hands-on experience with enterprise monitoring tools, including Big Brother, Nagios, or cloud-native solutions (e.g., Amazon CloudWatch) to ensure system performance, availability, and reliability. Database Management: Proficiency in SQL and a strong understanding of relational database design, querying, and maintenance. Version Control: Experience using version control and change management tools such as Git, Subversion (SVN), or similar platforms. Certifications Required (one of the following) One foundational or associate-level cloud certification (e.g., AWS Certified Cloud Practitioner or equivalent) Desired Advanced cloud certifications Additional Information: Clearance: Must be authorized to work in the U.S. Background checks may include Criminal History, Education Verification, Employment Verification, Professional Certifications, and Credit History. (Public Trust investigations typically take 4–8 weeks and require fingerprinting.) Work Environment: Remote Salary Range: $65,000 – $100,000 annually Benefits: SFI offers a comprehensive benefits package. Details available at SFI Careers. This is a full-time, W2 position. No agencies, third parties, or Corp-to-Corp submissions. Spatial Front Inc. is an Equal Opportunity Employer — all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, or protected veteran status. SFI participates in E-Verify.