IDF Dataflow Analyst

Job TypeFull-timeDescriptionSFI is seeking an IDF Dataflow Analyst to support a large-scale data modernization initiative transitioning legacy, on-premise systems into a centralized, high-availability cloud data platform. This role is part of a Dataflow Team that serves as the critical bridge for the movement of real-time, high-volume data across a complex enterprise environment.Over the next 6–12 months, the primary focus will be on supporting the development and population of a centralized, real-time data repository designed to enable scalable data access, advanced analytics, and future AI/ML capabilities.Key ResponsibilitiesSupport the ingestion and migration of large-scale datasets into a cloud-based data platformAssist in modernizing legacy dataflow pipelines into automated, cloud-native solutionsMaintain high availability and reliability of real-time data delivery across hybrid environmentsMonitor, troubleshoot, and optimize data ingestion and routing processesPrimary ResponsibilitiesData Lifecycle Management: Manage the end-to-end flow of real-time data, including validation, quality control, archival, and retrievalCloud Data Ingest Support: Execute and support ingestion processes for mission-critical datasets into the cloud environmentPipeline Modernization: Assist in transitioning legacy workflows into API-driven and automated scripting solutions (Python/Bash)Operational Monitoring & Support: Ensure continuous data flow in a 24/7 environment; troubleshoot and resolve data delivery issuesSystem Integration & Performance: Monitor and optimize data routing applications and cloud services to ensure performance and low latencyScripting & Maintenance: Maintain and enhance scripts and legacy tools (Bash, Perl, SQL) while supporting migration to modern solutionsCI/CD & Automation: Support automated deployment, testing, and monitoring of dataflow applications and pipelinesTier 2 Support: Serve as a technical escalation point for complex data ingestion and formatting issuesDocumentation: Develop and maintain technical documentation, processes, and configuration standardsOn-Call Support: Participate in a 24/7 on-call rotation to support mission-critical operationsStakeholder Collaboration: Work with internal teams and external partners to resolve data access, formatting, and integration challengesRequirementsEducation & ExperienceBachelor’s degree in Computer Science, Information Systems, or related field (or equivalent experience)5–8 years of experience in a technical, data, or systems support role1–2 years of hands-on experience with cloud platforms (AWS, Azure, or GCP)Strong scripting experience in Python and Bash (Perl experience a plus)Experience supporting data pipelines, ETL processes, or system integrationsFamiliarity with CI/CD tools and automated workflowsMinimum 2 years of Linux/Unix system administration or support experienceAbility to obtain and maintain a Public Trust clearanceDesired Skills & QualificationsMeteorological Domain Expertise: Experience working with scientific data dissemination and observation systems within NOAA, NASA, or Department of Defense environments; familiarity with standard meteorological data formats such as METAR, TAF, GRIB, and BUFR. System Monitoring: Hands-on experience with enterprise monitoring tools, including Big Brother, Nagios, or cloud-native solutions (e.g., Amazon CloudWatch) to ensure system performance, availability, and reliability. Database Management: Proficiency in SQL and a strong understanding of relational database design, querying, and maintenance. Version Control: Experience using version control and change management tools such as Git, Subversion (SVN), or similar platforms.Certifications Required (one Of The Following)One foundational or associate-level cloud certification (e.g., AWS Certified Cloud Practitioner or equivalent)DesiredAdvanced cloud certificationsAdditional InformationClearance: Must be authorized to work in the U.S.Background checks may include Criminal History, Education Verification, Employment Verification, Professional Certifications, and Credit History. (Public Trust investigations typically take 4–8 weeks and require fingerprinting.)Work Environment: RemoteSalary Range: $65,000 – $100,000 annuallyBenefits: SFI offers a comprehensive benefits package. Details available at SFI Careers.This is a full-time, W2 position.No agencies, third parties, or Corp-to-Corp submissions.Spatial Front Inc. is an Equal Opportunity Employer — all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, or protected veteran status.SFI participates in E-Verify.Salary Description$65,000.00 - $100,00.00 annually