Data Engineer

OTR Solutions is an innovator in the transportation industry providing a suite of factoring, fuel, and business management solutions. We help new and established companies get fast access to the funds they need for daily operations. As a Private Equity-backed FinTech company, we are scaling our technology and AI capabilities to deliver next-generation automation and document intelligence solutions for the freight and financial services industries. OTR has been recognized as a “Top Workplace” by the Atlanta Journal-Constitution since 2016! As a Data Engineer – External Data Integrations, you will design, build, and maintain scalable batch-oriented data pipelines that enable secure and reliable data exchange between OTR and external systems. You will play a key role in developing integrations with third-party platforms, supporting internal data operations, and ensuring data quality and observability across mission-critical workflows.This role combines data engineering and integration development, requiring close collaboration with Engineering, Business Intelligence, and business stakeholders to deliver scalable solutions that support automation, reporting, and business growth initiatives.Please note: We do not sponsor work-related visas.** Responsibilities: Design and build scalable batch ingestion pipelines from external systems, including APIs, SFTP sources, and databasesDevelop outbound data pipelines to securely publish structured data to external partners and third-party platformsBuild, maintain, and optimize Azure Synapse pipelines and notebook-based transformations using PySpark and Spark SQLOrchestrate workflows using Azure Logic Apps, including scheduling, retries, monitoring, and alertingDesign and implement data quality validation, observability, and monitoring frameworks to ensure pipeline reliability and SLA adherenceDefine and maintain schema standards, versioning strategies, and partner-facing data contractsBuild secure integrations with third-party systems using modern authentication methods including OAuth and Azure Key VaultPartner with Engineering, Product, and Business Intelligence teams to define integration requirements and scalable data exchange patternsTroubleshoot complex integration issues and continuously improve performance, reliability, and maintainability of data pipelinesIdentify opportunities to automate and streamline data workflows across systems What we look for: 4–7+ years of experience in Data Engineering, Integration Engineering, or similar technical rolesStrong experience designing and maintaining batch-oriented data pipelines at scaleHands-on experience with Azure Synapse Analytics, Spark/Python, and Azure Logic AppsExperience integrating with REST APIs, SFTP workflows, and external data providersStrong SQL skills with experience transforming and modeling large datasetsUnderstanding of data observability, monitoring, and reliability best practicesExperience designing secure integrations and implementing authentication mechanisms for external systemsStrong problem-solving skills with experience troubleshooting complex distributed data workflowsExcellent communication skills with ability to work across technical and non-technical stakeholdersExperience working in Agile environments Nice to have: Experience with Azure Data Lake and Parquet or Delta file formatsFamiliarity with Azure API Management (APIM)Experience implementing CI/CD pipelines using Azure DevOpsKnowledge of data governance, lineage, and metadata management conceptsExperience in FinTech, transportation, logistics, or other high-volume transactional environments Perks and Benefits: OTR provides a competitive, comprehensive compensation package for our full-time employees: Paid Certifications Certification Bonus Eligibility for Individual and Company bonus programs Medical, Dental, Vision, Life/AD&D Insurance, Short-Term Disability Pet Insurance, Paid Family Leave, Employee Assistance Program Fully Paid Maternity Leave 401(k) with Company Matching Generous PTO, Sick/Mental Health Days, Flex Holidays + Company Paid Holidays Travel Stipend to support Work Life Balance Leadership Development and Training Continuous Learning + Professional Enhancements Weekly Catered Lunches + Casual Dress Code Company Paid Fitness Membership Volunteer Days and Opportunities with Company-Partnered Charities Internal Inclusion Programs OTR’s mission is to create exceptional value for our clients by providing industry-leading financing and back-office solutions. Three pillars that are crucial to supporting that mission are outstanding customer service, technology that creates efficiency for ourselves and our customers, and a culture that provides employees the opportunity to achieve greatness. OTR Solutions is an Equal Opportunity Employer