{"schemaVersion":"jobsearcher.job.v1","id":"122a96ef874a9aae42a46e13","url":"https://jobsearcher.com/jobs/122a96ef874a9aae42a46e13","canonicalUrl":"https://jobsearcher.com/jobs/122a96ef874a9aae42a46e13","title":"Sr. Data Engineer","description":"Job Title: Sr.Data Engineer (Mid–Senior Level) – AWS & StreamingExperience Level – 13-15+ YearsLocation: Fort Mill, SC (3 days hybrid)Role Summary: We are seeking a Mid–Senior Data Engineer with strong expertise in AWS-based data engineering, real-time streaming technologies, and enterprise-grade data quality frameworks. The ideal candidate will design, build, and optimize scalable batch and streaming data pipelines, implement robust data validation and monitoring processes, and support mission-critical analytics platforms. Key Responsibilities:\nDevelop and maintain scalable ETL/ELT pipelines using AWS Glue, PySpark, and Python\nBuild event-driven workflows using AWS Lambda\nDesign and manage real-time streaming solutions using Kafka, KSQL, and Apache Flink\nImplement and enforce comprehensive data quality frameworks, including validation, profiling, monitoring, and reconciliation\nOptimize data processing performance, scalability, reliability, and cost in cloud environments\nCollaborate with cross-functional teams to deliver reliable, production-grade data platforms and ensure data integrity across the pipeline\nMust have Skills:\nStrong hands-on experience with Python and PySpark\nProven expertise in AWS Glue, Lambda, and other cloud-native data services\nSolid experience with the Kafka ecosystem (topics, partitions, consumer groups, streaming patterns)\nDemonstrated experience building and supporting data quality frameworks (validation rules, reconciliation checks, profiling, anomaly detection)\nStrong understanding of distributed data processing and scalable architecture patterns\nGood-to-Have Skills:\nExperience with Apache Flink for real-time stream processing and stateful computations\nKnowledge of KSQL or other streaming SQL engines\nExposure to CI/CD pipelines, IaC (Terraform/CloudFormation), and DevOps practices\nFamiliarity with data lake/lakehouse architectures and table formats such as Iceberg, Delta, or Hudi\nExperience working in enterprise or financial data environments","company":"Qode","rawCompany":"qode","city":"Fort Mill","state":"SC","isRemote":false,"isActive":false,"createdAt":"2026-04-14T11:19:59.118Z","occupations":[{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"},{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"518210","title":"Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services","slug":"computing-infrastructure-providers-data-processing-web-hosting-and-related-services"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Sr. Data Engineer","description":"Job Title: Sr.Data Engineer (Mid–Senior Level) – AWS & StreamingExperience Level – 13-15+ YearsLocation: Fort Mill, SC (3 days hybrid)Role Summary: We are seeking a Mid–Senior Data Engineer with strong expertise in AWS-based data engineering, real-time streaming technologies, and enterprise-grade data quality frameworks. The ideal candidate will design, build, and optimize scalable batch and streaming data pipelines, implement robust data validation and monitoring processes, and support mission-critical analytics platforms. Key Responsibilities:\nDevelop and maintain scalable ETL/ELT pipelines using AWS Glue, PySpark, and Python\nBuild event-driven workflows using AWS Lambda\nDesign and manage real-time streaming solutions using Kafka, KSQL, and Apache Flink\nImplement and enforce comprehensive data quality frameworks, including validation, profiling, monitoring, and reconciliation\nOptimize data processing performance, scalability, reliability, and cost in cloud environments\nCollaborate with cross-functional teams to deliver reliable, production-grade data platforms and ensure data integrity across the pipeline\nMust have Skills:\nStrong hands-on experience with Python and PySpark\nProven expertise in AWS Glue, Lambda, and other cloud-native data services\nSolid experience with the Kafka ecosystem (topics, partitions, consumer groups, streaming patterns)\nDemonstrated experience building and supporting data quality frameworks (validation rules, reconciliation checks, profiling, anomaly detection)\nStrong understanding of distributed data processing and scalable architecture patterns\nGood-to-Have Skills:\nExperience with Apache Flink for real-time stream processing and stateful computations\nKnowledge of KSQL or other streaming SQL engines\nExposure to CI/CD pipelines, IaC (Terraform/CloudFormation), and DevOps practices\nFamiliarity with data lake/lakehouse architectures and table formats such as Iceberg, Delta, or Hudi\nExperience working in enterprise or financial data environments","datePosted":"2026-04-14T11:19:59.118Z","dateModified":"2026-04-14T11:19:59.118Z","hiringOrganization":{"@type":"Organization","name":"Qode","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Fort Mill","addressRegion":"SC","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"122a96ef874a9aae42a46e13"},"url":"https://jobsearcher.com/jobs/122a96ef874a9aae42a46e13"}}