{"schemaVersion":"jobsearcher.job.v1","id":"4e6bfd0ee124cb23a87dcc0c","url":"https://jobsearcher.com/jobs/4e6bfd0ee124cb23a87dcc0c","canonicalUrl":"https://jobsearcher.com/jobs/4e6bfd0ee124cb23a87dcc0c","title":"Senior Data Engineer","description":"We're hiring on behalf of a Haystack partner!The Role• Provide thought leadership in designing, developing, and maintaining robust data systems.• Lead the development of efficient data processing and ensure data availability for analysis and reporting.• Drive the design and development of data pipelines from various sources to internal databases.• Influence the construction and optimization of data infrastructure for analysis readiness.• Develop and guide the implementation of scalable, sustainable, and robust data products and solutions using advanced engineering and cloud technologies.• Champion best practices and new data framework concepts to promote standard methodologies in data management.What You'll Need• Minimum of 6 years of relevant work experience.• Define long-term technical direction and establish best practices for scalable and maintainable solutions.• Champion reliability, observability, and performance for high-standard data systems.• Make sound technical and architectural decisions by evaluating competing priorities like speed, cost, risk, and flexibility.• Deep expertise in implementing cloud-based data warehouses, data lakes, and open table formats (e.g., Snowflake, AWS).• Proficiency in data collection, ingestion tools (e.g., Kafka, AWS Glue), and storage formats (e.g., Iceberg, Parquet).• Experience with data streaming architectures and tools (e.g., Kafka, Flink) and strong background using Spark for data transformation.• Extensive experience in DevOps practices, including code management, CI/CD, and deployment strategies.What's On Offer• Competitive salary• Opportunity to work with cutting-edge big data and cloud-based technologies.• Play a key role in shaping data strategy and infrastructure for a leading organization.• Influence technical direction and establish best practices in data engineering.Apply via Haystack today!","company":"Haystack","rawCompany":"haystack","city":"Atlanta","state":"NY","isRemote":false,"isActive":false,"createdAt":"2026-05-05T10:36:32.537Z","occupations":[{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"},{"code":"15-1243.00","title":"Database Architects","slug":"database-architects"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"518210","title":"Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services","slug":"computing-infrastructure-providers-data-processing-web-hosting-and-related-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Senior Data Engineer","description":"We're hiring on behalf of a Haystack partner!The Role• Provide thought leadership in designing, developing, and maintaining robust data systems.• Lead the development of efficient data processing and ensure data availability for analysis and reporting.• Drive the design and development of data pipelines from various sources to internal databases.• Influence the construction and optimization of data infrastructure for analysis readiness.• Develop and guide the implementation of scalable, sustainable, and robust data products and solutions using advanced engineering and cloud technologies.• Champion best practices and new data framework concepts to promote standard methodologies in data management.What You'll Need• Minimum of 6 years of relevant work experience.• Define long-term technical direction and establish best practices for scalable and maintainable solutions.• Champion reliability, observability, and performance for high-standard data systems.• Make sound technical and architectural decisions by evaluating competing priorities like speed, cost, risk, and flexibility.• Deep expertise in implementing cloud-based data warehouses, data lakes, and open table formats (e.g., Snowflake, AWS).• Proficiency in data collection, ingestion tools (e.g., Kafka, AWS Glue), and storage formats (e.g., Iceberg, Parquet).• Experience with data streaming architectures and tools (e.g., Kafka, Flink) and strong background using Spark for data transformation.• Extensive experience in DevOps practices, including code management, CI/CD, and deployment strategies.What's On Offer• Competitive salary• Opportunity to work with cutting-edge big data and cloud-based technologies.• Play a key role in shaping data strategy and infrastructure for a leading organization.• Influence technical direction and establish best practices in data engineering.Apply via Haystack today!","datePosted":"2026-05-05T10:36:32.537Z","dateModified":"2026-05-05T10:36:32.537Z","hiringOrganization":{"@type":"Organization","name":"Haystack","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Atlanta","addressRegion":"NY","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"4e6bfd0ee124cb23a87dcc0c"},"url":"https://jobsearcher.com/jobs/4e6bfd0ee124cb23a87dcc0c"}}