Sr. Data Engineer

Position Responsibilities: We are seeking a Senior Data Engineer to design, build, and maintain robust data pipelines and scalable platforms on AWS and Snowflake. You will partner closely with data, analytics, and engineering teams to migrate data from diverse sources—enterprise systems, SaaS applications, and event streams—into the Snowflake data warehouse to support analytics, reporting, and downstream applications. This is a contract-to-hire opportunity for professionals who are looking to move toward a technical lead role and work in a cutting-edge data engineering environment. Design and develop scalable batch and real-time data pipelines on AWS using services such as Glue, Lambda, Step Functions, Kinesis, DMS, and Kafka (Amazon MSK).Develop, optimize, and maintain Snowflake data models—including staging, transformation, and dimensional data layers—for analytics and business reporting needs. Engineer efficient data loading pipelines into Snowflake via Snowpipe, Streams and Tasks, and external stages leveraging S3.Implement C#/.NET services and Lambda functions for data ingestion, integration with APIs, and general data processing workflows. Optimize Snowflake performance and manage costs through effective warehouse sizing, clustering, query optimization, and resource monitoring. Enforce Snowflake security practices by applying role-based access control, data masking, and data governance standards. Write and maintain Terraform configurations for both AWS and Snowflake infrastructure; manage CI/CD pipelines using GitHub Actions with automated testing and deployment practices. Create and maintain data quality checks, monitoring, and alerting (using AWS CloudWatch) to quickly identify and address pipeline failures or data anomalies. Provide Tier 2 and Tier 3 support for production pipelines, participate in on-call rotations, and contribute proactively to incident reviews and post-mortems. Mentor junior engineers, take an active role in code reviews, and thoroughly document data flows, data models, and operational runbooks. Essential Skills, Experience:5–7 years' experience in data engineering or software engineering, with a strong emphasis on developing and maintaining data pipelines for large-scale enterprise environments. At least 3 years of hands-on experience with Snowflake, including comprehensive knowledge of data modeling, performance tuning, Snowpipe, and experience with Streams and Tasks. Advanced C#/.NET programming skills with a focus on building resilient data services and systems integrations. Extensive, recent production experience using AWS data services such as S3, Glue, Lambda, Step Functions, Kinesis, and DMS.Deep understanding of data warehousing concepts, including dimensional modeling, slowly changing dimensions, and ELT (Extract, Load, Transform) patterns; advanced SQL proficiency. Practical experience with Infrastructure as Code using Terraform for automating cloud provisioning both in AWS and Snowflake ecosystems. Strong experience setting up and optimizing CI/CD pipelines, preferably GitHub Actions, including practices for automated testing and robust deployment strategies. Demonstrated capability in monitoring, troubleshooting, and tuning critical data systems for maximum reliability, efficiency, and cost-effectiveness. Excellent interpersonal and communication skills. Must be comfortable operating independently or as part of a distributed agile team.

Qualifications: Bachelor's degree in Computer Science, Information Technology, or a related field (or equivalent experience).ECCO Select is committed to hiring and retaining a diverse workforce. Our policy is to provide equal opportunity to all people without regard to race, color, religion, national origin, ancestry, marital status, veteran status, age, disability, pregnancy, genetic information, citizenship status, sex, sexual orientation, gender identity or any other legally protected category. Veterans of our United States Uniformed Services are specifically encouraged to apply for ECCO Select opportunities. Equal Employment Opportunity is The Law This Organization Participates in E-Verify