Senior Data & Integration Engineer/Designer/Architect
Dice is the leading career destination for tech experts at every stage of their careers. Our client, Dimension Consulting, is seeking the following. Apply via Dice today!Hi,Hope you’re doing well.Please take a moment to review the job description I’ve shared. If you’re interested in this opportunity, kindly send me your updated resume at your earliest convenienceJob Title: Technology Lead | Database Administration | Teradata Administration -- Senior Data & Integration Engineer/Designer/ArchitectWork Location & Reporting Address: Peoria, IL 61630Contract duration: 12Must Have Skills: SnapLogic AWS Python Snowflake DataStageNice to Have Skills: GitHub CI/CD integrationDetailed Job Description: Design ResponsibilitiesSolution & Technical Design Translate business requirements into scalable, maintainable, and secure technical designs across DataStage, SnapLogic, AWS, Python, and Snowflake ecosystems. Create high-level and low-level design documents covering data flows, mappings, process orchestration, and integration patterns. Develop data models, transformation logic, and interface specifications for batch, real-time, and event-driven pipelines. Ensure designs align with enterprise architecture standards, security guidelines, and best practices. Collaborate with product owners, analysts, and architects to finalize solution design and validate technical feasibility. Senior Development ResponsibilitiesHands-on Development & Implementation Build and enhance ETL/ELT pipelines in IBM DataStage, SnapLogic, and Python. Develop scalable Snowflake SQL, stored procedures, and performance-optimized ELT logic. Implement AWS services (Lambda, S3, SNS, SQS, IAM, CloudWatch,Cloudformation, EventBridge) as part of cloud-native data pipelines. Code reusable frameworks, utilities, and components to accelerate team productivity. Conduct peer code reviews, mentor team members, and establish coding standards.Quality & Delivery Perform unit testing and support integration/UAT activities. Optimize workflows for performance, cost-efficiency, and maintainability. Ensure version control, CI/CD integration, and documentation are consistently maintained. GitHub CI/CD integration Production Support & Issue Resolution ResponsibilitiesIncident & Problem Management Serve as the point for any production issues across DataStage, SnapLogic, Snowflake, AWS, and Tidal. Responsible for analyzing and fixing production issues in any system. Analyze root causes, identify systemic issues, and propose permanent fixes. Develop automated monitoring, alerting, using Python/AWS.Stability & Reliability Work closely with operations teams to ensure SLAs, uptime, and performance thresholds are met. Improve recovery processes, failover mechanisms, and operational resiliency. Troubleshoot orchestration and scheduling issues in Tidal Enterprise Scheduler. Architecture Input & Technical Leadership ResponsibilitiesArchitecture Contributions Provide architectural guidance for new integrations, data warehouse initiatives, and migration projects. Recommend best practices for cloud adoption, pipeline modernization, and platform evolution. Contribute to reference architectures, standards, reusable patterns, and decision frameworks.Strategic Technology Guidance Evaluate emerging tools and technologies in data engineering, integration, cloud, and orchestration. Champion automation, observability, data quality, and performance optimization initiatives. Collaborate with enterprise architects and infrastructure teams to ensure future-proof design choices. Cross-functional Collaboration Responsibilities Work with QA, business analysts, and project managers to enable smooth delivery. Assist and collaborate with offshore teams to ensure alignment, effective knowledge transfer, and smooth delivery across time zones. Communicate technical concepts clearly to both technical and non-technical stakeholders. Tools & Technology Scope ETL/ELT: IBM DataStage, SnapLogic Cloud: AWS (Compute, Storage, Serverless, Orchestration, IAM, Monitoring) Data Warehouse: Snowflake Programming: Python, SQL Scheduling: Tidal Enterprise Scheduler Other: Git, CI/CD tools, DevOps pipelines, monitoring platformsMinimum Years of Experience: 10+ yearsBest Regards,Shravan G Technical RecruiterE: | P: +1W: