Lead Data Engineer / Airflow Architect - Orchestration & Integration
Who We AreArtmac Soft is a technology consulting and service-oriented IT company dedicated to providing innovative technology solutions and services to customers.Job DescriptionJob Title : Lead Data Engineer / Airflow Architect Orchestration & IntegrationJob Type : W2/C2CExperience : 9-12 YearsLocation : Prosper, TexasResponsibilities9 12 years of experience in Data Engineering, Data Integration, ETL, or related areas.Strong hands-on expertise with Apache Airflow and enterprise orchestration architecture.Proven experience designing and implementing complex, enterprise-scale Airflow DAGs.Experience with Oracle EBS integration and enterprise application data flows.Experience designing highly scalable, reliable, and fault-tolerant data pipelines.Experience implementing data quality and validation mechanisms.Hands-on experience with CI/CD practices and source control.Experience participating in or leading technical architecture and design reviews.Strong programming skills in Python.Strong proficiency in SQL and relational databases.Strong understanding of ETL/ELT and data integration architectureStrong understanding of database synchronization, data replication, and data movement patterns.Strong knowledge of monitoring, observability, logging, alerting, and failure recovery.Strong understanding of software engineering principles, design patterns, and development standards.Design and define enterprise Airflow architecture, standards, frameworks, and best practices.Architect and develop scalable, reusable, and maintainable Airflow DAGs for complex data workflows.Lead the design of ETL/ELT and data integration architectures across multiple enterprise systems.Develop robust data pipelines using Python, SQL, and Airflow.Design and implement integration patterns for Oracle EBS and other enterprise applications.Design pipelines to support high-volume, scalable, and performance-sensitive workloads.Establish and improve pipeline observability, including logging, monitoring, metrics, SLA tracking, and operational dashboards.Implement data quality and validation frameworks to ensure data accuracy, completeness, and consistency.QualificationBachelor's degree or equivalent combination of education and experience.