Data Solution Architect (Databricks & Application Integration)
Company DescriptionLumen Solutions Group Inc. is a technology consulting Services company based in Florida. We provide a wide array of experienced business and IT professionals supporting clients from solution design to implementation and support. We specialize in professional IT consulting services, IT Staffing, Business/IT Strategy, Business Process Blueprints, Enterprise Architecture, and Enterprise Transformation. Job Role: Data Solution Architect (Databricks & Application Integration)Job Location: Washington DC (Remote)Job Type: Long Term ContractJOB SUMMARY:We are seeking an experienced Data Solution Architect to lead the strategic architecture, integration, and governance of an enterprise Databricks Lakehouse platform. This is a highly visible architecture role where you will define enterprise standards, design scalable integration frameworks, and serve as the technical authority connecting Databricks with enterprise applications, APIs, and business systems.Key ResponsibilitiesSolution Architecture & Enterprise IntegrationDesign end-to-end solution architectures using Databricks Delta Live Tables (DLT), Structured Streaming, and enterprise orchestration frameworks. Architect integrations between the Databricks Lakehouse and downstream enterprise applications, APIs, microservices, and BI platforms. Define enterprise data governance, lineage, and quality frameworks using Unity Catalog and DLT Expectations. Create scalable architecture blueprints that align business objectives with modern cloud data solutions. Enterprise Standards & Technical LeadershipEstablish enterprise-wide architectural standards, reusable design patterns, and engineering best practices. Develop secure platform frameworks in collaboration with cloud infrastructure and platform engineering teams. Lead architecture reviews, provide technical mentorship, and ensure engineering teams follow enterprise architecture principles. Platform Optimization & DevOpsArchitect performance optimization strategies including:PhotonZ-OrderingLiquid ClusteringLiquid PartitioningDesign enterprise CI/CD strategies across Development, Test, Stage, and Production environments. Drive Infrastructure-as-Code (IaC) and deployment automation using Azure DevOps, GitHub Actions, Git, and Terraform. Optimize cloud performance while maintaining cost efficiency (FinOps). Required Qualifications8+ years of experience in Solution Architecture or Enterprise Data Architecture. Extensive hands-on experience designing enterprise solutions on the Databricks platform. Strong expertise with:DatabricksDelta LakeDelta Live Tables (DLT)PySparkSQLStructured StreamingDeep understanding of Medallion (Bronze, Silver, Gold), dimensional, and relational data modeling. Experience designing enterprise CI/CD pipelines and Infrastructure-as-Code using Git, Azure DevOps, GitHub Actions, and Terraform. Proven ability to collaborate with engineering teams, infrastructure teams, business stakeholders, and executive leadership. Excellent communication, architectural governance, and technical leadership skills. Lumen Solutions Group Inc is an equal opportunity employer. All qualified applicants will be considered for employment without regard to any legally protected status.