Cloud Data & AI Platform Engineer - Software Engineer 4
ARCHIVED
We can't find an active application page for this role right now. It may reopen or be listed elsewhere. Use Next Steps to search for an active apply link and similar live jobs.
Job Description
Immediate W2 contract position available in Birmingham, AL.Estimated Duration: 7 monthsRole Overview:Focus for this position is in AI application development - specifically utilizing DataBricks with an MS Azure lakehouse framework. Software Engineers design and implement sophisticated products using the latest and most advanced engineering technologies in the industry.The Cloud Data & AI Platform Engineer is a hands-on technical role responsible for designing, building, and operating advanced data and AI orchestration capabilities within the company's Azure/Databricks-based Lakehouse environment. This role focuses on enabling reliable, governed, and auditable automation of data and analytics workflows using Azure Databricks and related Azure services.The position supports the company by developing orchestration frameworks, AI-enabled processing pipelines, and integration services that extend beyond traditional ETL, while remaining compliant with regulatory, security, and cost-management standards expected in a nuclear operating environment.This role partners closely with data engineering, analytics, and application teams to ensure that AI-enabled solutions are production-ready, maintainable, and aligned with enterprise architecture standards.Desired Qualifications:10 + YearsHas fundamental knowledge of software engineering utilizing Web-based or Object-Oriented Technologies, including .NET and Java.Requires good troubleshooting skills, and experience with large-scale distributed system environments.Has fundamental knowledge of software engineering utilizing Web-based or Object-Oriented Technologies, including .NET and Java.Professional Experience5+ years of experience in software engineering, cloud platform engineering, or data engineering roles.Demonstrated experience delivering production-grade data or analytics solutions in an enterprise environment.Experience in the energy, utilities, nuclear, or other highly regulated industries is strongly preferred.Exposure to handling sensitive operational, telemetry, or regulatory data is a plusCore Technical SkillsPython: Advanced proficiency, including object-oriented design and asynchronous or event-driven patterns.Data Engineering: Strong experience with PySpark, Delta Lake, and enterprise data lake architectures.Azure Platform: Practical experience with Azure services such as:Azure DatabricksAzure Functions and/or Logic AppsAzure Container-based services (as applicable)AI Enablement: Experience implementing AI-assisted or LLM-enabled workflows using structured orchestration patterns (e.g., task-based agents, supervisor/worker models).Platform & DevOpsExperience with CI/CD pipelines using GitHub Actions or Azure DevOps.Familiarity with infrastructure-as-code or environment configuration management in Azure.Strong understanding of secure development practices in regulated environments.Performance & Operating ExpectationsAccuracy & Auditability: Solutions must be reliable, traceable, and verifiable to support regulatory and operational requirements.Scalability & Resilience: Designs must tolerate variable workload patterns without manual intervention.Documentation & Standards Compliance:Code adheres to PEP 8 and Southern Company development standards.Comprehensive docstrings, READMEs, and architectural artifacts are required.Key ResponsibilitiesData & AI Orchestration EngineeringDesign and implement reusable orchestration frameworks in Python to manage multi-step analytics, data quality checks, and AI-assisted workflows.Develop controlled agent-based or task-specialized components to support activities such as data validation, metadata enrichment, code generation assistance, and operational diagnostics.Ensure orchestration logic is deterministic, testable, and suitable for regulated production environments.Azure Databricks Platform IntegrationDeploy and operate orchestration and AI-enabled workloads within Azure Databricks, leveraging:Delta Lake and Medallion Architecture (Bronze/Silver/Gold)Databricks Workflows and JobsUnity Catalog for data governance and access controlPartner with Lakehouse platform leads to align solutions with SNC architectural standards.System & API IntegrationDesign and implement secure integration patterns with internal SNC applications and approved external vendor systems.Ensure integrations follow enterprise security, identity, and data-handling requirements, including auditability and least-privilege access.Performance, Cost, and Reliability ManagementMonitor and optimize Spark workloads, orchestration processes, and AI service calls to ensure efficient resource utilization.Apply cost-awareness principles consistent with Southern Company AR/CO and cloud financial management expectations.Build solutions that can scale to intermittent high-volume workloads while remaining operationally stable.Technical Leadership & StandardsContribute to architectural guidance, design reviews, and technical standards for data and AI solutions in the Lakehouse.Ensure solutions are modular, maintainable, and aligned with long-term platform strategy.Provide clear documentation and handoff materials to support ongoing operations and support teams.Provide high-level application supportProblem determination and resolutionCoding and debuggingInstalling and updating softwareProviding 24x7 technical supportDesigning, creating, testing, and modifying programsHandling special projectsDesigning, developing, and implementing software solutionsReviewing and recommending productsDeveloping technical specificationsDeveloping new systems and programsCompany DescriptionWe provide supplemental employees to the region's most sought after power projects. We credit our success to the commitment we show to our job applicants. E Group Recruiters are here to make sure your job search experience is the best it can be. Our recruiters are experts in knowing what the client manager is looking for in a resume, what bill rate the market will bear, and how to make your application stand out among the rest. Our personal touch continues even after we've found the perfect job for you. All full-time employees are eligible to pay for full health and retirement benefits including BC/BS health and dental insurance, life and disability insurances, and 401K with an immediately vested match is available. We have a dedicated team to guide you through these benefits.Company DescriptionWe provide supplemental employees to the region's most sought after power projects. We credit our success to the commitment we show to our job applicants. E Group Recruiters are here to make sure your job search experience is the best it can be. Our recruiters are experts in knowing what the client manager is looking for in a resume, what bill rate the market will bear, and how to make your application stand out among the rest. Our personal touch continues even after we've found the perfect job for you. All full-time employees are eligible to pay for full health and retirement benefits including BC/BS health and dental insurance, life and disability insurances, and 401K with an immediately vested match is available. We have a dedicated team to guide you through these benefits.