Data Engineer : Alpine Capital Research

Data Engineer Remote or In-Office (St. Louis, MO)Description:Data Engineer responsible for designing, developing, and maintaining data pipelines and warehousing solutions.Key tasks will include API integration, ETL development, data modeling (Star Schema or Snowflake Schema), and supporting Power BI reporting.Will primarily work on the OIL Analytics Report Migration project initially, then transition to the Tamarac Data Warehouse project.Collaborate with internal project teams to ensure data accuracy, integrity, and structured organization for business intelligence.Tech stack:Azure Synapse AnalyticsTwo separate environments (e.g., Development and Production).Handles data warehousing and large-scale analytics workloads.Azure Data LakeCentralized storage layer.Supports both structured and unstructured data.Azure Key VaultManages secrets, encryption keys, and certificates.Ensures secure access across both environments.Azure DevOpsCI/CD pipelines for automated builds and deployments.Manages data pipeline lifecycle and component delivery.Apache Spark NotebooksDeployed in both environments.Used for interactive data exploration, transformation, and analytics.Azure Integration RuntimeFacilitates secure and scalable data movement.Enables transformations across network boundaries within Synapse or Data Factory.Metastore Data WarehouseCentralized metadata repository.Maintains schema definitions, and table metadataARM Template (Azure Resource Manager)Defines and automates infrastructure deployment.Enables consistent provisioning of Synapse, Data Lake, Key Vault, and other resources across environments.