Senior Data Engineer

Software Methods is seeking a Senior Data Engineer for a 24+ month contract opportunity at our client in the King of Prussia, PA area. This is a remote opportunity. Responsibilities: Identifying, creating, and preparing data required for modern BI/ML solutionsBuilding data architectures, and data pipelines to collectively bring together dataDesigning solutions using Microsoft Azure services and other toolsAssuring that data is cleansed, mapped, transformed, and optimized for storage and use according to business and technical requirementsAutomating tasks and deploying production standard code (with unit testing, continuous integration, versioning, etc.)Loading transformed data into storage and reporting structures such as data warehouses, real-time reporting systems and analytics applications.Required Skills: Bachelor’s Degree in Computer Science or similarExperience in data engineering and cloud data processing services (Azure Cloud Platform)Hands on Experience in Data Warehousing & ETL toolsExperience in Big Data technologies (e.g. Hadoop, Spark, Databricks, Snowflake)Experience building and optimizing 'big data' data pipelines, architectures, and data setsKnowledge of SQL and Python/PySpark Open mindset, ability to quickly adapt to new technologies and learn new practices.Preferred Skills: Knowledge of Oracle PL/SQL and Java Performance/security-oriented data modeling and data design, including partitions, different type of indexes, views, and most effective data management practices Azure Synapse Analytics and Azure DevOpsAzure Data Engineer certification Knowledge of Purview, Snowflake, Qlik, or Tableau. If this sounds like you, please contact us today!Unable to sponsor visas for this position. Please encourage those authorized, to work in the U.S. without a visa, to apply!No third parties please.