Senior Data Engineer
ARCHIVED
We can't find an active application page for this role right now. It may reopen or be listed elsewhere. Use Next Steps to search for an active apply link and similar live jobs.
Software Methods is seeking a Senior Data Engineer for a 24+ month contract opportunity at our client in the King of Prussia, PA area. This is a remote opportunity.
Responsibilities:
- Identifying, creating, and preparing data required for modern BI/ML solutions
- Building data architectures, and data pipelines to collectively bring together data
- Designing solutions using Microsoft Azure services and other tools
- Assuring that data is cleansed, mapped, transformed, and optimized for storage and use according to business and technical requirements
Automating tasks and deploying production standard code (with unit testing, continuous integration, versioning, etc.)Loading transformed data into storage and reporting structures such as data warehouses, real-time reporting systems and analytics applications.
Required Skills:
- Bachelor’s Degree in Computer Science or similar
- Experience in data engineering and cloud data processing services (Azure Cloud Platform)
- Hands on Experience in Data Warehousing & ETL tools
- Experience in Big Data technologies (e.g. Hadoop, Spark, Databricks, Snowflake)
- Experience building and optimizing 'big data' data pipelines, architectures, and data sets
Knowledge of SQL and Python/PySpark Open mindset, ability to quickly adapt to new technologies and learn new practices.
Preferred Skills:
Knowledge of Oracle PL/SQL and Java Performance/security-oriented data modeling and data design, including partitions, different type of indexes, views, and most effective data management practices Azure Synapse Analytics and Azure DevOpsAzure Data Engineer certification Knowledge of Purview, Snowflake, Qlik, or Tableau. If this sounds like you, please contact us today! Unable to sponsor visas for this position. Please encourage those authorized, to work in the U.S. without a visa, to apply! No third parties please.