{"schemaVersion":"jobsearcher.job.v1","id":"fefe3d436f4decc130065e82","url":"https://jobsearcher.com/jobs/fefe3d436f4decc130065e82","canonicalUrl":"https://jobsearcher.com/jobs/fefe3d436f4decc130065e82","title":"Data Engineer/Python Developer","description":"Job Responsibilities: Develop, optimize, and maintain ETL/ELT pipelines using PySpark and SQL.\r\nWork with structured and unstructured data to build scalable data solutions.\r\nWrite efficient and scalable PySpark scripts for data transformation and processing.\r\nOptimize SQL queries, stored procedures, and indexing strategies to enhance performance.\r\nDesign and implement data models, schemas, and partitioning strategies for large-scale datasets.\r\nCollaborate with Data Scientists, Analysts, and other Engineers to integrate data workflows.\r\nEnsure data quality, validation, and consistency in data pipelines.\r\nImplement error handling, logging, and monitoring for data pipelines.\r\nWork with cloud platforms (AWS, Azure, or GCP) for data processing and storage.\r\nOptimize data pipelines for cost efficiency and performance.\r\nTechnical Skills Required: Strong experience in Python for data engineering tasks.\r\nProficiency in PySpark for large-scale data processing.\r\nDeep understanding of SQL (Joins, Window Functions, CTEs, Query Optimization).\r\nExperience in ETL/ELT development using Spark and SQL.\r\nExperience with cloud data services (AWS Glue, Databricks, Azure Synapse, GCP BigQuery).\r\nFamiliarity with orchestration tools (Airflow, Apache Oozie).\r\nExperience with data warehousing (Snowflake, Redshift, BigQuery).\r\nUnderstanding of performance tuning in PySpark and SQL.\r\nFamiliarity with version control (Git) and CI/CD pipelines.\r\nJ-18808-Ljbffr","company":"TechDigital Group","rawCompany":"techdigital group","city":"Saint Paul","state":"MN","isRemote":false,"isActive":false,"createdAt":"2026-06-25T00:42:32.703Z","occupations":[{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"},{"code":"15-2051.00","title":"Data Scientists","slug":"data-scientists"}],"industries":[{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Data Engineer/Python Developer","description":"Job Responsibilities: Develop, optimize, and maintain ETL/ELT pipelines using PySpark and SQL.\r\nWork with structured and unstructured data to build scalable data solutions.\r\nWrite efficient and scalable PySpark scripts for data transformation and processing.\r\nOptimize SQL queries, stored procedures, and indexing strategies to enhance performance.\r\nDesign and implement data models, schemas, and partitioning strategies for large-scale datasets.\r\nCollaborate with Data Scientists, Analysts, and other Engineers to integrate data workflows.\r\nEnsure data quality, validation, and consistency in data pipelines.\r\nImplement error handling, logging, and monitoring for data pipelines.\r\nWork with cloud platforms (AWS, Azure, or GCP) for data processing and storage.\r\nOptimize data pipelines for cost efficiency and performance.\r\nTechnical Skills Required: Strong experience in Python for data engineering tasks.\r\nProficiency in PySpark for large-scale data processing.\r\nDeep understanding of SQL (Joins, Window Functions, CTEs, Query Optimization).\r\nExperience in ETL/ELT development using Spark and SQL.\r\nExperience with cloud data services (AWS Glue, Databricks, Azure Synapse, GCP BigQuery).\r\nFamiliarity with orchestration tools (Airflow, Apache Oozie).\r\nExperience with data warehousing (Snowflake, Redshift, BigQuery).\r\nUnderstanding of performance tuning in PySpark and SQL.\r\nFamiliarity with version control (Git) and CI/CD pipelines.\r\nJ-18808-Ljbffr","datePosted":"2026-06-25T00:42:32.703Z","dateModified":"2026-06-25T00:42:32.703Z","hiringOrganization":{"@type":"Organization","name":"TechDigital Group","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Saint Paul","addressRegion":"MN","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"fefe3d436f4decc130065e82"},"url":"https://jobsearcher.com/jobs/fefe3d436f4decc130065e82"}}