{"schemaVersion":"jobsearcher.job.v1","id":"d3fe2a2f28eefa1967fd7cc1","url":"https://jobsearcher.com/jobs/d3fe2a2f28eefa1967fd7cc1","canonicalUrl":"https://jobsearcher.com/jobs/d3fe2a2f28eefa1967fd7cc1","title":"Senior Data Engineer","description":"We are seeking a skilled Data Engineer with strong expertise in Databricks, Azure data services, PySpark, SQL, and Power BI. The ideal candidate will be responsible for building scalable ETL/ELT pipelines, optimizing data models, and developing high-performance dashboards while ensuring governance and best practices.\nOnly USC/GC\n\nDevelop and maintain robust data pipelines using ETL (Extract, Transform, Load) processes to ensure high-quality data flow across systems\nDesign and implement scalable data architectures leveraging cloud platforms such as AWS and Azure Data Lake to support big data initiatives\nCollaborate with cross-functional teams to gather requirements and translate them into efficient database designs and data models\nOptimize SQL queries and database performance for Microsoft SQL Server, Oracle, and other relational databases\nBuild and deploy analytics dashboards using Looker, providing stakeholders with clear insights into key metrics\nUtilize Hadoop, Apache Hive, Spark, and other big data tools to process large datasets efficiently\nWrite clean, efficient code in Java, Python, Bash (Unix shell), Shell Scripting, and other languages to automate workflows and enhance system integration\nSupport model training activities by preparing data sets and ensuring data quality for machine learning projects\nMaintain comprehensive documentation of data pipelines, architecture diagrams, and technical procedures\nFollow Agile methodologies to ensure iterative development, continuous improvement, and timely delivery of projects\n\nExtensive experience with cloud platforms such as AWS and Azure Data Lake for scalable storage solutions\nProficiency in Java, Python, Bash (Unix shell), Shell Scripting for automation and system integration\nDeep understanding of big data technologies including Hadoop, Apache Hive, Spark, and related ecosystems\nStrong knowledge of ETL tools like Talend and Informatica for seamless data integration\nExpertise in SQL development for Microsoft SQL Server, Oracle databases, including database design and optimization techniques\nFamiliarity with Looker or similar BI tools for creating interactive dashboards and reports\nExperience working with RESTful APIs for system communication and data exchange\nKnowledge of Linked Data principles to connect disparate datasets across platforms\nHands-on experience with Data Warehouse architecture design and implementation strategies\nAbility to analyze complex datasets to extract meaningful insights; strong analysis skills are essential\nFamiliarity with Model Training processes within machine learning workflows\nExperience with VBA scripting for automation within Excel or other Office applications is a plus\nStrong understanding of Agile development practices to foster collaboration and iterative progress\nEmbrace this opportunity to leverage your technical prowess in a vibrant environment where innovation drives success. Your contributions will directly influence how we harness the power of data to shape strategic decisions!\nJob Types: Full-time, Contract\nPay: From $80.00 per hour\nExpected hours: 8 per week\nWork Location: In person","company":"Millennium Software","rawCompany":"millennium software","city":"Greenville","state":"SC","isRemote":false,"isActive":false,"createdAt":"2026-07-30T11:24:26.974Z","occupations":[{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-2051.00","title":"Data Scientists","slug":"data-scientists"},{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Senior Data Engineer","description":"We are seeking a skilled Data Engineer with strong expertise in Databricks, Azure data services, PySpark, SQL, and Power BI. The ideal candidate will be responsible for building scalable ETL/ELT pipelines, optimizing data models, and developing high-performance dashboards while ensuring governance and best practices.\nOnly USC/GC\n\nDevelop and maintain robust data pipelines using ETL (Extract, Transform, Load) processes to ensure high-quality data flow across systems\nDesign and implement scalable data architectures leveraging cloud platforms such as AWS and Azure Data Lake to support big data initiatives\nCollaborate with cross-functional teams to gather requirements and translate them into efficient database designs and data models\nOptimize SQL queries and database performance for Microsoft SQL Server, Oracle, and other relational databases\nBuild and deploy analytics dashboards using Looker, providing stakeholders with clear insights into key metrics\nUtilize Hadoop, Apache Hive, Spark, and other big data tools to process large datasets efficiently\nWrite clean, efficient code in Java, Python, Bash (Unix shell), Shell Scripting, and other languages to automate workflows and enhance system integration\nSupport model training activities by preparing data sets and ensuring data quality for machine learning projects\nMaintain comprehensive documentation of data pipelines, architecture diagrams, and technical procedures\nFollow Agile methodologies to ensure iterative development, continuous improvement, and timely delivery of projects\n\nExtensive experience with cloud platforms such as AWS and Azure Data Lake for scalable storage solutions\nProficiency in Java, Python, Bash (Unix shell), Shell Scripting for automation and system integration\nDeep understanding of big data technologies including Hadoop, Apache Hive, Spark, and related ecosystems\nStrong knowledge of ETL tools like Talend and Informatica for seamless data integration\nExpertise in SQL development for Microsoft SQL Server, Oracle databases, including database design and optimization techniques\nFamiliarity with Looker or similar BI tools for creating interactive dashboards and reports\nExperience working with RESTful APIs for system communication and data exchange\nKnowledge of Linked Data principles to connect disparate datasets across platforms\nHands-on experience with Data Warehouse architecture design and implementation strategies\nAbility to analyze complex datasets to extract meaningful insights; strong analysis skills are essential\nFamiliarity with Model Training processes within machine learning workflows\nExperience with VBA scripting for automation within Excel or other Office applications is a plus\nStrong understanding of Agile development practices to foster collaboration and iterative progress\nEmbrace this opportunity to leverage your technical prowess in a vibrant environment where innovation drives success. Your contributions will directly influence how we harness the power of data to shape strategic decisions!\nJob Types: Full-time, Contract\nPay: From $80.00 per hour\nExpected hours: 8 per week\nWork Location: In person","datePosted":"2026-07-30T11:24:26.974Z","dateModified":"2026-07-30T11:24:26.974Z","hiringOrganization":{"@type":"Organization","name":"Millennium Software","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Greenville","addressRegion":"SC","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"d3fe2a2f28eefa1967fd7cc1"},"url":"https://jobsearcher.com/jobs/d3fe2a2f28eefa1967fd7cc1"}}