Data Engineer - Python Developer
APN Consulting, Inc. is a progressive IT staffing and services company offering innovative business solutions to improve client business outcomes. We focus on high impact technology solutions in ServiceNow, Fullstack, Cloud & Data, and AI / ML. Due to our globally expanding service offerings we are seeking top-talent to join our teams and grow with us.Direct Client RequirementJob Title: Data Engineer - Python DeveloperLocation: Oldwick, NJ (Hybrid)Job Type: FTEAbout the jobFlexible and hybrid work arrangementsPaid time off/Paid company holidaysMedical plan options/prescription drug planDental plan/vision plan optionsFlexible spending and health savings accounts401(k) retirement savings plan with a Roth savings option and company matching contributionsEducational assistance programOverview:The Data Engineer will be responsible for designing, building, and optimizing scalable data solutions to support a wide range of business needs. This role requires a strong ability to work both independently and collaboratively in a fast-paced, agile environment. The ideal candidate will engage with cross-functional teams to gather data requirements, propose enhancements to existing data pipelines and structures, and ensure the reliability and efficiency of data processes.ResponsibilitiesDevelop and maintain scripts and tools using Python, PowerShell, and RDesign, write, and optimize SQL queries for performance and scalabilityHelp modernize 'legacy' solutions to realign with our current code base and tech stackAssist in redevelopment, improvement and ongoing maintenance of existing data, analytics, and reporting solutionsEnsure accurate and efficient data integration of diverse data sources and formatsEnhance and support database functions and proceduresOptimize data access and data processing workflows for performance, scalability, and efficiencyImplement data quality checks and validations to ensure the accuracy, consistency, and completeness of dataIdentify and resolve performance bottlenecks, investigate and troubleshoot data related issues, and provide solutions to address defectsSeamlessly transition between production support and development tasks based on business needsDeploy and manage code utilizing engineering best practices in non-prod and prod environmentsQualifications:Bachelors Degree in computer science, data science, software engineering, information systems, or related quantitative field.Minimum 4 years of experience working as a Python Developer, Solutions Engineer, Data Engineer, or similar roles.Skills:4+ years of solid continuous experience in Python3+ years of solid experience writing SQL and PL/SQL code3+ years of experience working with relational databases (solid understanding of Oracle preferred)2+ years of experience scripting with PowerShellExperience programming in RExperience with web application frameworks including Shiny, Dash, StreamlitExperience with CI/CD utilizing git/Azure DevOpsKnowledge of alternative storage formats including Parquet/Arrow/AvroAbility to collaborate within and across teams of different technical knowledge to support delivery of solutionsExpert problem-solving skills, including debugging skills, enabling the determination of sources of issues in unfamiliar code or systemsPluses, but not required: Any work experience in the following:ETL / ELT tools: Spark, Kafka, Azure Data Factory (ADF)NoSQL databases: MongoDB, Cosmos DB, DocumentDB or similarLanguages: SAS, Java, Scala, .NetWe are committed to fostering a diverse, inclusive, and equitable workplace where individuals from all backgrounds feel valued and empowered to contribute their unique perspectives. We strongly encourage applications from candidates of all genders, races, ethnicities, abilities, and experiences to join our team and help us build a culture of belonging.