ETL/Spark Developer
ARCHIVED
We can't find an active application page for this role right now. It may reopen or be listed elsewhere. Use Next Steps to search for an active apply link and similar live jobs.
ROLE: - ETL/Spark Developer LOCATION: - Mclean VA DURATION: - Long term contract Job Description:Your expertise in Python, PySpark, ETL processes, CI/CD (Jenkins or GitHub), and experience with both streaming and batch workflows will be essential in ensuring the efficient flow and processing of data to support our clientsCollaborate with cross-functional teams to understand data requirements and design robust data architecture solutionsImplement ETL processes to extract, transform, and load data from various sourcesEnsure data quality, integrity, and consistency throughout the ETL pipelineUtilize your expertise in Python and PySpark to develop efficient data processing and analysis scriptsOptimize code for performance and scalability, keeping up-to-date with the latest industry best practicesIntegrate data from different systems and sources to provide a unified view for analytical purposesCollaborate with data analysts to implement solutions that meet their data integration needsDesign and implement streaming workflows using PySpark Streaming or other relevant technologiesDevelop batch processing workflows for large-scale data processing and analysis