JOBSEARCHER

Senior Data Engineer

Must have: starburst or dremio exp Role : GCP Data Engineer Contract Charlotte, NC - Onsite Job Description: Required Qualifications & SkillsCore GCP: Hands-on experience with core gcp data services: Big Query, Cloud Dataflow, Cloud Composer (Airflow), and Cloud Storage. Databases: Strong proficiency in NoSQL databases (specifically MongoDB) and data warehousing concepts. Programming: Advanced programming and scripting skills in Python and complex SQL.Support & CI/CD: Experience utilizing Cloud Logging/Monitoring for root cause analysis and implementing CI/CD frameworks.
Key Responsibilities: Pipeline Integration: Design, build, and deploy scalable ETL/ELT data pipelines using Python and GCP-native services. Database Management: Integrate data from MongoDB into Google Cloud Storage and load/transform it in Big Query for analytics. Support & Debugging: Monitor, troubleshoot, and resolve pipeline failures and data discrepancies. Performance Tuning: Optimize Big Query queries, Dataflow jobs, and MongoDB indexing to ensure cost-efficiency and fast execution.