Data Engineer
Position: - Data EngineerLocation: - Remote - Costa Rica, Brazil or Mexico Duration: Contract Rate: DOE We are looking for a Developer Senior Developer Data Engineer to build and operate scalable data pipelines and curated datasets that enable Digital and Customer Experience Applications across a global FMCG enterprise You will work Handson with Python PySpark Databricks and SQL contribute to modern engineering practices using Gi based workflows and CICD and support endtoend delivery through Azure DevOpsKey ResponsibilitiesDesign develop and optimize ETLELT pipelines using Databricks PySpark to ingest transform and serve data for digital customer experience use casesBuild and maintain high-quality performant SQL transformations and dimensionalcurated data layers for analytics and downstream consumptionImplement best practices for Databricks engineering notebooks vs repos modular code cluster job configuration performance tuning and cost awarenessUse Python for data processing utilities validations orchestration helpers and reusable librariesManage source control using Git with enterprise workflows across GitHub Bitbucket enforce PR reviews branching strategies and coding standardsBuild and maintain CICD pipelines using Azure DevOps automating testing packaging and deployment of data code artifacts across environmentsEnsure data quality and reliability through validations reconciliation checks monitoring and operational runbooksCollaborate with productapp teams analysts and platform teams to translate requirements into scalable data products aligned to customer experience journeysFor Senior Developer lead modulelevel design mentor engineers drive standards for CICD and code quality and own delivery for critical pipelinesPrimary Skills MustHaveStrong handson experience withPythonPySparkDatabricks jobs workflows clusters reposSQL advanced querying optimizationStrong experience with Git and repository platforms GitHub andor BitbucketHandson experience implementing CICD for data engineering workloadsStrong working experience with Azure DevOps Boards Repos Pipelines buildrelease workflowsSecondary Skills Good-to-HaveAzure Data Factory ADF for orchestration ingestion and scheduling patternsPower BI experience for consumptionlayer understanding datasets measures refresh patterns supporting analytics enablement