{"schemaVersion":"jobsearcher.job.v1","id":"1796e5e9b99fcd786fa92e03","url":"https://jobsearcher.com/jobs/1796e5e9b99fcd786fa92e03","canonicalUrl":"https://jobsearcher.com/jobs/1796e5e9b99fcd786fa92e03","title":"Data Engineer","description":"Sorry we are not considering any candidates that require sponsorship or transfer of any kind as the client needs to be able to convert this person without any kind of transfer or sponsorship of any visa. Local candidates only.\r\nData Engineer to help build and scale its modern cloud data platform. This role will be responsible for designing and developing data pipelines, integrating internal and external data sources, and building scalable cloud solutions using Azure Databricks , Amazon Web Services (AWS) , and Python .\r\nThe ideal candidate is passionate about cloud technologies and data engineering, enjoys building applications and automation tools, and has experience creating reliable, high-performance data solutions that support analytics and business intelligence. This position will work closely with Data Scientists, Business Analysts, and business stakeholders to transform raw data into trusted, actionable insights.\r\nKey Responsibilities Design, develop, and maintain scalable ETL/ELT pipelines using Azure Databricks and PySpark .\r\nBuild robust data integration solutions for structured and unstructured data sources.\r\nDesign and optimize data models to support reporting, analytics, and machine learning.\r\nMonitor, troubleshoot, and optimize data pipelines for performance, reliability, and scalability.\r\nImplement data quality checks and governance best practices.\r\nDesign and maintain cloud-based data storage solutions using Amazon S3 .\r\nConfigure secure AWS environments for data ingestion from internal and third-party data providers.\r\nBuild automated processes for ingesting files into S3 and orchestrating downstream processing.\r\nWork with AWS services including\r\nAmazon S3\r\nAWS Glue\r\nLambda\r\nIAM\r\nCloudWatch\r\nSupport future cloud-native initiatives utilizing AWS container technologies such as ECS, EKS, or Kubernetes.\r\nApplication Development Develop internal applications, automation tools, APIs, and utilities using Python .\r\nBuild reusable services that streamline business processes and improve operational efficiency.\r\nCollaborate with cross-functional teams to deliver scalable, data-driven solutions.\r\nPartner with Sales, Marketing, Finance, Supply Chain, and Operations teams to understand business requirements.\r\nSupport Data Scientists by preparing high-quality datasets for advanced analytics and AI initiatives.\r\nWork closely with IT and business stakeholders to implement enterprise data solutions.\r\nRequired Qualifications Bachelor's degree in Computer Science, Information Systems, Data Engineering, Software Engineering, or a related field.\r\n3+ years of experience in Data Engineering or a similar role.\r\nHands-on experience with Azure Databricks .\r\nExperience working within Amazon Web Services (AWS) .\r\nStrong programming skills in Python .\r\nAdvanced SQL development skills.\r\nExperience building scalable ETL/ELT pipelines.\r\nExperience with Git and source control.\r\nStrong understanding of relational databases and data warehousing concepts.\r\nPreferred Qualifications Experience working with syndicated market data providers such as NielsenIQ , Circana (IRI), SPINS, or retailer POS data.\r\nExperience with\r\nPySpark\r\nSpark SQL\r\nSnowflake\r\nAmazon Athena\r\nAmazon Redshift\r\nExperience with Docker, Kubernetes, or containerized applications in AWS.\r\nFamiliarity with CI/CD pipelines and DevOps practices.#J-18808-Ljbffr","company":"Encore Talent Solutions","rawCompany":"encore talent solutions","city":"Brea","state":"CA","isRemote":false,"isActive":false,"createdAt":"2026-08-13T02:06:08.690Z","occupations":[{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-2051.00","title":"Data Scientists","slug":"data-scientists"},{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Data Engineer","description":"Sorry we are not considering any candidates that require sponsorship or transfer of any kind as the client needs to be able to convert this person without any kind of transfer or sponsorship of any visa. Local candidates only.\r\nData Engineer to help build and scale its modern cloud data platform. This role will be responsible for designing and developing data pipelines, integrating internal and external data sources, and building scalable cloud solutions using Azure Databricks , Amazon Web Services (AWS) , and Python .\r\nThe ideal candidate is passionate about cloud technologies and data engineering, enjoys building applications and automation tools, and has experience creating reliable, high-performance data solutions that support analytics and business intelligence. This position will work closely with Data Scientists, Business Analysts, and business stakeholders to transform raw data into trusted, actionable insights.\r\nKey Responsibilities Design, develop, and maintain scalable ETL/ELT pipelines using Azure Databricks and PySpark .\r\nBuild robust data integration solutions for structured and unstructured data sources.\r\nDesign and optimize data models to support reporting, analytics, and machine learning.\r\nMonitor, troubleshoot, and optimize data pipelines for performance, reliability, and scalability.\r\nImplement data quality checks and governance best practices.\r\nDesign and maintain cloud-based data storage solutions using Amazon S3 .\r\nConfigure secure AWS environments for data ingestion from internal and third-party data providers.\r\nBuild automated processes for ingesting files into S3 and orchestrating downstream processing.\r\nWork with AWS services including\r\nAmazon S3\r\nAWS Glue\r\nLambda\r\nIAM\r\nCloudWatch\r\nSupport future cloud-native initiatives utilizing AWS container technologies such as ECS, EKS, or Kubernetes.\r\nApplication Development Develop internal applications, automation tools, APIs, and utilities using Python .\r\nBuild reusable services that streamline business processes and improve operational efficiency.\r\nCollaborate with cross-functional teams to deliver scalable, data-driven solutions.\r\nPartner with Sales, Marketing, Finance, Supply Chain, and Operations teams to understand business requirements.\r\nSupport Data Scientists by preparing high-quality datasets for advanced analytics and AI initiatives.\r\nWork closely with IT and business stakeholders to implement enterprise data solutions.\r\nRequired Qualifications Bachelor's degree in Computer Science, Information Systems, Data Engineering, Software Engineering, or a related field.\r\n3+ years of experience in Data Engineering or a similar role.\r\nHands-on experience with Azure Databricks .\r\nExperience working within Amazon Web Services (AWS) .\r\nStrong programming skills in Python .\r\nAdvanced SQL development skills.\r\nExperience building scalable ETL/ELT pipelines.\r\nExperience with Git and source control.\r\nStrong understanding of relational databases and data warehousing concepts.\r\nPreferred Qualifications Experience working with syndicated market data providers such as NielsenIQ , Circana (IRI), SPINS, or retailer POS data.\r\nExperience with\r\nPySpark\r\nSpark SQL\r\nSnowflake\r\nAmazon Athena\r\nAmazon Redshift\r\nExperience with Docker, Kubernetes, or containerized applications in AWS.\r\nFamiliarity with CI/CD pipelines and DevOps practices.#J-18808-Ljbffr","datePosted":"2026-08-13T02:06:08.690Z","dateModified":"2026-08-13T02:06:08.690Z","hiringOrganization":{"@type":"Organization","name":"Encore Talent Solutions","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Brea","addressRegion":"CA","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"1796e5e9b99fcd786fa92e03"},"url":"https://jobsearcher.com/jobs/1796e5e9b99fcd786fa92e03"}}