{"schemaVersion":"jobsearcher.job.v1","id":"36f6174ead5ec8d8f85516e3","url":"https://jobsearcher.com/jobs/36f6174ead5ec8d8f85516e3","canonicalUrl":"https://jobsearcher.com/jobs/36f6174ead5ec8d8f85516e3","title":"Data Engineer","description":"OverviewAs a Data Engineer, you will design, build, and optimize scalable data pipelines and cloud-based platforms to empower data-driven decision-making. You will work within cross-functional teams to translate data into actionable insights and robust data models. You'll tackle batch and real-time ingestion, ensure data quality, and implement CI/CD for data workflows. This role offers the chance to shape enterprise data architecture on cloud platforms and collaborate with data scientists and engineers. You will be a key contributor to scalable analytics and governance across the data stack.ResponsibilitiesDesign, develop, and maintain scalable data pipelines and ETL/ELT workflowsBuild and optimize data processing with Python, SQL, and Apache Spark (PySpark)Develop batch and real-time data ingestion pipelinesHandle structured and unstructured data from multiple sourcesDesign and implement cloud-based data solutions (Azure, AWS, GCP)Develop and maintain data models, data lakes, and data warehousesIntegrate data from APIs, databases, and streaming platformsOptimize pipeline performance and ensure data qualityCollaborate with Data Scientists, Business Analysts, and Software EngineersImplement CI/CD pipelines and DevOps practices for data engineeringTroubleshoot production issues and provide ongoing supportEnsure compliance with data governance, security, and privacy standardsKey requirements5+ years of Data Engineer experienceStrong Python programmingExcellent SQL skillsHands-on Apache Spark / PySparkETL/ELT development experienceKnowledge of Data Warehousing conceptsHadoop ecosystem experience (Hive, HDFS)Databricks experienceApache Kafka experienceAirflow or similar workflow orchestration toolLinux/Unix environment experienceGit and CI/CD familiarityCloud experience with Azure, AWS or GCPcollaboration with cross-functional teamsproblem-solving mindseteffective communicationPythonSQLApache Spark / PySpark","company":"Prolim Global","rawCompany":"prolim global","city":"Edison","state":"NJ","isRemote":false,"isActive":false,"createdAt":"2026-10-26T14:38:12.483Z","occupations":[{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"},{"code":"15-1243.00","title":"Database Architects","slug":"database-architects"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Data Engineer","description":"OverviewAs a Data Engineer, you will design, build, and optimize scalable data pipelines and cloud-based platforms to empower data-driven decision-making. You will work within cross-functional teams to translate data into actionable insights and robust data models. You'll tackle batch and real-time ingestion, ensure data quality, and implement CI/CD for data workflows. This role offers the chance to shape enterprise data architecture on cloud platforms and collaborate with data scientists and engineers. You will be a key contributor to scalable analytics and governance across the data stack.ResponsibilitiesDesign, develop, and maintain scalable data pipelines and ETL/ELT workflowsBuild and optimize data processing with Python, SQL, and Apache Spark (PySpark)Develop batch and real-time data ingestion pipelinesHandle structured and unstructured data from multiple sourcesDesign and implement cloud-based data solutions (Azure, AWS, GCP)Develop and maintain data models, data lakes, and data warehousesIntegrate data from APIs, databases, and streaming platformsOptimize pipeline performance and ensure data qualityCollaborate with Data Scientists, Business Analysts, and Software EngineersImplement CI/CD pipelines and DevOps practices for data engineeringTroubleshoot production issues and provide ongoing supportEnsure compliance with data governance, security, and privacy standardsKey requirements5+ years of Data Engineer experienceStrong Python programmingExcellent SQL skillsHands-on Apache Spark / PySparkETL/ELT development experienceKnowledge of Data Warehousing conceptsHadoop ecosystem experience (Hive, HDFS)Databricks experienceApache Kafka experienceAirflow or similar workflow orchestration toolLinux/Unix environment experienceGit and CI/CD familiarityCloud experience with Azure, AWS or GCPcollaboration with cross-functional teamsproblem-solving mindseteffective communicationPythonSQLApache Spark / PySpark","datePosted":"2026-10-26T14:38:12.483Z","dateModified":"2026-10-26T14:38:12.483Z","hiringOrganization":{"@type":"Organization","name":"Prolim Global","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Edison","addressRegion":"NJ","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"36f6174ead5ec8d8f85516e3"},"url":"https://jobsearcher.com/jobs/36f6174ead5ec8d8f85516e3"}}