{"schemaVersion":"jobsearcher.job.v1","id":"09516926f41301cdf7e4c9f7","url":"https://jobsearcher.com/jobs/09516926f41301cdf7e4c9f7","canonicalUrl":"https://jobsearcher.com/jobs/09516926f41301cdf7e4c9f7","title":"Principal Data Engineer (Python, AWS, Redshift, EMR, Airflow, Databricks, Big data) | Contract [...]","description":"Irvine, CA\r\nPrincipal Data Engineer (Python, AWS, Redshift, EMR, Airflow, Databricks, Big data) | Contract to Hire | Irvine, CA (Hybrid) |Title: Principal Data Engineer (Python, AWS, Redshift, EMR, Airflow, Databricks, Big-data)\r\nLocation: Irvine, CA (Hybrid)\r\nPosition Type: Contract to Hire\r\nResponsibilitiesAs a Data Software Engineer Sr. Staff, you will be responsible for all aspects of data acquisition, data transformation, analytics scheduling and operationalization to drive high-visibility, cross-division outcomes. Investigate, evaluate, test and recommend technical solutions for future systems. They will support software developers, database architects, data scientists on data initiatives and will contribute optimal data delivery architecture.\r\nWhat you will be doingData Operations\r\nLead the creation of data environments and/or data sets to serve a wide range of data users, including but not limited to Data Scientists, Data Analysts, Business Analysts etc.\r\nPerform offline analysis of large data sets using components of a big data software ecosystem.\r\nValidate the solution of root cause analysis escalated by various technical staff in multiple organizations and with differing levels of expertise.\r\nInvestigate, evaluate, test and recommend technical solutions for future systems.\r\nData ManagementOwn product data sets from the definition phase through to production deployment (end-to-end).\r\nProvide solutions for the design and implementation of Hadoop EMR Cluster/ Big Data Infrastructure.\r\nDeploy Hadoop/Big Data/Spark and database storage Infrastructures in AWS cloud.\r\nMonitor HDFS/Hadoop/Spark and related software releases, third-party utilities with emphasis on overall system performance.\r\nLead and develop tools and procedures to monitor and automate system tasks on servers and clusters\r\nLead and collaborate with other teams to design, develop, and deploy data tools that support both operations and product use cases.\r\nData Design\r\nLead and design distributed, scalable, and reliable data pipelines that ingest and process data at scale and in real-time.\r\nLead and design big data technologies and prototype solutions to improve data processing architecture.\r\nQualificationsBachelor’s degree in computer science, computer engineering, or a related technical field.\r\n12+ years of professional experience as a data software engineer; or 16+ years of related experience as a data software engineer in lieu of 4-year degree.\r\n2+ years of experience with AWS cloud or other cloud Big Data computing design, provisioning, and tuning.\r\nRelated AWS certification, preferred.\r\nPrevious experience as a Data Engineer / Database Administrator and/or Business Intelligence Analyst.\r\nExpertise in database concepts, object and data modeling techniques and design principles.\r\nExpertise in database architectures, software, and facilities\r\nExpertise with programming languages - Python (required), Scala, Ruby, R Database technologies - SQL, performance tuning concepts, AWS RDS, RedShift, MySQL\r\nExpertise with big data batch processing tools: Hadoop MapReduce, ElasticSearch, PIG, Hive, Cascading/Scalding, Apache Spark, AWS EMR\r\nExpertise with stream-processing systems: Kinesis, Kafka, MQTT\r\nExpertise with relational NoSQL databases including DyanamoDB\r\nExpertise in writing JSON, XML, YAML and other data definition schemas\r\nExcellent verbal and written communication skills necessary to effectively collaborate in a team environment and present and explain technical information and provide advice to management.\r\nAbility to work on advanced complex technical projects or business issues requiring state of the art technical knowledge or industry.\r\nAbility to work on significant and unique issues where analysis of situations or data requires an evaluation of intangibles. Exercises independent judgment in methods, techniques and evaluation criteria for obtaining results.\r\nAbility to lead and mentor junior engineers and colleagues.\r\nCentral Business Solutions, Inc(A Certified Minority Owned Organization)#J-18808-Ljbffr","company":"Central Business Solutions","rawCompany":"central business solutions","city":"Irvine","state":"CA","isRemote":false,"isActive":false,"createdAt":"2026-10-04T01:52:11.995Z","occupations":[{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"},{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Principal Data Engineer (Python, AWS, Redshift, EMR, Airflow, Databricks, Big data) | Contract [...]","description":"Irvine, CA\r\nPrincipal Data Engineer (Python, AWS, Redshift, EMR, Airflow, Databricks, Big data) | Contract to Hire | Irvine, CA (Hybrid) |Title: Principal Data Engineer (Python, AWS, Redshift, EMR, Airflow, Databricks, Big-data)\r\nLocation: Irvine, CA (Hybrid)\r\nPosition Type: Contract to Hire\r\nResponsibilitiesAs a Data Software Engineer Sr. Staff, you will be responsible for all aspects of data acquisition, data transformation, analytics scheduling and operationalization to drive high-visibility, cross-division outcomes. Investigate, evaluate, test and recommend technical solutions for future systems. They will support software developers, database architects, data scientists on data initiatives and will contribute optimal data delivery architecture.\r\nWhat you will be doingData Operations\r\nLead the creation of data environments and/or data sets to serve a wide range of data users, including but not limited to Data Scientists, Data Analysts, Business Analysts etc.\r\nPerform offline analysis of large data sets using components of a big data software ecosystem.\r\nValidate the solution of root cause analysis escalated by various technical staff in multiple organizations and with differing levels of expertise.\r\nInvestigate, evaluate, test and recommend technical solutions for future systems.\r\nData ManagementOwn product data sets from the definition phase through to production deployment (end-to-end).\r\nProvide solutions for the design and implementation of Hadoop EMR Cluster/ Big Data Infrastructure.\r\nDeploy Hadoop/Big Data/Spark and database storage Infrastructures in AWS cloud.\r\nMonitor HDFS/Hadoop/Spark and related software releases, third-party utilities with emphasis on overall system performance.\r\nLead and develop tools and procedures to monitor and automate system tasks on servers and clusters\r\nLead and collaborate with other teams to design, develop, and deploy data tools that support both operations and product use cases.\r\nData Design\r\nLead and design distributed, scalable, and reliable data pipelines that ingest and process data at scale and in real-time.\r\nLead and design big data technologies and prototype solutions to improve data processing architecture.\r\nQualificationsBachelor’s degree in computer science, computer engineering, or a related technical field.\r\n12+ years of professional experience as a data software engineer; or 16+ years of related experience as a data software engineer in lieu of 4-year degree.\r\n2+ years of experience with AWS cloud or other cloud Big Data computing design, provisioning, and tuning.\r\nRelated AWS certification, preferred.\r\nPrevious experience as a Data Engineer / Database Administrator and/or Business Intelligence Analyst.\r\nExpertise in database concepts, object and data modeling techniques and design principles.\r\nExpertise in database architectures, software, and facilities\r\nExpertise with programming languages - Python (required), Scala, Ruby, R Database technologies - SQL, performance tuning concepts, AWS RDS, RedShift, MySQL\r\nExpertise with big data batch processing tools: Hadoop MapReduce, ElasticSearch, PIG, Hive, Cascading/Scalding, Apache Spark, AWS EMR\r\nExpertise with stream-processing systems: Kinesis, Kafka, MQTT\r\nExpertise with relational NoSQL databases including DyanamoDB\r\nExpertise in writing JSON, XML, YAML and other data definition schemas\r\nExcellent verbal and written communication skills necessary to effectively collaborate in a team environment and present and explain technical information and provide advice to management.\r\nAbility to work on advanced complex technical projects or business issues requiring state of the art technical knowledge or industry.\r\nAbility to work on significant and unique issues where analysis of situations or data requires an evaluation of intangibles. Exercises independent judgment in methods, techniques and evaluation criteria for obtaining results.\r\nAbility to lead and mentor junior engineers and colleagues.\r\nCentral Business Solutions, Inc(A Certified Minority Owned Organization)#J-18808-Ljbffr","datePosted":"2026-10-04T01:52:11.995Z","dateModified":"2026-10-04T01:52:11.995Z","hiringOrganization":{"@type":"Organization","name":"Central Business Solutions","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Irvine","addressRegion":"CA","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"09516926f41301cdf7e4c9f7"},"url":"https://jobsearcher.com/jobs/09516926f41301cdf7e4c9f7"}}