Copart

Copart is looking for a talented Lead or Senior Data Platform Engineer/Kafka Administrator to join our DevOps team to support our data, search and messaging platforms and other related technologies, as well as partner with the product team to ensure data integrity in the entire system.. Partner with Information Security professionals to ensure data is secure both at-rest and in-flight.. Develop, test, deploy and maintain efficient reusable patterns of streaming and batch data ingestion pipeline architectures for our data engineers to use.. Extensive Experience with Kafka and related technologies (Hive, Hadoop, Spark, Storm, Zookeeper)Experience managing Kafka with Confluent Platform and Confluent CloudExperience with Solr and related technologies (Solr, Elastic Search, Lucene API, etc.). Experience with designing and supporting Enterprise Redis PlatformsExperience with Source control/Bug Tracking/Automated Build tools Jira, Jenkins, and GitExperience with http web servers and load balancersExperience with Reporting and ETL platforms

platform engineer

Now hiring in Dallas, TX

Copart is looking for a talented Lead or Senior Data Platform Engineer/Kafka Administrator to join our DevOps team to support our data, search and messaging platforms and other related technologies, as well as partner with the product team to ensure data integrity in the entire system. An ideal candidate brings curiosity, passion for data, and a deep understanding of the technologies behind data pipelines, big data, analytics, and deep understanding of the software development life cycle.
Responsibilities:
Lead, Design and Develop all Copart’s Data PlatformsDeploy, manage, and monitor data platforms and data movement solutions.Build scalability, fault-tolerance, security, and performance into our data platforms to meet the growing needs of our customers.Partner with agile data development teams and use DevOps methodologies to create automated, efficient CI/CD processes to reduce the time to promote, test and deploy code.Partner with Information Security professionals to ensure data is secure both at-rest and in-flight.Develop, test, deploy and maintain efficient reusable patterns of streaming and batch data ingestion pipeline architectures for our data engineers to use.Document and maintain key architecture and coding standards for supported platforms.Act as first line support for data platforms to maintain peak operating efficiency and ensure maximum uptime.Ensure data platforms remain current to take advantage of the latest features and support.Communicate status of assigned work to management and follow agile practices and procedures covered by precedents, standards, or policies.Seek guidance when direction is needed and speak up about technology risks identified and own addressing them with the team.Influence peers on the team with questions and insightBe open to learn, train and develop as a team.
Experience required minimum 8 years.Extensive Experience with Kafka and related technologies (Hive, Hadoop, Spark, Storm, Zookeeper)Experience managing Kafka with Confluent Platform and Confluent CloudExperience with Solr and related technologies (Solr, Elastic Search, Lucene API, etc.)Experience with deploying, configuring, scaling, and troubleshooting data and search infrastructure.Experience with alerting, monitoring, and auto-remediation in a large-scale distributed environmentProgramming experience in Java, Python, or similar languagesExperience in support of stream processing solutions in Big Data and Kafka, KinesisStrong Knowledge of messaging/events architecture Concepts and PUB/SUB PatternSolid knowledge of Java SE, Java EE, XML, XML Schema, XSD, XSLT/XPath and JSON technologiesExperience in building and deploying Micro Services on containers such as Pivotal Foundry Cloud, Docker, or Kubernetes etc.Experience with designing and supporting Enterprise Redis PlatformsExperience with Source control/Bug Tracking/Automated Build tools Jira, Jenkins, and GitExperience with http web servers and load balancersExperience with Reporting and ETL platforms

START NEW SEARCH