Remote Databricks - Data Engineer

Lyteworx Automation Systems (Lyteworx) is seeking talentedindividuals to join our team of technology pioneers. With over 16years of experience, we have honed our core capabilities in ITinfrastructure engineering, cyber security, data science, andartificial intelligence. Our comprehensive suite of engineering andtechnical support services caters to clients across defense,intelligence, and commercial sectors. If you have a passion forcutting -edge technology and a drive to push the boundaries ofinnovation, Lyteworx is the place for you. Join us and be part of ateam that is shaping the future of technology.- - - Currently Collecting Resumes - - -Description:We are seeking a talented and experienced Databricks Data Engineer to join our dynamic team. The successful candidate will play a crucial role in building and managing data pipelines, processing large datasets, and ensuring efficient and secure data management practices. They will also be responsible for inspiring the adoption of advanced analytics and data science across the organization.Requirements Security Clearance: None/Secret/Top SecretLocation : RemoteCertifications:- Databricks Certified Data Engineer Associate certificationEducation:Bachelor's degree in a relevant field or equivalent combination of education and experience7+ years of experience in the data engineering field3+ years of experience in a data analytics environment, preferably in DoD or the intelligence communityMaster's degree in a relevant field (may substitute for 3 years of general experience)Required Skills/Experience:Previous experience in a data engineering role or similarExperience with data processing and pipeline managementFamiliarity with industry -standard data engineering platforms and toolsStrong data manipulation and processing skillsProficiency in data engineering tools such as Databricks, Apache Spark, Delta Lake, MLflow, and SQLUnderstanding of the Databricks Lakehouse Platform, its workspace, architecture, and capabilitiesAbility to perform multi -hop architecture ETL tasks using Apache Spark SQL and PythonKnowledge of incremental data processing in batch and streaming modeFamiliarity with open -source tools, cloud computing, machine learning, and data visualizationStrong interpersonal skills and a collaborative work styleUnderstanding of security and governance best practicesStrong problem -solving and analytical skillsExcellent written and verbal communication abilitiesMajor Duties/Tasks:Build and manage data pipelines for data engineering applicationsProcess and manipulate large datasets efficiently and securelyWork with data engineering platforms and tools such as Databricks, Apache Spark, Delta Lake, MLflow, and SQLMaintain best practices around security and governanceModel data management solutionsManage, test, and deploy codeProvide expertise on data concepts to the advanced analytics groupInstall continuous pipelines of filtered information for data analysts and scientists to access relevant datasetsCollaborate with cross -functional teams to ensure effective data utilizationBenefits At Lyteworx, weprioritize the well -being and satisfaction of our employees. Tothat end, we offer a comprehensive benefits package thatincludes medical, dental, and vision insurance, as well as lifeand disability insurance options. Our employees also enjoy a401(k) plan with employer matching contributions, generous paidtime off, and flexible scheduling options to help them balancetheir work and personal lives.We believe that ouremployees are our greatest asset, and we are dedicated to providingthem with the resources and support they need to achieve their goalsand succeed in their careers.401K PlanVacation and Paid Time Off(PTO)Health, Dental & VisionInsuranceLife & Supplemental LifeInsuranceDisability & AccidentalDeath & DismembermentMental Health CareHealth Saving Account (HSA)