Lead Data Engineer
ARCHIVED
We can't find an active application page for this role right now. It may reopen or be listed elsewhere. Use Next Steps to search for an active apply link and similar live jobs.
Job Title: Lead Data Engineer Location: ALTA is supporting a direct hire opportunity working hybrid onsite/remote for a client located in the Atlanta, GA area SummaryThe Lead Data Engineer is responsible for managing and organizing the client’s enterprise data and overseeing the technical output of a team of data engineers. They will architect and design data pipelines and dictate how information should be managed, consolidated and stored for optimal use by the organization. Lead Data Engineers will support other Data Engineers, Data Architects, and Data Analysts on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. They will drive standardization and reduce effort through automation.Essential Duties And Responsibilities Lead a team of engineers through architecture, design, demand delivery, code reviews, release management, implementation, presentations, and meetings. Mentor fellow data engineers and contribute to ongoing process improvements for the team. Evaluate business needs and objectives and align architecture/designs with business requirements Build the data pipelines required for the optimal extraction, transformation, integration and loading of raw data from a wide variety of data sources Assemble large, complex data sets and model our data in a way that meets functional / non-functional business requirements Create data tools for analytics team members that assist them in generating innovative industry insights that provide our business a competitive advantage Implement data tagging mechanisms and metadata management so data is accurately classified and visible to the organization Build processes to help identify and improve data quality, consistency and effectiveness Ensure our data is managed in a way that it conforms to all information privacy and protection policies Use agile software development processes to iteratively make improvements to our data management systems Identify opportunities for automation Be an advocate for best practices and continued learning Required Experience Bachelor's/Tech School degree in Computer Science, MIS or Engineering or relevant technical field and/or commensurate years of real-world experience in software engineering. 7+ years of relevant experience in data management 5+ years in data engineering with detailed knowledge of data warehouse technical architectures, infrastructure components, ETL/ ELT 3+ years of experience with Cloud based DW such as Redshift, Snowflake etc. Technical expertise with data models, data mining, and segmentation techniques Experience in data acquisition, transformation and storage design using design principles, patterns and best practices Experience with performance analysis and optimization Experience with relational SQL and NoSQL databases, including Postgres and Cassandra Experience with data pipeline and workflow management tools Experience with AWS cloud services: EC2, EMR, RDS, Redshift, Modern data platforms, Snowflake, dbt, Fivetran and Airflow. Experience with stream-processing systems: Kafka, Storm, Spark-Streaming, etc. Data engineering certification is a plus. For immediate consideration, please apply directly or contact Patrick Jackson at pjackson@altaits.com System One, and its subsidiaries including Joulé, ALTA IT Services, CM Access, and Mountain Ltd., are leaders in delivering outsourced services and workforce solutions across North America. We help clients get work done more efficiently and economically, without compromising quality. System One not only serves as a valued partner for our clients, but we offer eligible employees health and welfare benefits coverage options including medical, dental, vision, spending accounts, life insurance, voluntary plans, as well as participation in a 401(k) plan.System One is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender identity, age, national origin, disability, family care or medical leave status, genetic information, veteran status, marital status, or any other characteristic protected by applicable federal, state, or local law.