Sr. Data Engineer

Data EngineerMust be located in Atlanta, GALong term opportunity | $60-$70 per hour(We are unable to partner with third parties at this time)Primary Responsibilities & Essential FunctionsDesign, implement, and maintain the data pipeline architecture for our businessAssemble large, complex data sets that meet functional / non-functional business requirementsIdentify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and GCP or AWS 'big data' technologiesBuild analytics tools that utilize the data pipeline to provide actionable insights into sensor behavior, application usage, operational efficiencies, and other key business performance metricsWork across vertical stakeholders to assist with data-related technical issues as well as supporting their evolving data infrastructure needsDevelop and implement a data segregation and security strategy within and across availability zonesCreate the data tools and frameworks for our analytics and data science team that assist them in building industry-leading insights and solutionsSkills & QualificationsMinimum5+ years of experience in a data engineer (or similar) roleAdvanced experience working with both relational & non-relational databases, including Postgres, BigQuery, and FirebaseExperience with big data tools: Hadoop, Spark, Kafka, etc.Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.Experience with stream-processing systems: Storm, Spark-Streaming, etc.Experience with object-oriented/object function scripting languages: Python, Kotlin, etc.Experience with machine learning frameworks (like Keras or PyTorch) and libraries (like scikit-learn)Advanced working SQL knowledge and query authoringExperience building and optimizing 'big data' data pipelines, architectures and data setsStrong track record of manipulating, processing and extracting value from large, disconnected datasetsWorking knowledge of message queuing, stream processing, and highly scalable 'big data' data storesStrong project management and organizational skillsExperience supporting and working with cross-functional teams in a dynamic environmentPreferredExperience with GCP cloud services: BigQuery, FirebaseExperience working with IoT sensors and their data setsExperience working with data visualization tools, especially Power BI