Sr. Data Engineer

*Job Overview* We are seeking a highly skilled and energetic Senior Data Engineer to join our dynamic data team. In this pivotal role, you will lead the design, development, and maintenance of robust data pipelines and architectures that empower data-driven decision-making across the organization. Your expertise will drive innovation in big data systems, cloud-based data solutions, and advanced analytics, enabling us to harness the full potential of our data assets. If you thrive in a fast-paced environment and are passionate about building scalable data solutions, this is your opportunity to make a significant impact. *Responsibilities* * Design, develop, and optimize large-scale ETL (Extract, Transform, Load) pipelines using tools like Informatica, Apache Hive, Spark, and Python to ensure efficient data flow across systems. * Architect and implement cloud-based data solutions utilizing AWS, Azure Data Lake, and other public cloud platforms to support scalable analytics environments. * Collaborate with cross-functional teams to understand business requirements and translate them into effective data models and warehousing solutions using dimensional modeling techniques. * Manage and improve data management integration processes within big data systems such as Hadoop and Spark clusters, ensuring high performance and reliability. * Develop and maintain complex SQL queries, stored procedures, and database schemas for SQL databases including Microsoft SQL Server, Oracle, and cloud databases. * Build dashboards and reports using business intelligence tools like Looker to provide actionable insights for stakeholders. * Support model training and analysis efforts by preparing clean datasets, implementing RESTful APIs for data access, and scripting automation with Bash or Shell scripting. * Participate actively in Agile development cycles to deliver continuous improvements in data engineering workflows. *Experience* * Proven experience as a Data Engineer working with big data systems such as Hadoop, Spark, or similar platforms. * Strong proficiency in SQL programming with extensive knowledge of SQL databases including Microsoft SQL Server, Oracle, and cloud-based options like Azure Data Lake or other cloud databases. * Hands-on experience developing ETL pipelines using Informatica or similar tools; familiarity with ETL pipeline development best practices is essential. * Demonstrated ability to design scalable data models using dimensional modeling techniques for data warehousing environments. * Skilled in programming languages such as Java and Python for software development related to data engineering tasks. * Experience working with cloud services (AWS or Azure) for building secure, scalable big data solutions; understanding of public cloud architecture is highly valued. * Knowledge of analytics tools like Looker combined with strong analysis skills to interpret complex datasets effectively. * Familiarity with shell scripting (Bash), VBA automation, RESTful API integration, and analysis skills to support comprehensive data workflows. * Ability to work within an Agile environment while managing multiple priorities efficiently. Join us if you're eager to leverage your expertise in big data systems, cloud technologies, and advanced analytics to shape innovative solutions that drive business success! Pay: $92,823.30 - $111,787.20 per year Work Location: In person