Databricks Data Architect
Overview
Join our innovative team as a Databricks Data Architect and lead the design and implementation of scalable, high-performance data solutions using cutting-edge cloud technologies. In this role, you will be instrumental in shaping our data architecture, ensuring seamless integration across diverse data sources, and enabling advanced analytics to drive strategic decision-making. Your expertise will empower our organization to harness the full potential of big data, fostering a data-driven culture that accelerates business growth and innovation. This paid position offers a dynamic environment where your technical prowess and creative problem-solving will make a tangible impact.
Responsibilities
Design and develop robust cloud-based data architectures utilizing Databricks, Azure Data Lake, AWS, and other cloud platforms to support enterprise-wide data initiatives.
Lead the development of scalable data models, data warehousing solutions, and system designs that optimize performance, scalability, and security.
Collaborate with cross-functional teams to define requirements for data integration, ETL processes, and master data management strategies using tools like Informatica and SQL.
Implement best practices for big data processing with Spark, Hadoop, and NoSQL databases such as Microsoft SQL Server and Oracle to ensure efficient data analytics workflows.
Conduct performance tuning and scalability assessments to enhance system efficiency for large-scale data modeling projects.
Develop comprehensive documentation for system design, architecture standards, and data governance policies aligned with business intelligence needs.
Stay current with emerging trends in cloud database architecture, linked data concepts, and analytics tools to continuously improve our data ecosystem.
Skills
Extensive experience with cloud platforms such as Azure and AWS, including services like Azure Data Lake and cloud database architecture.
Proficiency in programming languages including Java, Python, Bash (Unix shell), with a focus on developing scalable ETL pipelines and analytics solutions.
Strong knowledge of NoSQL databases, Hadoop ecosystem components, Spark processing frameworks, and big data technologies.
Expertise in data modeling projects, system design for system development, and designing efficient data warehousing solutions.
Familiarity with master data management practices to ensure consistent and accurate enterprise-wide data assets.
Proven ability to perform performance tuning for large datasets while maintaining system scalability and reliability.
Experience working within Agile methodologies to deliver iterative improvements on complex analytics projects.
Excellent understanding of business intelligence tools, linked data principles, SQL optimization techniques, and system design best practices for analytics environments.
Embark on this exciting journey as a Databricks Data Architect where your innovative mindset will shape the future of our enterprise data landscape!
Pay: $80.00 - $90.00 per hour
Work Location: Remote