JOBSEARCHER

Databricks Solutions Architect

What you will be doing:
  • Be a core member of our rapidly growing Databricks practice
  • Work directly with end customers and architect, scope, negotiate & lead enterprise scale Databricks migration projects
  • Provide thought leadership in the areas of data migration, master data management, data modeling, data governance, data transformations, curation and data integration
  • Develop data architecture blueprints, patterns and frameworks that will enable reuse and standardization
  • Grow the practice by influencing sales deals and assist with scoping, solutioning and estimating effort
  • Lead efforts to develop reusable frameworks, accelerators and internal product development
  • Help us hire, train and develop highly differentiated and diverse team of Big Data experts
  • The skills you will bring 7+ years experience of data engineering, data platforms &analytics.10+ years of consulting experience
Minimum 6-8+ projects delivered with hands-on experience in development on databricks. Current knowledge across the Databricks product *& platform features - and/ or complete Databricks Data Engineering Professional Certification (upon joining).Deep understanding and experience working with modern cloud data architectures and engineering for one or more of the common cloud ecosystems - AWS, Azure or GCPFamiliarity with cloud native technologies specifically - Python / PySpark/ JavaScript, CI/CD for production deployments, ML Ops, cloud devops, containers (kubernetes/docker, etc.)Deep experience with distributed computing with Spark, with knowledge of Spark runtime intervals. Strong abilities to provide a firm point of view on core cloud platform capabilities, security, and best practices Knowledge of cloud and Big Data ecosystems to advise clients on optimal solutions and best practices Understanding of cloud data architecture and data integration patterns (Databricks, Starburst, Azure Data Factory, AWS Glue and others), storage and processing (Redshift, Azure Synapse, BigQuery, Snowflake); Infrastructure as code (CloudFormation, Terraform) Understanding of enterprise data concepts such as Master Data Management and Enterprise Data Warehouse, experience with MDM standards Understanding of SQL, report generation using visualization tools such as Tableau/Power BI, programming using Python/Scala/Spark Ability to identify, debug bottlenecks and significantly optimizes low running data pipelines Experience migrating applications from legacy Hadoop or Data Warehouses to the cloud running Apache Spark or Databricks a huge plus Other nice to have skills: Demonstrating prior Big 4 or proven consulting experience in strategy through execution projects is a plus Experience leading and working with large Cloud Data Platform, Cloud Data migration or Enterprise Information Management programs You bring an uncompromising Growth mindset You are highly motivated, creative in your approach to technical problems and know how to leverage both internal and external networks You invest in keeping technical skills updated and are constantly looking for the next big challenge You will bring both broad and deep knowledge in Data Engineering and can architect a solution by mapping a customer business problem to an end-to-end solution. You are resourceful, confident and composed under pressure