Data Architect

Data Architect – CTH / Direct-Hire REMOTE / Work From Home (Prefers TX/CST) The role is a combination of design/implementation and consulting with hands-on experience. It will require one to envision, design, and implement the technical solution working with customer and internal technical team. Must have been involved in this role, where she/he has led the design and/or implementation of several complex data-oriented solutions on Hadoop Big Data Platform. Experience working with customer Business/IT team. Should be able to speak confidently throughout the conversation. The candidate is expected to play developer role who can interact with the customer, work with teams (local or remote) and lead the technical or business discussions in key meetings. Skills & ExperienceMandatory to have End-To-End experience working in a Databricks Data environment (Dev, QA and Prod) with large data sets (Petabytes)Must have worked on several projects in the Big Data / Hadoop space; Comfortable with the broader Databricks ecosystemsHands-on with experience with - Spark, Databricks & SQL; Good in Java / Python, PySpark/Spark language Experience working on Apache Spark, creating data processing jobs and running them on DatabricksExperience with Python and deployments for data sourcing and loads into ADLS (Azure Data Lake)Very comfortable with SQL; Knowledge of Kafka would be value add; Basics of Unix commandsSecondary Skills / Good To have – Experience working with Azure Data Services (Big Plus)Soft skills/other skills – Good communication skills and Positive attitudeBE/BS /MS / MCA degree in Computer Science / IT / IS or relevant