Data Platform Engineer
Are you an experienced Platform Engineer looking for the chance to make a real impact? We're hiring! We help organizations create robust technical architecture, develop complex systems and build out their infrastructures. Check out our openings here.
*Responsibilities:*
• Develop, evaluate, test and maintain data platform architecture and data solutions
• Administer systems including configuration, monitoring and maintenance of Application servers
• Work closely with IT Platform Manager to implement and support infrastructure for key project work and company objectives
• Administration and maintenance of existing on premise and cloud infrastructure
• Excellent organizational and time management skills to handle multiple tasks simultaneously
• Analyze and improve data platform performance
• Resolve data and platform anomalies observed in collaboration with other teams
• Code deployments and migrations of data initiatives
• Ensure Infrastructure maintains its high standard of security by regularly carrying out mitigation and preventive maintenance tasks
• Keep abreast of best practices and develop a leading-edge expertise on supported technologies
*Qualifications:*
• Bachelor's or Graduate's Degree in computer science, engineering or information systems
• Candidate should have 6+ years of platform experience with 3+ years of cloud experience
• Good Knowledge of Big Data systems (AWS), including Hadoop, HDFS, Hive
• Scripting Experience with Apache Spark, Python, Shell
• Proficient in installing Apache Airflow, configuring, and monitoring Airflow cluster
• Proficient in Manage application security
• Proficient with developing guidelines for Airflow clusters and DAG's
• Proficient in building CICD Pipeline with Git & Jenkins
• Experience in AWS clusters, EC2, S3, EFS & other components
• Experience with SQL and writing queries
• Experience in BI and data science tools such as Tableau, Superset, Jupyter
• Experience in Tableau Administration & Vertica administration
• Experience in Administration of Dremio Application
Job Type: Full-time
Pay: $100,000.00 - $151,000.00 per year
Schedule:
* Monday to Friday
Ability to commute/relocate:
* San Francisco Bay Area, CA: Reliably commute or planning to relocate before starting work (Required)
Experience:
* AWS: 2 years (Required)
* Scripting: 2 years (Required)
* Hadoop: 2 years (Preferred)
Work Location: In person