Lorven Technologies

A solid experience and understanding of considerations for large-scale solutioning and operationalization of data warehouses, data lakes and analytics platforms on GCP is a must.. Determine best way to extract application telemetry data, structure it, send to proper tool for reporting (Kafka, Splunk).. 6+ years of experience in Data Engineering with an emphasis on Data Warehousing and Data Analytics.. 2+ years hands on experience on GCP Cloud data implementation projects (Dataflow, DataProc, Cloud Composer, Big Query, Cloud Storage, GKE, Airflow, etc. At least 2 years of experience in Data governance and Metadata Management.

data engineer

Job Title: GCP Data Engineer Location: Phoenix, AZ (Onsite) Duration: 6+ Months Contract Required Skills <ul><li>Strong in GCP and Python</li><li>Knowledge on migration projects</li><li>experience on building re-usable idempotent pipelines</li><li>emphasize on data engineering principles on pipelines being built</li><li>comprehensive knowledge on some of the core GCP services </li></ul>Job Summary & Principal Duties <ul><li>A solid experience and understanding of considerations for large-scale solutioning and operationalization of data warehouses, data lakes and analytics platforms on GCP is a must.</li><li>Monitors the Data Lake and Warehouse to ensure that the appropriate support teams are engaged at the right times.</li><li>Design, build and test scalable data ingestion pipelines, perform end to end automation of ETL process for various datasets that are being ingested.</li><li>Participate in peer review and provide feedback to the engineers keeping development best practices, business and technical requirements in view</li><li>Determine best way to extract application telemetry data, structure it, send to proper tool for reporting (Kafka, Splunk).</li><li>Work with business and cross-functional teams to gather and document requirements to meet business needs.</li><li>Provide support as required to ensure the availability and performance of ETL/ELT jobs.</li><li>Provide technical assistance and cross training to business and internal team members.</li><li>Collaborate with business partners for continuous improvement opportunities. </li></ul>Education <ul><li>Bachelor's Degree in Computer Science, Information Technology, Engineering, or related field </li></ul>Experience, Skills & Qualifications <ul><li>6+ years of experience in Data Engineering with an emphasis on Data Warehousing and Data Analytics.</li><li>4+ years of experience with one of the leading public clouds.</li><li>4+ years of experience in design and build of salable data pipelines that deal with extraction, transformation, and loading.</li><li>4+ years of experience with Python, Scala with working knowledge on Notebooks.</li><li>2+ years hands on experience on GCP Cloud data implementation projects (Dataflow, DataProc, Cloud Composer, Big Query, Cloud Storage, GKE, Airflow, etc.).</li><li>At least 2 years of experience in Data governance and Metadata Management.</li><li>Ability to work independently, solve problems, update the stake holders.</li><li>Analyze, design, develop and deploy solutions as per business requirements.</li><li>Strong understanding of relational and dimensional data modeling.</li><li>Experience in DevOps and CI/CD related technologies.</li><li>Excellent written, verbal communication skills, including experience in technical documentation and ability to communicate with senior business managers and executives.</li></ul>

START NEW SEARCH