Data Engineer with OCI Exp.
As a Data Engineer with OCI, you will be a part of an Agile team to build healthcare applications and implement new features while adhering to the best coding development standards.
Mandatory Technical skills: -
PySpark, Python, Advanced SQL, Big Data Processing, OCI
Responsibilities: -
· Design, develop, and optimize scalable batch and streaming data pipelines using PySpark, Python, and advanced SQL.
· Build enterprise-grade ingestion, transformation, enrichment, and consumption pipelines across Bronze, Silver, and Gold layers.
· Design and operate cloud data solutions primarily on Oracle Cloud Infrastructure (OCI), while supporting platform evaluation or integration with Databricks and Snowflake where appropriate.
· Process structured, semi-structured, and unstructured content at scale, including document ingestion, metadata extraction, and entity extraction.
· Engineer enterprise knowledge-base pipelines using chunking, embeddings, vector stores, and graph databases to support search, retrieval, and agentic AI use cases.
· Design reusable data models, lakehouse/warehouse structures, semantic layers, and data products for enterprise consumption.
· Implement data quality, observability, lineage, governance, security, and incremental-processing controls across the platform.
· Optimize distributed processing, storage, and query performance for high-volume data workloads.
· Collaborate with data architects, AI teams, platform teams, business stakeholders, and client leadership to translate requirements into scalable technical solutions.
· Contribute hands-on to development, code reviews, troubleshooting, production deployments, and technical design decisions.
· Mentor engineers and support initial technical screening, solution discussions, and delivery planning.