{"schemaVersion":"jobsearcher.job.v1","id":"aad8e00db841660de5b2edf6","url":"https://jobsearcher.com/jobs/aad8e00db841660de5b2edf6","canonicalUrl":"https://jobsearcher.com/jobs/aad8e00db841660de5b2edf6","title":"Data Engineer","description":"Iris's direct client, a leader Payroll, is looking to hire a strong Databricks Platform Engineer for a Long Term Contractual role.Job title: Data & AI Platform Engineer — (Databricks + AWS)Location: Hybrid (3 days onsite, Roseland, NJ)Duration: 18 Months Skills: Databricks, Pyspark, Python, Genie Space Or Genie AgentJob DescriptionAbout the RoleOwn the Databricks lakehouse layer and AI/LLM platform for Finance Insights. You'll design the data architecture on Databricks Unity Catalog, build Genie Spaces for natural language analytics, and integrate LLMs to power intelligent financial workflows — all running on AWS.ResponsibilitiesDesign and build Delta Lake tables on Databricks (bronze/silver/gold medallion architecture) for financial datasets (AR, GL, invoices, collections)Build and manage Databricks Genie Spaces — configure semantic models, write GENIE-compatible SQL, and tune NL-to-SQL behavior for finance use casesDevelop PySpark and Python-based data pipelines (Databricks Jobs + Workflows) for ERP data ingestion, transformation, and aggregationIntegrate Databricks Model Serving with LLMs (Claude, GPT-4, or custom fine-tuned models) for AI-driven insights, anomaly detection, and financial forecastingBuild RAG pipelines using Databricks Vector Search over financial documents, contracts, and GL notesExpose Databricks SQL Warehouse endpoints to Python API services and the React frontendManage Unity Catalog governance — row-level security, column masking, data lineage for finance complianceDeploy infrastructure on AWS (S3 as Databricks external storage, IAM roles, VPC networking, Secrets Manager)Required SkillsDatabricks (PySpark, Delta Lake, Jobs/Workflows, SQL Warehouses) — 3+ yearsDatabricks Unity Catalog and governanceDatabricks Genie Spaces (semantic layer, NL analytics)Python 3.11+ for data engineering and API integrationAWS (S3, IAM, VPC, Secrets Manager, optionally Lambda/Glue)LLM integration: Databricks Model Serving, MLflow, or direct API calls to Claude/OpenAISQL (advanced — window functions, CTEs, query optimization)","company":"Iris Software","rawCompany":"iris software","city":"Roseland","state":"NJ","isRemote":false,"isActive":false,"createdAt":"2026-08-12T11:06:36.323Z","occupations":[{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"},{"code":"15-2051.00","title":"Data Scientists","slug":"data-scientists"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"518210","title":"Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services","slug":"computing-infrastructure-providers-data-processing-web-hosting-and-related-services"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Data Engineer","description":"Iris's direct client, a leader Payroll, is looking to hire a strong Databricks Platform Engineer for a Long Term Contractual role.Job title: Data & AI Platform Engineer — (Databricks + AWS)Location: Hybrid (3 days onsite, Roseland, NJ)Duration: 18 Months Skills: Databricks, Pyspark, Python, Genie Space Or Genie AgentJob DescriptionAbout the RoleOwn the Databricks lakehouse layer and AI/LLM platform for Finance Insights. You'll design the data architecture on Databricks Unity Catalog, build Genie Spaces for natural language analytics, and integrate LLMs to power intelligent financial workflows — all running on AWS.ResponsibilitiesDesign and build Delta Lake tables on Databricks (bronze/silver/gold medallion architecture) for financial datasets (AR, GL, invoices, collections)Build and manage Databricks Genie Spaces — configure semantic models, write GENIE-compatible SQL, and tune NL-to-SQL behavior for finance use casesDevelop PySpark and Python-based data pipelines (Databricks Jobs + Workflows) for ERP data ingestion, transformation, and aggregationIntegrate Databricks Model Serving with LLMs (Claude, GPT-4, or custom fine-tuned models) for AI-driven insights, anomaly detection, and financial forecastingBuild RAG pipelines using Databricks Vector Search over financial documents, contracts, and GL notesExpose Databricks SQL Warehouse endpoints to Python API services and the React frontendManage Unity Catalog governance — row-level security, column masking, data lineage for finance complianceDeploy infrastructure on AWS (S3 as Databricks external storage, IAM roles, VPC networking, Secrets Manager)Required SkillsDatabricks (PySpark, Delta Lake, Jobs/Workflows, SQL Warehouses) — 3+ yearsDatabricks Unity Catalog and governanceDatabricks Genie Spaces (semantic layer, NL analytics)Python 3.11+ for data engineering and API integrationAWS (S3, IAM, VPC, Secrets Manager, optionally Lambda/Glue)LLM integration: Databricks Model Serving, MLflow, or direct API calls to Claude/OpenAISQL (advanced — window functions, CTEs, query optimization)","datePosted":"2026-08-12T11:06:36.323Z","dateModified":"2026-08-12T11:06:36.323Z","hiringOrganization":{"@type":"Organization","name":"Iris Software","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Roseland","addressRegion":"NJ","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"aad8e00db841660de5b2edf6"},"url":"https://jobsearcher.com/jobs/aad8e00db841660de5b2edf6"}}