{"schemaVersion":"jobsearcher.job.v1","id":"c2cf59f6f35a4ee30a7dcb20","url":"https://jobsearcher.com/jobs/c2cf59f6f35a4ee30a7dcb20","canonicalUrl":"https://jobsearcher.com/jobs/c2cf59f6f35a4ee30a7dcb20","title":"Manager - Data Engineering","description":"LatentView Analytics is a leading global analytics and decision sciences provider, delivering solutions that help companies drive digital transformation and use data to gain a competitive advantage. With analytics solutions that provide a 360-degree view of the digital consumer, fuel machine learning capabilities, and support artificial intelligence initiatives., LatentView Analytics enables leading global brands to predict new revenue streams, anticipate product trends and popularity, improve customer retention rates, optimize investment decisions, and turn unstructured data into valuable business assets.\n\nDesignation : Manager - Data Engineering\n\nLevel : L4\n\nLocation : San Jose, California , United States\n\nExperience : 10 to 15 Years\n\nJob Role :\n\nWe're looking for a Senior Data Engineer with deep expertise in building and scaling modern data platforms. You'll design, build, and maintain robust data pipelines and infrastructure that power analytics and business-critical applications, with a strong emphasis on the Databricks and AWS ecosystem.\n\nKey Responsibilities\n\nDesign, develop, and maintain scalable ETL/ELT pipelines using Databricks (PySpark/Spark SQL)\n\nBuild, orchestrate, and monitor workflows using Apache Airflow (DAG design, scheduling, dependency management)\n\nArchitect and manage data infrastructure on AWS (S3, Glue, Lambda, EMR, Redshift, IAM, etc.)\n\nOptimize data pipelines for performance, reliability, and cost-efficiency\n\nImplement data quality checks, testing frameworks, and observability/monitoring for pipelines\n\nCollaborate with Data Scientists, Analysts, and Product teams to understand data requirements\n\nDesign and maintain data models (Lakehouse/Medallion architecture — Bronze/Silver/Gold layers)\n\nImplement CI/CD pipelines for data engineering workflows\n\nEnsure data security, access controls, and compliance across the data platform\n\nDocument architecture, pipelines, and processes for team knowledge sharing\n\nMentor junior data engineers and contribute to engineering best practices\n\nRequired Qualifications\n\n7+ years of experience in Data Engineering roles\n\nExtensive hands-on experience with Databricks (Delta Lake, Unity Catalog, cluster management, notebooks, job orchestration)\n\nStrong experience with AWS cloud services (S3, IAM, Glue, EMR, Lambda, Redshift, CloudWatch)\n\nProven expertise in Apache Airflow for workflow orchestration and scheduling\n\nStrong programming skills in Python and SQL\n\nSolid understanding of Apache Spark (PySpark, Spark SQL, performance tuning)\n\nExperience with data modeling, warehousing concepts, and Lakehouse architecture\n\nFamiliarity with version control (Git) and CI/CD practices\n\nStrong understanding of data governance, quality, and lineage principles\n\nExcellent problem-solving and communication skills\n\nAt LatentView Analytics, we value a diverse, inclusive workforce and provide equal employment opportunities for all applicants and employees. All qualified applicants for employment will be considered without regard to an individual's race, colour, sex, gender identity, gender expression, religion, age, national origin or ancestry, citizenship, physical or mental disability, medical condition, family care status, marital status, domestic partner status, sexual orientation, genetic information, military or veteran status, or any other basis protected by federal, state or local laws.\nJob Snapshot\nUpdated Date\n20-08-2026\nJob ID\nJ_5716\nLocation\nSan Jose, California, United States\nEmployee Type\nPermanent","company":"Latentviewanalytics","rawCompany":"latentviewanalytics","city":"San Jose","state":"CA","isRemote":false,"isActive":false,"createdAt":"2026-08-29T10:44:50.525Z","occupations":[{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-2051.00","title":"Data Scientists","slug":"data-scientists"},{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Manager - Data Engineering","description":"LatentView Analytics is a leading global analytics and decision sciences provider, delivering solutions that help companies drive digital transformation and use data to gain a competitive advantage. With analytics solutions that provide a 360-degree view of the digital consumer, fuel machine learning capabilities, and support artificial intelligence initiatives., LatentView Analytics enables leading global brands to predict new revenue streams, anticipate product trends and popularity, improve customer retention rates, optimize investment decisions, and turn unstructured data into valuable business assets.\n\nDesignation : Manager - Data Engineering\n\nLevel : L4\n\nLocation : San Jose, California , United States\n\nExperience : 10 to 15 Years\n\nJob Role :\n\nWe're looking for a Senior Data Engineer with deep expertise in building and scaling modern data platforms. You'll design, build, and maintain robust data pipelines and infrastructure that power analytics and business-critical applications, with a strong emphasis on the Databricks and AWS ecosystem.\n\nKey Responsibilities\n\nDesign, develop, and maintain scalable ETL/ELT pipelines using Databricks (PySpark/Spark SQL)\n\nBuild, orchestrate, and monitor workflows using Apache Airflow (DAG design, scheduling, dependency management)\n\nArchitect and manage data infrastructure on AWS (S3, Glue, Lambda, EMR, Redshift, IAM, etc.)\n\nOptimize data pipelines for performance, reliability, and cost-efficiency\n\nImplement data quality checks, testing frameworks, and observability/monitoring for pipelines\n\nCollaborate with Data Scientists, Analysts, and Product teams to understand data requirements\n\nDesign and maintain data models (Lakehouse/Medallion architecture — Bronze/Silver/Gold layers)\n\nImplement CI/CD pipelines for data engineering workflows\n\nEnsure data security, access controls, and compliance across the data platform\n\nDocument architecture, pipelines, and processes for team knowledge sharing\n\nMentor junior data engineers and contribute to engineering best practices\n\nRequired Qualifications\n\n7+ years of experience in Data Engineering roles\n\nExtensive hands-on experience with Databricks (Delta Lake, Unity Catalog, cluster management, notebooks, job orchestration)\n\nStrong experience with AWS cloud services (S3, IAM, Glue, EMR, Lambda, Redshift, CloudWatch)\n\nProven expertise in Apache Airflow for workflow orchestration and scheduling\n\nStrong programming skills in Python and SQL\n\nSolid understanding of Apache Spark (PySpark, Spark SQL, performance tuning)\n\nExperience with data modeling, warehousing concepts, and Lakehouse architecture\n\nFamiliarity with version control (Git) and CI/CD practices\n\nStrong understanding of data governance, quality, and lineage principles\n\nExcellent problem-solving and communication skills\n\nAt LatentView Analytics, we value a diverse, inclusive workforce and provide equal employment opportunities for all applicants and employees. All qualified applicants for employment will be considered without regard to an individual's race, colour, sex, gender identity, gender expression, religion, age, national origin or ancestry, citizenship, physical or mental disability, medical condition, family care status, marital status, domestic partner status, sexual orientation, genetic information, military or veteran status, or any other basis protected by federal, state or local laws.\nJob Snapshot\nUpdated Date\n20-08-2026\nJob ID\nJ_5716\nLocation\nSan Jose, California, United States\nEmployee Type\nPermanent","datePosted":"2026-08-29T10:44:50.525Z","dateModified":"2026-08-29T10:44:50.525Z","hiringOrganization":{"@type":"Organization","name":"Latentviewanalytics","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"San Jose","addressRegion":"CA","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"c2cf59f6f35a4ee30a7dcb20"},"url":"https://jobsearcher.com/jobs/c2cf59f6f35a4ee30a7dcb20"}}