{"schemaVersion":"jobsearcher.job.v1","id":"5cae766f9532e7dae7d8d2f3","url":"https://jobsearcher.com/jobs/5cae766f9532e7dae7d8d2f3","canonicalUrl":"https://jobsearcher.com/jobs/5cae766f9532e7dae7d8d2f3","title":"Data Engineering Manager","description":"YipitData is the leading market research and analytics firm for the disruptive economy and most recently raised $475M from The Carlyle Group at a valuation of over $1B. Every day, our proprietary technology analyzes billions of alternative data points to uncover actionable insights across sectors like software, AI, cloud, e-commerce, ridesharing, and payments.\r\nOur data and research teams transform raw data into strategic intelligence, delivering accurate, timely, and deeply contextualized analysis that our customers—ranging from the world's top investment funds to Fortune 500 companies—depend on to drive high-stakes decisions. From sourcing and licensing novel datasets to rigorous analysis and expert narrative framing, our teams ensure clients get not just data, but clarity and confidence.\r\nWe operate globally with offices in the US (NYC, Austin, Miami, Mountain View), APAC (Hong Kong, Shanghai, Beijing, Guangzhou, Singapore), and India. Our award-winning, people-centric culture—recognized by Inc. as a Best Workplace for three consecutive years—emphasizes transparency, ownership, and continuous mastery.\r\nWhat It's Like to Work at YipitData YipitData isn't a place for coasting—it's a launchpad for ambitious, impact-driven professionals.\r\nFrom day one, you'll take the lead on meaningful work, accelerate your growth, and gain exposure that shapes careers.\r\nWhy Top Talent Chooses YipitData Ownership That Matters : You'll lead high-impact projects with real business outcomes\r\nRapid Growth : We compress years of learning into months\r\nMerit Over Titles : Trust and responsibility are earned through execution, not tenure\r\nVelocity with Purpose : We move fast, support each other, and aim high—always with purpose and intention\r\nAbout The Role We are looking for a highly skilled Data Engineering Manager to join our Data Engineering team and play a central role in building and scaling our vendor universe—the database of companies we track and analyze. Reporting directly to the Senior Director of Data Engineering, this role demands technical leadership, independence, and the ability to deliver under tight deadlines in a fast-paced environment.\r\nAs a Data Engineering Manager, you will design and maintain large-scale data pipelines, define best practices for ETL, and integrate emerging technologies to keep our platform on the cutting edge. You'll work cross-functionally to deliver reliable, efficient, and scalable data solutions while contributing hands-on expertise in Databricks, Airflow, PySpark, and SQL.\r\nWhat You'll Do Own the design, build, and optimization of end-to-end data pipelines that power our vendor universe.\r\nEstablish and enforce best practices in data modeling, orchestration, and system reliability.\r\nCollaborate with product, engineering, and business stakeholders to translate requirements into robust, scalable data solutions.\r\nWork extensively with Databricks and Airflow for large-scale data processing and orchestration.\r\nTroubleshoot and resolve complex pipeline issues to ensure reliability and performance.\r\nContribute to the team's technical strategy, helping drive improvements in scalability, performance, and efficiency.\r\nLead, mentor, and support engineers through challenges, code reviews, and project execution.\r\nWhat We're Looking For 6+ years of professional experience in Data Engineering or equivalent technical roles (e.g., data architecture, big data development, or ETL engineering).\r\n2+ years of managerial experience , including mentoring, team leadership, and supporting delivery.\r\nStrong expertise in SQL and distributed data systems.\r\nProficiency with PySpark and Databricks for processing and scaling large datasets.\r\nHands-on experience with Airflow for pipeline orchestration (Dagster/dbt a plus).\r\nProven track record of delivering in fast-paced, deadline-driven environments with minimal oversight.\r\nStrong problem-solving skills and ability to translate business needs into scalable technical solutions.\r\nExcellent communication and collaboration skills with both technical and non-technical stakeholders.\r\nNice to Have Experience leveraging AI/ML models, vector search , or Elasticsearch to enhance data pipelines.\r\nFamiliarity with Django or similar web frameworks to support data-driven applications.\r\nRemote & Location Flexibility This is a remote-friendly opportunity that can sit in NYC (headquarters), one of our office hubs (Austin, Miami, Denver, or Mountain View), or elsewhere in the US. Depending on remote work location, income may be subject to New York State tax withholding.\r\nAdditional Information We are not able to consider candidates who currently or will require visa sponsorship.\r\nWhat We Offer Our compensation package includes comprehensive benefits, perks, and a competitive salary.\r\nFlexible work hours, flexible vacation, a generous 401K match, parental leave, team events, wellness budget, learning reimbursement, and more!\r\nGrowth is driven by impact, not tenure, office politics, or facetime.\r\nThe annual on-target earnings for this position are anticipated to be up to $215,000–$240,000.\r\nAdditional factors like experience, skills, and team benchmarks influence the final offer.\r\nThe compensation package also includes equity.\r\nEqual Employment Opportunity We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, marital status, disability, gender, gender identity or expression, or veteran status. We are proud to be an equal opportunity employer.\r\nJ-18808-Ljbffr","company":"Yipitdata","rawCompany":"yipitdata","city":"New York","state":"NY","isRemote":false,"isActive":true,"createdAt":"2026-05-23T06:48:26.822Z","occupations":[{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-2051.00","title":"Data Scientists","slug":"data-scientists"},{"code":"15-1243.00","title":"Database Architects","slug":"database-architects"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Data Engineering Manager","description":"YipitData is the leading market research and analytics firm for the disruptive economy and most recently raised $475M from The Carlyle Group at a valuation of over $1B. Every day, our proprietary technology analyzes billions of alternative data points to uncover actionable insights across sectors like software, AI, cloud, e-commerce, ridesharing, and payments.\r\nOur data and research teams transform raw data into strategic intelligence, delivering accurate, timely, and deeply contextualized analysis that our customers—ranging from the world's top investment funds to Fortune 500 companies—depend on to drive high-stakes decisions. From sourcing and licensing novel datasets to rigorous analysis and expert narrative framing, our teams ensure clients get not just data, but clarity and confidence.\r\nWe operate globally with offices in the US (NYC, Austin, Miami, Mountain View), APAC (Hong Kong, Shanghai, Beijing, Guangzhou, Singapore), and India. Our award-winning, people-centric culture—recognized by Inc. as a Best Workplace for three consecutive years—emphasizes transparency, ownership, and continuous mastery.\r\nWhat It's Like to Work at YipitData YipitData isn't a place for coasting—it's a launchpad for ambitious, impact-driven professionals.\r\nFrom day one, you'll take the lead on meaningful work, accelerate your growth, and gain exposure that shapes careers.\r\nWhy Top Talent Chooses YipitData Ownership That Matters : You'll lead high-impact projects with real business outcomes\r\nRapid Growth : We compress years of learning into months\r\nMerit Over Titles : Trust and responsibility are earned through execution, not tenure\r\nVelocity with Purpose : We move fast, support each other, and aim high—always with purpose and intention\r\nAbout The Role We are looking for a highly skilled Data Engineering Manager to join our Data Engineering team and play a central role in building and scaling our vendor universe—the database of companies we track and analyze. Reporting directly to the Senior Director of Data Engineering, this role demands technical leadership, independence, and the ability to deliver under tight deadlines in a fast-paced environment.\r\nAs a Data Engineering Manager, you will design and maintain large-scale data pipelines, define best practices for ETL, and integrate emerging technologies to keep our platform on the cutting edge. You'll work cross-functionally to deliver reliable, efficient, and scalable data solutions while contributing hands-on expertise in Databricks, Airflow, PySpark, and SQL.\r\nWhat You'll Do Own the design, build, and optimization of end-to-end data pipelines that power our vendor universe.\r\nEstablish and enforce best practices in data modeling, orchestration, and system reliability.\r\nCollaborate with product, engineering, and business stakeholders to translate requirements into robust, scalable data solutions.\r\nWork extensively with Databricks and Airflow for large-scale data processing and orchestration.\r\nTroubleshoot and resolve complex pipeline issues to ensure reliability and performance.\r\nContribute to the team's technical strategy, helping drive improvements in scalability, performance, and efficiency.\r\nLead, mentor, and support engineers through challenges, code reviews, and project execution.\r\nWhat We're Looking For 6+ years of professional experience in Data Engineering or equivalent technical roles (e.g., data architecture, big data development, or ETL engineering).\r\n2+ years of managerial experience , including mentoring, team leadership, and supporting delivery.\r\nStrong expertise in SQL and distributed data systems.\r\nProficiency with PySpark and Databricks for processing and scaling large datasets.\r\nHands-on experience with Airflow for pipeline orchestration (Dagster/dbt a plus).\r\nProven track record of delivering in fast-paced, deadline-driven environments with minimal oversight.\r\nStrong problem-solving skills and ability to translate business needs into scalable technical solutions.\r\nExcellent communication and collaboration skills with both technical and non-technical stakeholders.\r\nNice to Have Experience leveraging AI/ML models, vector search , or Elasticsearch to enhance data pipelines.\r\nFamiliarity with Django or similar web frameworks to support data-driven applications.\r\nRemote & Location Flexibility This is a remote-friendly opportunity that can sit in NYC (headquarters), one of our office hubs (Austin, Miami, Denver, or Mountain View), or elsewhere in the US. Depending on remote work location, income may be subject to New York State tax withholding.\r\nAdditional Information We are not able to consider candidates who currently or will require visa sponsorship.\r\nWhat We Offer Our compensation package includes comprehensive benefits, perks, and a competitive salary.\r\nFlexible work hours, flexible vacation, a generous 401K match, parental leave, team events, wellness budget, learning reimbursement, and more!\r\nGrowth is driven by impact, not tenure, office politics, or facetime.\r\nThe annual on-target earnings for this position are anticipated to be up to $215,000–$240,000.\r\nAdditional factors like experience, skills, and team benchmarks influence the final offer.\r\nThe compensation package also includes equity.\r\nEqual Employment Opportunity We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, marital status, disability, gender, gender identity or expression, or veteran status. We are proud to be an equal opportunity employer.\r\nJ-18808-Ljbffr","datePosted":"2026-05-23T06:48:26.822Z","dateModified":"2026-05-23T06:48:26.822Z","hiringOrganization":{"@type":"Organization","name":"Yipitdata","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"New York","addressRegion":"NY","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"5cae766f9532e7dae7d8d2f3"},"url":"https://jobsearcher.com/jobs/5cae766f9532e7dae7d8d2f3"}}