{"schemaVersion":"jobsearcher.job.v1","id":"9e030d44e4c34826ec5b4015","url":"https://jobsearcher.com/jobs/9e030d44e4c34826ec5b4015","canonicalUrl":"https://jobsearcher.com/jobs/9e030d44e4c34826ec5b4015","title":"Lead Data Engineer / Lead BigData Engineer","description":"Please find details for this position below:Client: Banking/Financial IndustryTitle: Lead Data Engineer / Lead BigData Engineer / Lead BigData Architect / Lead BigData Platform Engineer / Big Data Platform Engineer - 5 OpeningsLocation: Charlotte, NC – Hybrid RolesDuration: 12+ Month (s) Extend or Convert based on performances1st Job Details:Required Qualifications:7+ years of software engineering experience7+ years of experience working with Teradata5+ years ETL AbInitio5+ Advanced SQL5 + years of cloud computing experience3+ years of experience with Google Big QueryDesired Qualifications:5+ years of experience with Spark, Python3+ years of experience with secure DevOps and deployment automation to cloud environments3+ years of Agile experienceStrong analytical skillsStrong verbal, written, and interpersonal communication skillsAn industry-standard technology Cloud certificationWorking knowledge of Google Cloud Platform (GCP)Experience communicating and presenting complex information to multiple levels of the organizationExperience successfully escalating complex issues and tracking follow-through to completionStrong collaboration and partnering skillsExperience with strategy development and implementationJob Details - 3 Openings:Required Qualifications:5+ years of Software Engineering experienceFinancial Crimes Technology team is evolving toward more in-house build capabilities and reducing dependency on legacy vendor/tooling approaches.This role will support data engineering and platform development for financial crimes use cases (AML, investigations, sanctions, fraud, KYC) by building scalable pipelines, improving data quality, and enabling analytics/reporting and downstream applications.Key Responsibilities:Build and maintain batch and/or streaming data pipelines supporting financial crimes initiatives.Develop data transformations using Python + PySpark and optimize performance for large datasets.Apply strong understanding of Apache Spark architecture (executors, partitions, shuffles, joins, caching) to improve performancePartner with business and technical stakeholders to translate requirements into data models, mappings, and curated datasets.Support ingestion from multiple sources (transactional systems, case management, reference data, etc.).Implement data quality checks, reconciliation, and controls to ensure auditability and reliability.Contribute to modernization efforts (legacy → in-house build) including migration planning and redesign.Create documentation for pipelines, logic, and operational runbooks.Work within Agile delivery (Jira), supporting sprint execution and delivery timelines.Required Skills:5+ years of experience in data engineering / ETL / data platform developmentStrong hands-on development in:PythonPySpark / Apache SparkAdvanced SQLExperience working with large-scale data sets and performance tuning.Strong understanding of data concepts: data modeling, lineage, metadata, governanceExperience supporting regulated environments with emphasis on controls and audit readinessStrong communication skills (ability to work with both engineering + business partners)Preferred Skills (Nice to Have):Experience running PySpark workloads on Google Cloud Platform (GCP)Dataproc, BigQuery, Google Cloud Storage (GCS), etc.Experience with cloud native Big Data platformsKnowledge of data governance, security, and compliance practicesExperience with CI/CD pipelines for data engineering workloadsOrchestration: Airflow (or similar scheduling tools)Streaming: KafkaLakehouse/Warehouse: Databricks / Snowflake / BigQueryCI/CD + DevOps: Git, pipelines, automation, release managementData governance/security: encryption, access controls, data masking, PII handlingPrior Financial Crimes domain: AML / sanctions / fraud / investigations / KYCDomain Experience (Highly Valued):Experience supporting AML, Transaction Monitoring, Investigations, Sanctions screening, Fraud, or similar risk/compliance functions.Familiarity with regulatory expectations and strong documentation discipline.Job Details - Big Data Platform Engineer - 1 OpeningsRequired Qualifications:4+ years of Software EngineeringBig Data Platform (Source, Conform, Curate)Big Data developer (Spark, Scala, Python, Autosys, Git, etc.)Tools Used (Spark, Python, Scala, Linux Shell, Autosys, etc.)Home Grown Tool (Flow Master, Edit Upload, etc.) - if prior WFInterfaces (Linux Command Line, Editors like PyCharm, Dremio, etc.)Soft Skills (Data processing experience, Big Data experience, Data Controls experience, working in JIRA Agile)Accountability (Lead and own work streams end to end)Fin Crime (Domain expertise with preparing data for use cases like Transaction Monitoring, Customer Risk, Investigations, etc.)EEO:Mindlance is an Equal Opportunity Employer and does not discriminate in employment on the basis of – Minority/Gender/Disability/Religion/LGBTQI/Age/Veterans.","company":"Mindlance","rawCompany":"mindlance","city":"Charlotte","state":"NC","isRemote":false,"isActive":false,"createdAt":"2026-05-03T02:52:01.240Z","occupations":[{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"},{"code":"15-2051.00","title":"Data Scientists","slug":"data-scientists"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"518210","title":"Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services","slug":"computing-infrastructure-providers-data-processing-web-hosting-and-related-services"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Lead Data Engineer / Lead BigData Engineer","description":"Please find details for this position below:Client: Banking/Financial IndustryTitle: Lead Data Engineer / Lead BigData Engineer / Lead BigData Architect / Lead BigData Platform Engineer / Big Data Platform Engineer - 5 OpeningsLocation: Charlotte, NC – Hybrid RolesDuration: 12+ Month (s) Extend or Convert based on performances1st Job Details:Required Qualifications:7+ years of software engineering experience7+ years of experience working with Teradata5+ years ETL AbInitio5+ Advanced SQL5 + years of cloud computing experience3+ years of experience with Google Big QueryDesired Qualifications:5+ years of experience with Spark, Python3+ years of experience with secure DevOps and deployment automation to cloud environments3+ years of Agile experienceStrong analytical skillsStrong verbal, written, and interpersonal communication skillsAn industry-standard technology Cloud certificationWorking knowledge of Google Cloud Platform (GCP)Experience communicating and presenting complex information to multiple levels of the organizationExperience successfully escalating complex issues and tracking follow-through to completionStrong collaboration and partnering skillsExperience with strategy development and implementationJob Details - 3 Openings:Required Qualifications:5+ years of Software Engineering experienceFinancial Crimes Technology team is evolving toward more in-house build capabilities and reducing dependency on legacy vendor/tooling approaches.This role will support data engineering and platform development for financial crimes use cases (AML, investigations, sanctions, fraud, KYC) by building scalable pipelines, improving data quality, and enabling analytics/reporting and downstream applications.Key Responsibilities:Build and maintain batch and/or streaming data pipelines supporting financial crimes initiatives.Develop data transformations using Python + PySpark and optimize performance for large datasets.Apply strong understanding of Apache Spark architecture (executors, partitions, shuffles, joins, caching) to improve performancePartner with business and technical stakeholders to translate requirements into data models, mappings, and curated datasets.Support ingestion from multiple sources (transactional systems, case management, reference data, etc.).Implement data quality checks, reconciliation, and controls to ensure auditability and reliability.Contribute to modernization efforts (legacy → in-house build) including migration planning and redesign.Create documentation for pipelines, logic, and operational runbooks.Work within Agile delivery (Jira), supporting sprint execution and delivery timelines.Required Skills:5+ years of experience in data engineering / ETL / data platform developmentStrong hands-on development in:PythonPySpark / Apache SparkAdvanced SQLExperience working with large-scale data sets and performance tuning.Strong understanding of data concepts: data modeling, lineage, metadata, governanceExperience supporting regulated environments with emphasis on controls and audit readinessStrong communication skills (ability to work with both engineering + business partners)Preferred Skills (Nice to Have):Experience running PySpark workloads on Google Cloud Platform (GCP)Dataproc, BigQuery, Google Cloud Storage (GCS), etc.Experience with cloud native Big Data platformsKnowledge of data governance, security, and compliance practicesExperience with CI/CD pipelines for data engineering workloadsOrchestration: Airflow (or similar scheduling tools)Streaming: KafkaLakehouse/Warehouse: Databricks / Snowflake / BigQueryCI/CD + DevOps: Git, pipelines, automation, release managementData governance/security: encryption, access controls, data masking, PII handlingPrior Financial Crimes domain: AML / sanctions / fraud / investigations / KYCDomain Experience (Highly Valued):Experience supporting AML, Transaction Monitoring, Investigations, Sanctions screening, Fraud, or similar risk/compliance functions.Familiarity with regulatory expectations and strong documentation discipline.Job Details - Big Data Platform Engineer - 1 OpeningsRequired Qualifications:4+ years of Software EngineeringBig Data Platform (Source, Conform, Curate)Big Data developer (Spark, Scala, Python, Autosys, Git, etc.)Tools Used (Spark, Python, Scala, Linux Shell, Autosys, etc.)Home Grown Tool (Flow Master, Edit Upload, etc.) - if prior WFInterfaces (Linux Command Line, Editors like PyCharm, Dremio, etc.)Soft Skills (Data processing experience, Big Data experience, Data Controls experience, working in JIRA Agile)Accountability (Lead and own work streams end to end)Fin Crime (Domain expertise with preparing data for use cases like Transaction Monitoring, Customer Risk, Investigations, etc.)EEO:Mindlance is an Equal Opportunity Employer and does not discriminate in employment on the basis of – Minority/Gender/Disability/Religion/LGBTQI/Age/Veterans.","datePosted":"2026-05-03T02:52:01.240Z","dateModified":"2026-05-03T02:52:01.240Z","hiringOrganization":{"@type":"Organization","name":"Mindlance","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Charlotte","addressRegion":"NC","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"9e030d44e4c34826ec5b4015"},"url":"https://jobsearcher.com/jobs/9e030d44e4c34826ec5b4015"}}