Senior Data Engineer

Quantiphi is an award-winning AI-first digital engineering company driven by the desire to solve transformational problems at the heart of the business. Quantiphi solves the toughest and most complex business problems by combining deep industry experience, disciplined cloud and data-engineering practices, and cutting-edge artificial intelligence research to achieve quantifiable business impact at unprecedented speed. We are passionate about our customers and obsessed with problem-solving to make products smarter, customer experiences frictionless, processes autonomous, and businesses safer by detecting risks, threats, and anomalies. Together with partners and customers, we embark on a data and AI-led transformation journey that delivers impactful and measurable results.JOB ROLE -Data Engineer / ATA DataLocation: US - Jersey City, As a Data Engineer / ATA Data at Quantiphi, you will solve big data problems and will develop solutions for migration, storage, and processingMust have skills:8+ years’ of hands-on experience in delivering data solutionsExperience with Databricks implementations - developing data pipelines using PySparkExperience in Databricks Workspaces,Notebooks, Delta Lake, APIsExperience in Python, ScalaExperience in advanced SQL and Query optimization Experience in implementing data integration projects using ETL Experience building and deploying cloud-based solutions at scale by ingesting data from sources like DB2 Good to have skills : Experience with AWS services - S3,Redshift,Secrets ManagerExperience in implementing data integration projects using ETLExperience in using Airflow or Step Functions for orchestrationExposure to IaC tools like Terraform and to CI/CD toolsPrior experience in migrating (on-prem to cloud) and processing large amounts of dataExperience in implementing data lake and data warehouse on cloudExperience in implementing the industry's best practices