Data Integration Engineer NetSuite API & Databricks
We are looking for an experienced Data Integration Engineer to support a data integration initiative that brings data from multiple enterprise systems into a centralized data platform.The ideal candidate will have strong experience integrating NetSuite APIs, Databricks, and other enterprise data sources, with a solid understanding of ETL/ELT pipelines, data transformation, data quality, and cloud-based data platforms.This person will work closely with business stakeholders, application teams, data engineers, and architects to design and implement reliable, scalable data integrations.Key Responsibilities Design, develop, and maintain data integration pipelines between NetSuite APIs, Databricks, databases, SaaS applications, and other enterprise systems. Develop robust ETL/ELT processes for extracting, transforming, and loading data into the centralized data platform. Integrate data using REST APIs, SOAP APIs, web services, and third-party connectors. Work with NetSuite data and integrations, including SuiteTalk, REST/SOAP web services, saved searches, and NetSuite data structures. Build and optimize data pipelines using Databricks, including Spark, SQL, notebooks, and Delta Lake where applicable. Develop data transformations using SQL and Python/PySpark. Implement incremental data loads, CDC/change tracking, error handling, retry mechanisms, and data reconciliation. Monitor data pipelines and troubleshoot integration, performance, and data-quality issues. Work with large and complex datasets while ensuring scalability and reliability. Collaborate with data architects to establish appropriate data models, integration patterns, and data-flow architectures. Implement data validation and quality checks to ensure accuracy and consistency across source and target systems. Document APIs, data mappings, transformation logic, integration workflows, and operational procedures. Participate in technical discussions with business and application teams to understand data requirements and integration dependencies.Required Qualifications 5+ years of experience in data engineering, data integration, ETL/ELT, or a related discipline. Strong hands-on experience with Databricks and modern data engineering practices. Strong SQL skills. Strong experience with Python and/or PySpark. Hands-on experience developing integrations using REST APIs and/or SOAP APIs. Experience working with NetSuite APIs, preferably with SuiteTalk, REST Web Services, SOAP Web Services, or NetSuite integrations. Experience building production-grade data pipelines and integration workflows. Strong understanding of relational databases, data modeling, and data warehousing concepts. Experience with cloud data platforms and modern data architecture. Understanding of data quality, reconciliation, error handling, logging, and pipeline monitoring.Strong communication skills and ability to work with both technical and non-technical stakeholders.Preferred Qualifications Experience with Delta Lake, Apache Spark, Databricks Workflows, Unity Catalog, or similar Databricks capabilities. Experience with cloud platforms such as AWS, Azure, or Google Cloud Platform. Experience with integration/orchestration tools such as Azure Data Factory, AWS Glue, MuleSoft, Boomi, Informatica, or similar technologies. Experience integrating other ERP, CRM, financial, or SaaS platforms. Experience with CI/CD, Git, automated testing, and DevOps practices. Understanding of data governance, security, access controls, and compliance. Experience working in Agile/Scrum environments.Regards,Raj Dakshinapu | Recruiter, Dotcom Team LLCPhoneWeb: | Email:2023 Best Places to Work – Boston Business JournalMinority Certified – Boston Business Journal’s Top Ten 2022, 2023Certified National Minority Supplier – NMSDC