JOBSEARCHER

Data Engineer - Data Platforms

Job Description
Job Title: Data Engineer - Data Platforms
Location: Piscataway, NJ
Duration: 12 Months
Interview: Virtual
Pay Rate: $68 on C2C (All inclusive) 2MCR - 5825048
Required Skills: " Apache Spark & Scala Strong hands-on experience developing distributed data-processing applications. " Hadoop / Hive / Impala Strong experience working with enterprise Big Data platforms and large datasets. " SQL Advanced SQL skills including complex queries, joins, transformations, reconciliation, and performance tuning. " Python Strong scripting and data-processing experience for automation, utilities, and data engineering activities.
Preferred Skills: " Experience working within banking or financial services environments. " Understanding of large-volume transactional and financial datasets. " Knowledge of ETL/data pipelines, data quality, and data reconciliation. " Experience with Agile development and CI/CD practices. *BGC* A Data Engineer with expertise in Data Platforms specializes in developing applications on Big Data technologies, such as API development. This role requires a strong foundation in traditional Application Development, along with knowledge of Analytics libraries, open-source Natural Language Processing, and statistical and big data computing libraries. The ideal candidate will possess exceptional technical abilities to understand, design, write, and debug complex code.