Data Analyst / Engineer

"ALL our jobs are US based and candidates must be in the US with valid US Work Authorization. Please apply on our website directly." Data Analyst / EngineerColumbus, OHW2 OnlyFull AWS EnvironmentGood understanding about Teradata, GlueData MigrationResponsibilitiesDevelop and maintain data platforms using Python, Spark, and PySparkHandle migration to PySpark on AWSDesign and implement data pipelinesWork with AWS and Big DataProduce unit tests for Spark transformations and helper methodsCreate Scala/Spark jobs for data transformation and aggregationWrite Scaladoc-style documentation for codeOptimize Spark queries for performanceIntegrate with SQL databases (e.g., Microsoft, Oracle, Postgres, MySQLUnderstand distributed systems concepts (CAP theorem, partitioning, replication, consistency, and consensusSkillsProficiency in Python, Scala (with a focus on functional programming), and SparkFamiliarity with Spark APIs, including RDD, DataFrame, MLlib, GraphX, and StreamingExperience working with HDFS, S3, Cassandra, and/or DynamoDBDeep understanding of distributed systemsExperience with building or maintaining cloud-native applicationsFamiliarity with serverless approaches using AWS Lambda is a plusNote: This is a W2 Contract. So, candidate must work on Galaxy I Tech Payroll. For Immediate response please reach out to me at suresh2 at galaxy i tech dot com / four eight zero six nine six five three nine four