Scala Developer

Job Role – Spark / Scala Senior Engineer Location: Jacksonville, FL (3 days onsite/week, hybrid)Job Type: ContractWhat is in it for you?We are looking for a highly skilled Spark/Scala Senior Engineer with 8 to 10 years of experience in designing, developing, and optimizing large-scale batch and real-time data processing solutions. The ideal candidate will possess strong expertise in Scala, Apache Spark, Snowflake, Kafka/NiFi, and modern Data Engineering frameworks. This role requires hands-on technical leadership, performance optimization expertise, and the ability to mentor junior team members while driving engineering best practices Required Technical SkillsScalaStrong hands-on experience with Scala development.Deep understanding of:Case ClassesTraitsPattern MatchingCollections FrameworkImplicitsStrong knowledge of Functional Programming concepts:ImmutabilityHigher-Order Functions (HOFs)MonadsExperience developing and maintaining production-grade Scala applications.Apache SparkStrong expertise with:Spark SQLDataFramesDatasetsExtensive experience with Spark Structured Streaming.Deep understanding of Spark internals:DAG ExecutionLazy EvaluationShuffle OperationsStage ExecutionExperience optimizing large-scale Spark workloads.Hands-on experience with:ParquetAvroORCDelta LakeApache KafkaApache NiFiSnowflakeExperience designing and querying Snowflake data warehouse schemas.Familiarity with:Snowflake StagesFile FormatsStreamsTasksKnowledge of Snowpark for Scala is preferred.Data Engineering & DevelopmentStrong SQL and query optimization skills.Experience with Git-based version control workflows.Familiarity with Docker and containerized application development.Experience working within Agile development environments.Good to have skills: - • Pharmacy DomainResponsibilitiesDesign, develop, and optimize large-scale batch and streaming data pipelines using Scala and Apache Spark.Build robust data processing solutions using Spark SQL, DataFrames, and Datasets.Develop and maintain Spark Structured Streaming applications for real-time data ingestion and processing.Integrate data pipelines with enterprise data platforms such as Snowflake.Implement scalable data ingestion frameworks utilizing Apache Kafka and/or Apache NiFi.Perform Spark performance tuning, including:Partition optimizationCaching strategiesShuffle optimizationBroadcast joinsResource allocation tuningDevelop clean, maintainable, and testable Scala code following functional programming principles.Participate in code reviews and establish coding standards and best practices.Create automated tests and support CI/CD pipeline improvements.Monitor production data pipelines and troubleshoot performance or data quality issues.Conduct root cause analysis and implement preventive measures.Lead technical and architectural discussions across teams.Mentor junior engineers and provide technical guidance.Collaborate with cross-functional stakeholders to deliver scalable data solutions.Experience: - 9+ YearsHiring mode: ContractLocation: - Jacksonville FLEducational Qualifications: - • Engineering Degree – BE/ME/BTech/MTech/BSc/MSc.• Technical certification in multiple technologies is desirable.