{"schemaVersion":"jobsearcher.job.v1","id":"eb58ed25876e1b277972ecbf","url":"https://jobsearcher.com/jobs/eb58ed25876e1b277972ecbf","canonicalUrl":"https://jobsearcher.com/jobs/eb58ed25876e1b277972ecbf","title":"Data Engineer","description":"Job Title: Data EngineerLocation: Malvern, PADuration:6 MonthsExperience Required: 10 & AboveJob Description:Technical skill sets :Python, Pyspark, AWS Lambda, S3,AWS glue, Kinesis,SQL, Apache Flink, Confluent Kafka, AI-LLM, Gen-AI , Java is optionalResponsibilities :1. Advanced Architecture & System DesignA Tech Lead is primarily responsible for the overall platform vision and ensuring systems do not break under scale.Distributed Computing: Mastery of frameworks like Apache Spark or Ray for massive-scale parallel data processing.Streaming & Event-Driven Architecture: Deep understanding of real-time pipeline design using Kafka, Kinesis, or Flink.Cloud Infrastructure: Expertise in at least one major public cloud (AWS), specifically understanding storage/compute decoupling and cost optimization.2. Core Programming & Database ManagementLeads set coding standards and review code, requiring complete fluency in the fundamentals.SQL: Advanced mastery for metrics computation, window functions, and query performance tuning across relational and columnar databases (e.g., Snowflake, Redshift, BigQuery).Scripting Languages: High proficiency in Python or Scala for writing reusable pipeline code and interacting with APIs.Data Storage: Deep familiarity with both columnar/analytical stores and NoSQL databases (e.g., DynamoDb, Cassandra).3. Pipeline Orchestration & DevOpsEnsuring pipelines run smoothly, idempotently, and securely in production.Workflow Orchestration: Ability to architect Directed Acyclic Graphs (DAGs) in tools like Apache Airflow or Prefect.CI/CD & Infrastructure as Code (IaC): Applying software engineering principles to data by using Docker, Kubernetes, and Terraform.Data Governance & Security: Implementing Role-Based Access Control (RBAC), data masking, and compliance frameworks.4. Leadership & Soft SkillsTech leads also mentor junior engineers, estimate project timelines, and translate ambiguous business needs into concrete technical specifications.Mentorship & Code Review: Fostering a collaborative development environment and enforcing style guidelines.System Observability: Building logging, monitoring, and alerting mechanisms so the team knows exactly when and why pipelines fail.Role Descriptions:Python| Pyspark| AWS Lambda| S3|AWS glue| Kinesis|SQL| Apache Flink| Confluent Kafka| Java is optionalEssential Skills: Python| Pyspark| AWS Lambda| S3|AWS glue| Kinesis|SQL| Apache Flink| Confluent Kafka| Java is optionalDesirable Skills:Keyword:Skills: Digital : Python~Digital : Amazon Web Service(AWS) Cloud Computing~Digital : Kafka~Advanced Java Concepts~Digital : PySpark","company":"Iflow","rawCompany":"iflow","city":"Malvern","state":"PA","isRemote":false,"isActive":false,"createdAt":"2026-09-19T13:06:22.081Z","occupations":[{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"},{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"518210","title":"Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services","slug":"computing-infrastructure-providers-data-processing-web-hosting-and-related-services"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Data Engineer","description":"Job Title: Data EngineerLocation: Malvern, PADuration:6 MonthsExperience Required: 10 & AboveJob Description:Technical skill sets :Python, Pyspark, AWS Lambda, S3,AWS glue, Kinesis,SQL, Apache Flink, Confluent Kafka, AI-LLM, Gen-AI , Java is optionalResponsibilities :1. Advanced Architecture & System DesignA Tech Lead is primarily responsible for the overall platform vision and ensuring systems do not break under scale.Distributed Computing: Mastery of frameworks like Apache Spark or Ray for massive-scale parallel data processing.Streaming & Event-Driven Architecture: Deep understanding of real-time pipeline design using Kafka, Kinesis, or Flink.Cloud Infrastructure: Expertise in at least one major public cloud (AWS), specifically understanding storage/compute decoupling and cost optimization.2. Core Programming & Database ManagementLeads set coding standards and review code, requiring complete fluency in the fundamentals.SQL: Advanced mastery for metrics computation, window functions, and query performance tuning across relational and columnar databases (e.g., Snowflake, Redshift, BigQuery).Scripting Languages: High proficiency in Python or Scala for writing reusable pipeline code and interacting with APIs.Data Storage: Deep familiarity with both columnar/analytical stores and NoSQL databases (e.g., DynamoDb, Cassandra).3. Pipeline Orchestration & DevOpsEnsuring pipelines run smoothly, idempotently, and securely in production.Workflow Orchestration: Ability to architect Directed Acyclic Graphs (DAGs) in tools like Apache Airflow or Prefect.CI/CD & Infrastructure as Code (IaC): Applying software engineering principles to data by using Docker, Kubernetes, and Terraform.Data Governance & Security: Implementing Role-Based Access Control (RBAC), data masking, and compliance frameworks.4. Leadership & Soft SkillsTech leads also mentor junior engineers, estimate project timelines, and translate ambiguous business needs into concrete technical specifications.Mentorship & Code Review: Fostering a collaborative development environment and enforcing style guidelines.System Observability: Building logging, monitoring, and alerting mechanisms so the team knows exactly when and why pipelines fail.Role Descriptions:Python| Pyspark| AWS Lambda| S3|AWS glue| Kinesis|SQL| Apache Flink| Confluent Kafka| Java is optionalEssential Skills: Python| Pyspark| AWS Lambda| S3|AWS glue| Kinesis|SQL| Apache Flink| Confluent Kafka| Java is optionalDesirable Skills:Keyword:Skills: Digital : Python~Digital : Amazon Web Service(AWS) Cloud Computing~Digital : Kafka~Advanced Java Concepts~Digital : PySpark","datePosted":"2026-09-19T13:06:22.081Z","dateModified":"2026-09-19T13:06:22.081Z","hiringOrganization":{"@type":"Organization","name":"Iflow","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Malvern","addressRegion":"PA","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"eb58ed25876e1b277972ecbf"},"url":"https://jobsearcher.com/jobs/eb58ed25876e1b277972ecbf"}}