{"schemaVersion":"jobsearcher.job.v1","id":"383877d582b420a2ed7f607e","url":"https://jobsearcher.com/jobs/383877d582b420a2ed7f607e","canonicalUrl":"https://jobsearcher.com/jobs/383877d582b420a2ed7f607e","title":"Sr AWS Data Engineer (with ETL, Python, AWS Glue, Lambda, Node.js & Microservices exp)","description":"Title: Sr AWS Engineer / Sr AWS Data Engineer (with ETL, Python, AWS Glue, Lambda, Node.js & Microservices exp)Location: Malvern, PA (Onsite)Job Type: ContractDescriptionWe are looking for a Senior AWS Engineer to extend our event-driven, serverless financial platform.The platform combines Python-based AWS Glue ETL pipelines with Node.js Lambda microservices.A candidate who has built both Python Glue pipelines and Node.js Lambda services in the same production environment would be the strongest fit.Must Have SkillsAWS Glue ETL Microservices - Nodejs or PythonDeployment pipeline - Jenkins, Cloud formation, SAMETL - Glue Job, Step FunctionsAPI Gateway - Lamda / DynamoDBResponsibilitiesDesign, build, and maintain independently deployable microservices (single-purpose AWS Lambda functions) within an event-driven architectureDevelop and maintain Node.js (ES6+/async-await) Lambda microservices for file intake, validation, transformation, submission and acknowledgement handling of transaction files (JSON, XLSX, CSV)Build event-driven Node.js services triggered by S3 event notifications, EventBridge, SQS and API Gateway, with clear contracts between servicesUse the AWS SDK for Node.js (v3 preferred) to integrate with core AWS services such as S3, DynamoDB, SNS/SES, Secrets Manager and Step Functions.Manage dependencies, Lambda layers, bundling and cold start/memory/timeout tuning for Node.js functionsDefine clean service boundaries and contracts (event payloads, schemas, S3 formats) enabling independent development and deploymentMaintain and extend AWS Glue ETL jobs (PySpark + native Oracle JDBC) that ingest, transform, and reconcile daily transaction history and position snapshot filesBuild and troubleshoot Step Functions workflows (ASL state machines) orchestrating multi-stage pipelines: file validation, ingestion, reconciliation, alertingDesign and maintain Lambda functions (Python and Node.js) for lightweight orchestration, file validation, DynamoDB writes, and SNS/SES alertingWrite and optimize Oracle SQL (native JDBC and Lambda-proxied) against a complex financial schemaManage DynamoDB data models for transaction history, reconciliation status, and fund-level summaries, including GSIs and TTL-based retentionImplement robust error handling and transactional integrity (per-record commit/rollback, idempotency, duplicate-detection) for financial data where silent failures are unacceptableApply retries, dead-letter queues and idempotency keys (for example, a file ID checked with DynamoDB conditional writes) so S3 events delivered more than once never cause duplicate processingOwn unit, integration, and smoke test suites (pytest/unittest, Jest/Mocha, moto and aws-sdk-client-mock for AWS mocking) and maintain/improve code coverageSupport CI/CD pipelines (Jenkins, AWS SAM/CloudFormation), including build, test, lint and packaging of Node.js servicesBuild and maintain observability: structured CloudWatch logging/metrics, Grafana dashboards, and metric registries for pipeline healthParticipate in security reviews (SOC2-aligned findings, SQL injection guards, least-privilege IAM, KMS encryption) and remediate findings, including Node.js dependency vulnerability management (npm audit)Produce and maintain technical documentation (architecture references, runbooks, deployment guides, changelogs)Required Skills & ExperiencePython (3.12+) strong proficiency, including testable, well-structured ETL codeNode.js (current LTS) has strong proficiency, including ES6+, async/await, and JavaScript or TypeScript for AWS Lambda microservicesExperience designing and operating microservices architectures: single-purpose services, loose coupling, independent deployment, event contracts and idempotencyAWS Glue (PySpark, Glue 4.0, DynamicFrames) and AWS Lambda (Python and Node.js runtimes)AWS Step Functions (Amazon States Language) for workflow orchestrationAWS SAM / CloudFormation infrastructure as code, multi-environment deploymentOracle SQL complex joins, DML across transactional schemas, stored procedure like code patternsDynamoDB key design, GSIs, conditional writes, paginationS3 - event-driven architectures (EventBridge notifications), data lake patterns (Parquet)Strong testing discipline: pytest/unittest, Jest/Mocha, mocking AWS services (moto, aws-sdk-client-mock), stubbing Spark/Glue runtime dependencies for offline unit testsExperience with financial/transactional data where correctness, auditability, and idempotency are criticalCI/CD experience, ideally Jenkins, with multi-environment promotion gatesFamiliarity with CloudWatch metrics/logs, Grafana, and building operational dashboards.","company":"Saransh","rawCompany":"saransh","city":"Malvern","state":"PA","isRemote":false,"isActive":false,"createdAt":"2026-11-17T11:29:16.383Z","occupations":[{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"},{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"},{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"518210","title":"Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services","slug":"computing-infrastructure-providers-data-processing-web-hosting-and-related-services"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Sr AWS Data Engineer (with ETL, Python, AWS Glue, Lambda, Node.js & Microservices exp)","description":"Title: Sr AWS Engineer / Sr AWS Data Engineer (with ETL, Python, AWS Glue, Lambda, Node.js & Microservices exp)Location: Malvern, PA (Onsite)Job Type: ContractDescriptionWe are looking for a Senior AWS Engineer to extend our event-driven, serverless financial platform.The platform combines Python-based AWS Glue ETL pipelines with Node.js Lambda microservices.A candidate who has built both Python Glue pipelines and Node.js Lambda services in the same production environment would be the strongest fit.Must Have SkillsAWS Glue ETL Microservices - Nodejs or PythonDeployment pipeline - Jenkins, Cloud formation, SAMETL - Glue Job, Step FunctionsAPI Gateway - Lamda / DynamoDBResponsibilitiesDesign, build, and maintain independently deployable microservices (single-purpose AWS Lambda functions) within an event-driven architectureDevelop and maintain Node.js (ES6+/async-await) Lambda microservices for file intake, validation, transformation, submission and acknowledgement handling of transaction files (JSON, XLSX, CSV)Build event-driven Node.js services triggered by S3 event notifications, EventBridge, SQS and API Gateway, with clear contracts between servicesUse the AWS SDK for Node.js (v3 preferred) to integrate with core AWS services such as S3, DynamoDB, SNS/SES, Secrets Manager and Step Functions.Manage dependencies, Lambda layers, bundling and cold start/memory/timeout tuning for Node.js functionsDefine clean service boundaries and contracts (event payloads, schemas, S3 formats) enabling independent development and deploymentMaintain and extend AWS Glue ETL jobs (PySpark + native Oracle JDBC) that ingest, transform, and reconcile daily transaction history and position snapshot filesBuild and troubleshoot Step Functions workflows (ASL state machines) orchestrating multi-stage pipelines: file validation, ingestion, reconciliation, alertingDesign and maintain Lambda functions (Python and Node.js) for lightweight orchestration, file validation, DynamoDB writes, and SNS/SES alertingWrite and optimize Oracle SQL (native JDBC and Lambda-proxied) against a complex financial schemaManage DynamoDB data models for transaction history, reconciliation status, and fund-level summaries, including GSIs and TTL-based retentionImplement robust error handling and transactional integrity (per-record commit/rollback, idempotency, duplicate-detection) for financial data where silent failures are unacceptableApply retries, dead-letter queues and idempotency keys (for example, a file ID checked with DynamoDB conditional writes) so S3 events delivered more than once never cause duplicate processingOwn unit, integration, and smoke test suites (pytest/unittest, Jest/Mocha, moto and aws-sdk-client-mock for AWS mocking) and maintain/improve code coverageSupport CI/CD pipelines (Jenkins, AWS SAM/CloudFormation), including build, test, lint and packaging of Node.js servicesBuild and maintain observability: structured CloudWatch logging/metrics, Grafana dashboards, and metric registries for pipeline healthParticipate in security reviews (SOC2-aligned findings, SQL injection guards, least-privilege IAM, KMS encryption) and remediate findings, including Node.js dependency vulnerability management (npm audit)Produce and maintain technical documentation (architecture references, runbooks, deployment guides, changelogs)Required Skills & ExperiencePython (3.12+) strong proficiency, including testable, well-structured ETL codeNode.js (current LTS) has strong proficiency, including ES6+, async/await, and JavaScript or TypeScript for AWS Lambda microservicesExperience designing and operating microservices architectures: single-purpose services, loose coupling, independent deployment, event contracts and idempotencyAWS Glue (PySpark, Glue 4.0, DynamicFrames) and AWS Lambda (Python and Node.js runtimes)AWS Step Functions (Amazon States Language) for workflow orchestrationAWS SAM / CloudFormation infrastructure as code, multi-environment deploymentOracle SQL complex joins, DML across transactional schemas, stored procedure like code patternsDynamoDB key design, GSIs, conditional writes, paginationS3 - event-driven architectures (EventBridge notifications), data lake patterns (Parquet)Strong testing discipline: pytest/unittest, Jest/Mocha, mocking AWS services (moto, aws-sdk-client-mock), stubbing Spark/Glue runtime dependencies for offline unit testsExperience with financial/transactional data where correctness, auditability, and idempotency are criticalCI/CD experience, ideally Jenkins, with multi-environment promotion gatesFamiliarity with CloudWatch metrics/logs, Grafana, and building operational dashboards.","datePosted":"2026-11-17T11:29:16.383Z","dateModified":"2026-11-17T11:29:16.383Z","hiringOrganization":{"@type":"Organization","name":"Saransh","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Malvern","addressRegion":"PA","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"383877d582b420a2ed7f607e"},"url":"https://jobsearcher.com/jobs/383877d582b420a2ed7f607e"}}