{"schemaVersion":"jobsearcher.job.v1","id":"46a97150b28dfbdbb54796f4","url":"https://jobsearcher.com/jobs/46a97150b28dfbdbb54796f4","canonicalUrl":"https://jobsearcher.com/jobs/46a97150b28dfbdbb54796f4","title":"Python / PySpark Data Engineer","description":"Qualifications10+ years hands-on Python development experience for big data application.Extensive working experience in implementing scalable and efficient data processing pipelines using big data technologies, such as Hadoop/EMR, Spark, Hive.Strong development experience in AWS platforms/services such as Lambda, Eventbridge, Step Functions, Redshift, S3, Glue.Extensive hands-on development experience in making API calls, SQL queries, data manipulation/transformation, analysis and visualization.Strong experience in data analysis/mining, hands-on experience on analyzing large datasets and extracting meaningful insights.Solid understanding and hand-on implementation experience in CI/CD pipeline. Familiar with tools such as Gitlab/Terraform.Critical thinking and strong analytical skills to drive solutions, alternative plans, and conclusionsCollaborates effectively and forms positive partnerships with team members in groups and levels across a matrixed organizationPossess strong analytical and problem-solving skills SkillsRequired 10+ years of Python development experience for big data applicationRequired 5+ years of development experience in AWS platforms/services such as EMR, Lambda, Eventbridge, Step Functions, Redshift, S3, GlueRequired 5+ years of development experience in making API calls, SQL queries, Spark, data manipulation/transformation, analysis and visualizationHands on experience with CI/CD pipeline tools such as Gitlab/Terraform","company":"Hadiamondstar Software Solutions","rawCompany":"hadiamondstar software solutions","city":"Reston","state":"VA","isRemote":false,"isActive":false,"createdAt":"2026-07-18T12:46:42.652Z","occupations":[{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"},{"code":"15-2051.00","title":"Data Scientists","slug":"data-scientists"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"518210","title":"Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services","slug":"computing-infrastructure-providers-data-processing-web-hosting-and-related-services"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Python / PySpark Data Engineer","description":"Qualifications10+ years hands-on Python development experience for big data application.Extensive working experience in implementing scalable and efficient data processing pipelines using big data technologies, such as Hadoop/EMR, Spark, Hive.Strong development experience in AWS platforms/services such as Lambda, Eventbridge, Step Functions, Redshift, S3, Glue.Extensive hands-on development experience in making API calls, SQL queries, data manipulation/transformation, analysis and visualization.Strong experience in data analysis/mining, hands-on experience on analyzing large datasets and extracting meaningful insights.Solid understanding and hand-on implementation experience in CI/CD pipeline. Familiar with tools such as Gitlab/Terraform.Critical thinking and strong analytical skills to drive solutions, alternative plans, and conclusionsCollaborates effectively and forms positive partnerships with team members in groups and levels across a matrixed organizationPossess strong analytical and problem-solving skills SkillsRequired 10+ years of Python development experience for big data applicationRequired 5+ years of development experience in AWS platforms/services such as EMR, Lambda, Eventbridge, Step Functions, Redshift, S3, GlueRequired 5+ years of development experience in making API calls, SQL queries, Spark, data manipulation/transformation, analysis and visualizationHands on experience with CI/CD pipeline tools such as Gitlab/Terraform","datePosted":"2026-07-18T12:46:42.652Z","dateModified":"2026-07-18T12:46:42.652Z","hiringOrganization":{"@type":"Organization","name":"Hadiamondstar Software Solutions","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Reston","addressRegion":"VA","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"46a97150b28dfbdbb54796f4"},"url":"https://jobsearcher.com/jobs/46a97150b28dfbdbb54796f4"}}