{"schemaVersion":"jobsearcher.job.v1","id":"332fb0ba89b07e2b1e6ede1e","url":"https://jobsearcher.com/jobs/332fb0ba89b07e2b1e6ede1e","canonicalUrl":"https://jobsearcher.com/jobs/332fb0ba89b07e2b1e6ede1e","title":"Big Data Engineer","description":"Mid-Level Big Data EngineerThe Big Data Engineers on AWS will be responsible for analyzing requirements, prototyping data analysis solutions (primarily in Hive, Hadoop, python), collecting, preparing data for modeling and productionizing the data preparation pipelines on AWS. Candidates need to have strong capabilities in large data warehouses using relational and/or Hadoop based systems, UNIX scripting, as well as a database skills (Postgres). The complexity driving this project is the domain understanding and volume of financial data in the petabytes of disparate data sets on an integrated platform providing interactive analytics to the users.\r\nRequired Skills and Responsibilities:\r\nData Analysis and data profiling. Understand logical, physical and conceptual data models.\r\nExcellent understanding of concepts and hands-on experience on Big Data platforms, Hadoop, Hive, Spark on AWS\r\nMust have extensive experience with data preparation pipeline implementations, data storage and distribution on AWS with a security mindset\r\nOptimization and tuning of data structures and queries on Big Data platforms on AWS\r\nA compelling track record of building large scale systems utilizing Big Data Technologies\r\nStrong Programming experience Python and/or Java or Scala and building user defined functions\r\nExperience with Data Analytics tools like Databricks/Dataiku/Domino for data wrangling to ideate analytics\r\nUnix / Shell scripting, strong SQL, including analytic functions.\r\nAWS RDS Postgres database SQL skills\r\nExperience with AWS Devops functionality with security mindset: Jenkins, Console, Services, Roles, Security groups, AMI refreshes etc.","company":"Software Technology","rawCompany":"software technology","city":"Derwood","state":"MD","isRemote":false,"isActive":false,"createdAt":"2026-08-09T01:25:04.980Z","occupations":[{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-2051.00","title":"Data Scientists","slug":"data-scientists"},{"code":"15-1243.00","title":"Database Architects","slug":"database-architects"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"518210","title":"Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services","slug":"computing-infrastructure-providers-data-processing-web-hosting-and-related-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Big Data Engineer","description":"Mid-Level Big Data EngineerThe Big Data Engineers on AWS will be responsible for analyzing requirements, prototyping data analysis solutions (primarily in Hive, Hadoop, python), collecting, preparing data for modeling and productionizing the data preparation pipelines on AWS. Candidates need to have strong capabilities in large data warehouses using relational and/or Hadoop based systems, UNIX scripting, as well as a database skills (Postgres). The complexity driving this project is the domain understanding and volume of financial data in the petabytes of disparate data sets on an integrated platform providing interactive analytics to the users.\r\nRequired Skills and Responsibilities:\r\nData Analysis and data profiling. Understand logical, physical and conceptual data models.\r\nExcellent understanding of concepts and hands-on experience on Big Data platforms, Hadoop, Hive, Spark on AWS\r\nMust have extensive experience with data preparation pipeline implementations, data storage and distribution on AWS with a security mindset\r\nOptimization and tuning of data structures and queries on Big Data platforms on AWS\r\nA compelling track record of building large scale systems utilizing Big Data Technologies\r\nStrong Programming experience Python and/or Java or Scala and building user defined functions\r\nExperience with Data Analytics tools like Databricks/Dataiku/Domino for data wrangling to ideate analytics\r\nUnix / Shell scripting, strong SQL, including analytic functions.\r\nAWS RDS Postgres database SQL skills\r\nExperience with AWS Devops functionality with security mindset: Jenkins, Console, Services, Roles, Security groups, AMI refreshes etc.","datePosted":"2026-08-09T01:25:04.980Z","dateModified":"2026-08-09T01:25:04.980Z","hiringOrganization":{"@type":"Organization","name":"Software Technology","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Derwood","addressRegion":"MD","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"332fb0ba89b07e2b1e6ede1e"},"url":"https://jobsearcher.com/jobs/332fb0ba89b07e2b1e6ede1e"}}