{"schemaVersion":"jobsearcher.job.v1","id":"8a7148f1750dfaf84331f85c","url":"https://jobsearcher.com/jobs/8a7148f1750dfaf84331f85c","canonicalUrl":"https://jobsearcher.com/jobs/8a7148f1750dfaf84331f85c","title":"Big Data Engineer","description":"Benefits:\r\nONSITE\r\nCompetitive salary\r\nOpportunity for advancementBig Data Engineer\r\nLocation: Chicago, IL (Day 1 Onsite)\r\nJob Type: Contract / Full Time\r\nExperience: 8+ yrs\r\nDuration: Long TermWe are seeking an experienced Big Data Engineer to design, develop, and optimize enterprise-scale big data solutions. The ideal candidate will have strong hands-on expertise in the Hadoop ecosystem, Spark, Scala, Hive, Apache NiFi, and Kafka, along with experience building scalable data pipelines and supporting modern CI/CD practices. Candidates should have worked directly with clients, participated in requirement gathering sessions, and delivered end-to-end Big Data implementations.Key Responsibilities\r\n* Design, develop, and optimize large-scale data processing pipelines using Spark, Scala, and Hive.\r\n* Build and maintain data ingestion workflows using Apache NiFi.\r\n* Develop and support real-time data streaming solutions using Apache Kafka.\r\n* Monitor application logs and system health using Kibana, Elasticsearch, and Logstash.\r\n* Implement and support CI/CD pipelines using Git, Jenkins, and Nexus.\r\n* Ensure data quality, integrity, and governance across Big Data platforms.\r\n* Participate in architecture discussions and recommend scalable design solutions.\r\n* Troubleshoot and resolve complex production issues across the Big Data stack.\r\n* Collaborate with cross-functional teams in an Agile environment.\r\n* Mentor junior engineers and contribute to technical best practices.Required Qualifications\r\n* 8+ years of experience in Big Data technologies.\r\n* Strong hands-on experience with Spark, Scala, Hive (HQL), and the Hadoop ecosystem.\r\n* Experience implementing Apache NiFi and Apache Kafka.\r\n* Proficiency in Shell Scripting or Python.\r\n* Experience with PostgreSQL.\r\n* Familiarity with scheduling tools such as Oozie and Control-M.\r\n* Working knowledge of Git, Jenkins, Nexus, Maven, Ansible, and SonarQube.\r\n* Strong understanding of CI/CD practices.\r\n* Experience in client-facing roles, including requirement gathering workshops.\r\n* Minimum of two end-to-end Big Data implementation projects.\r\n* Ability to work independently and contribute effectively within Agile teams.Compensation: $110,000.00 - $125,000.00 per yearAbout UsWe work to deliver profitability in your business - with effective communication, consulting, and interactive solutions. Following an Agile Work Approach, we make sure you get the ideal solutions at minimum expenses.Work ApproachOur Philosophy\r\nOur Philosophy starts-and-ends at the Client-first approach. Be it understanding your business requirements to choosing the right technologies, we work as a collective team that takes all the possible steps to grow continuously towards our common goal.Work PolicyWe promote a collaborative work environment. We involve everyone working in the organization in community decisions and encourage them to think from a broader perspective. Our work process promotes flexibility and we maintain a high level of discipline at different levels of execution.The FutureSelectMinds have years of experience in the domain helps us understand the need-of-the-hour better. This understanding drives us to a better future with every minute ticking. We believe we will be taking off major businesses from their flagship positions, with the products we are eyeing today.","company":"Selectminds","rawCompany":"selectminds","city":"East Lansing","state":"MI","isRemote":false,"isActive":false,"createdAt":"2026-08-09T01:19:17.103Z","occupations":[{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"},{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Big Data Engineer","description":"Benefits:\r\nONSITE\r\nCompetitive salary\r\nOpportunity for advancementBig Data Engineer\r\nLocation: Chicago, IL (Day 1 Onsite)\r\nJob Type: Contract / Full Time\r\nExperience: 8+ yrs\r\nDuration: Long TermWe are seeking an experienced Big Data Engineer to design, develop, and optimize enterprise-scale big data solutions. The ideal candidate will have strong hands-on expertise in the Hadoop ecosystem, Spark, Scala, Hive, Apache NiFi, and Kafka, along with experience building scalable data pipelines and supporting modern CI/CD practices. Candidates should have worked directly with clients, participated in requirement gathering sessions, and delivered end-to-end Big Data implementations.Key Responsibilities\r\n* Design, develop, and optimize large-scale data processing pipelines using Spark, Scala, and Hive.\r\n* Build and maintain data ingestion workflows using Apache NiFi.\r\n* Develop and support real-time data streaming solutions using Apache Kafka.\r\n* Monitor application logs and system health using Kibana, Elasticsearch, and Logstash.\r\n* Implement and support CI/CD pipelines using Git, Jenkins, and Nexus.\r\n* Ensure data quality, integrity, and governance across Big Data platforms.\r\n* Participate in architecture discussions and recommend scalable design solutions.\r\n* Troubleshoot and resolve complex production issues across the Big Data stack.\r\n* Collaborate with cross-functional teams in an Agile environment.\r\n* Mentor junior engineers and contribute to technical best practices.Required Qualifications\r\n* 8+ years of experience in Big Data technologies.\r\n* Strong hands-on experience with Spark, Scala, Hive (HQL), and the Hadoop ecosystem.\r\n* Experience implementing Apache NiFi and Apache Kafka.\r\n* Proficiency in Shell Scripting or Python.\r\n* Experience with PostgreSQL.\r\n* Familiarity with scheduling tools such as Oozie and Control-M.\r\n* Working knowledge of Git, Jenkins, Nexus, Maven, Ansible, and SonarQube.\r\n* Strong understanding of CI/CD practices.\r\n* Experience in client-facing roles, including requirement gathering workshops.\r\n* Minimum of two end-to-end Big Data implementation projects.\r\n* Ability to work independently and contribute effectively within Agile teams.Compensation: $110,000.00 - $125,000.00 per yearAbout UsWe work to deliver profitability in your business - with effective communication, consulting, and interactive solutions. Following an Agile Work Approach, we make sure you get the ideal solutions at minimum expenses.Work ApproachOur Philosophy\r\nOur Philosophy starts-and-ends at the Client-first approach. Be it understanding your business requirements to choosing the right technologies, we work as a collective team that takes all the possible steps to grow continuously towards our common goal.Work PolicyWe promote a collaborative work environment. We involve everyone working in the organization in community decisions and encourage them to think from a broader perspective. Our work process promotes flexibility and we maintain a high level of discipline at different levels of execution.The FutureSelectMinds have years of experience in the domain helps us understand the need-of-the-hour better. This understanding drives us to a better future with every minute ticking. We believe we will be taking off major businesses from their flagship positions, with the products we are eyeing today.","datePosted":"2026-08-09T01:19:17.103Z","dateModified":"2026-08-09T01:19:17.103Z","hiringOrganization":{"@type":"Organization","name":"Selectminds","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"East Lansing","addressRegion":"MI","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"8a7148f1750dfaf84331f85c"},"url":"https://jobsearcher.com/jobs/8a7148f1750dfaf84331f85c"}}