Data Engineer
Job Title: Data Engineer
Location: Columbia, SC Fully Remote
Duration: 12 Months (Extension Possible)
Interview: 1 Round – Virtual/Online
Required Skills
Education:
Bachelor's or Master's degree in Computer Science or a related field.4+ years of experience as a Data Engineer or in a similar role, leading technologists to manage, anticipate, and resolve complex technical challenges.4+ years of hands-on experience in system design, application development, and operational stability.4+ years of expertise in architecture disciplines and programming languages.4+ years of experience in data architecture, data modeling, data integration, cloud data services, domain-driven data design, and data engineering best practices.4+ years of advanced experience in data engineering disciplines such as ETL/ELT and event processing.4+ years of proficiency in SQL, data warehousing solutions, and cloud-native relational databases such as Snowflake, Amazon Athena, and PostgreSQL.4+ years of practical experience with AWS/Azure cloud services and data engineering technologies.
Preferred Skills:
4+ years of experience in business architecture, including knowledge and practical experience with architecture assessment frameworks.
Key Responsibilities:
Represent the Data Operations Hub team in technical discussions and provide guidance on enterprise data solutions.
Design, develop, and maintain scalable data architectures, including data lakes and data warehouses.
Build and enhance data pipelines, data integration processes, and reusable data engineering frameworks.
Collaborate with cross-functional teams to ensure data solutions align with business requirements and enterprise architecture goals.
Evaluate emerging data technologies and recommend solutions supporting future-state architecture.
Develop architectural models using Sparkx or other available data modeling tools.
Work with modern data processing technologies, including Python, Java, Apache Airflow, data mesh, and data lake architectures.
Perform hands-on coding, application development, and technical design to implement production-ready solutions.
Optimize data processing and application performance by identifying and resolving inefficiencies.
Provide technical leadership and serve as a subject matter expert in data engineering and architecture.
Promote data engineering best practices, reusable frameworks, and enterprise data standards.
Additional SkillsStrong analytical, problem-solving, communication, and interpersonal skills.
Ability to evaluate and recommend technologies for future-state enterprise architecture.
Experience collaborating with technical and business stakeholders.