IT Applications Solution Architect Sr (Sr Data Engineer)

SUMMARY OF DUTIES• Design, develop, and maintain scalable ETL data pipelines for batch and streaming data, handling both structured and unstructured formats effectively.• Utilize advanced analytics tools and methodologies to supplement and enhance the analytics platform, contributing to our journey towards advanced analytical capabilities.• Collaborate with business and technical teams to gather requirements and design comprehensive data solutions that align with organizational goals and DT strategies.• Implement complex data operations using Python, Java, Spark, and SQL, optimizing ETL/ELT processes for performance and efficiency across diverse data types.• Manage data across various platforms, leveraging cloud services, big data technologiesMINIMUM QUALIFICATIONS• 6+ years of ETL and data ingestion from relational and non-relational databases• 2+ years of sourcing data from ERP systems or Software as a Service applications• 2+ years’ experience working in Transportation or rail industry• 2+ years experience in data modeling• 2+ years experience in providing L3 support for data pipelinesMINIMUM KNOWLEDGE, SKILLS AND ABILITIES• SQL, Python, ETLCOMMUNICATIONS AND INTERPERONAL SKILLS:• Must have excellent oral and written communication and presentation skills.