Senior Data Engineer - Big Data
Description:
Seeking Senior Data Engineer - Big Data to join our Information Technology team in Irving. This full-time, on-site position offers an exciting opportunity to architect and build large-scale data solutions that power critical business insights and drive innovation across our technology platforms.
As a Senior Data Engineer specializing in Big Data, you will be responsible for designing, developing, and maintaining robust data pipelines and infrastructure that handle massive volumes of data. You will work closely with data scientists, analysts, and engineering teams to deliver scalable solutions that align with our clients' strategic objectives and industry best practices.
Banking Industry or Financial Industry preferred.
Responsibilities:
Design and implement scalable big data pipelines and architectures
Develop and maintain ETL processes for large-scale data integration
Optimize data storage and retrieval performance across distributed systems
Collaborate with data scientists and analysts to support data-driven initiatives
Build and manage data warehousing solutions and data lakes
Ensure data quality, integrity, and security across all platforms
Monitor and troubleshoot data pipeline performance and reliability
Implement best practices for data governance and compliance
Mentor junior engineers and share technical expertise
Stay current with emerging big data technologies and trends
Participate in code reviews and technical architecture discussions
Document data engineering processes and system designs
Requirements:
Bachelor's degree in Computer Science, Engineering, or related field
5+ years of experience in data engineering or related roles
Proficiency in big data technologies such as Hadoop, Spark, and Kafka
Strong experience with SQL and NoSQL databases
Experience with cloud platforms and distributed computing
Proficiency in programming languages such as Python, Java, or Scala
Strong understanding of data modeling and warehouse design principles
Excellent problem-solving and analytical skills
Strong communication and collaboration abilities
Experience with agile development methodologies