JOBSEARCHER

Data Engineer

LanceSoftPlano, TXL6 LeadNovember 13th, 2026
We are looking for an experienced Data Engineer with strong expertise in Big Data technologies, Python, Spark, and Google Cloud Platform (GCP). The candidate will be responsible for designing, developing, and maintaining scalable data processing solutions and high-performance data architectures. The ideal candidate should have hands-on experience with Spark on GCP Dataproc, BigQuery, Hadoop, and Python, along with strong data engineering and problem-solving skills.
Key Responsibilities:
  • Design and develop scalable, high-performance data architectures and Big Data solutions.
  • Build and maintain large-scale data processing and data storage systems.
  • Develop data pipelines using Spark, PySpark, Python, and GCP Big Data services.
  • Work with large datasets and optimize data processing workflows.
  • Implement and maintain ETL processes and data integration solutions.
  • Identify and resolve performance bottlenecks in data pipelines and systems.
  • Participate in the complete Software Development Life Cycle (SDLC).Collaborate with business stakeholders, architects, developers, and cross-functional teams.
  • Provide technical guidance and mentor other developers.
  • Ensure high-quality deliverables within project timelines.
  • Required Qualifications5–7 years of experience in designing and implementing large-scale data processing and storage solutions.
  • Strong hands-on experience with Apache Spark, preferably Spark on GCP Dataproc (Mandatory).Strong programming experience in Python and PySpark.
  • Experience with Google BigQuery and other GCP Big Data services.
  • Knowledge of Hadoop ecosystem, including HDFS, MapReduce, and Hive.
  • Experience with SQL, ETL processes, and large-scale data analytics.
  • Understanding of relational databases and MPP data warehouse platforms.
  • Knowledge of real-time data processing and analytics.
  • Strong problem-solving, communication, and collaboration skills.
  • Bachelor's degree in Computer Science, Computer Engineering, or a related technical field.
  • Technical Skills
  • Mandatory Skills:
  • Apache Spark – Spark on GCP Dataproc
  • Python / PySparkGoogle BigQueryBig Data Engineering
  • Additional Skills:
  • Hadoop, HDFS, MapReduce, HiveApache AirflowGCP Big Data ServicesSQL and Shell Scripting
  • Cloud SQLETL / Data Pipelines
  • Relational Databases and Data Warehousing
Preferred Qualifications: Experience with real-time analytics and data processing. Experience designing complex data architectures. Knowledge of data management frameworks and best practices. Process certifications such as Six Sigma, CBPP, BPM, ITIL, ISO 20000, or CMMI are a plus.