JOBSEARCHER

Senior Data Engineer

*Job Title: Senior Data Engineer*
Experience: 8 Years
Employment Type: Contract / W2
Location: McLean, Virginia
Duration: Contract
Job Description: We are looking for a Senior Data Engineer with 8 years of experience in designing, developing, and maintaining scalable data pipelines and data engineering solutions. The ideal candidate should have strong expertise in Python, SQL, ETL/ELT, cloud platforms, and big data technologies.
Key Responsibilities:
  • Design, develop, and maintain scalable ETL/ELT pipelines.
  • Develop data processing solutions using Python, PySpark, and SQL.
  • Build and optimize data ingestion and transformation workflows.
  • Work with large datasets, data lakes, and data warehouses.
  • Develop and optimize complex SQL queries and database operations.
  • Implement data quality checks, validation, and error-handling processes.
  • Work with cloud platforms such as AWS, Azure, or GCP.
  • Use Apache Spark and workflow orchestration tools to process and manage data pipelines.
  • Collaborate with data architects, analysts, and business teams to understand requirements.
  • Monitor pipeline performance, troubleshoot issues, and support production environments.
  • Follow best practices for data security, governance, and performance optimization.
  • Participate in code reviews, technical discussions, and Agile ceremonies.
Required Skills:
  • 8 years of experience in Data Engineering.
  • Strong proficiency in Python, SQL, and ETL/ELT processes.
  • Hands-on experience with PySpark and Apache Spark.
  • Experience with AWS, Azure, or GCP.
  • Knowledge of data warehousing and data lake architecture.
  • Experience with Snowflake, Databricks, or other modern data platforms.
  • Familiarity with Apache Airflow or similar orchestration tools.
  • Experience with relational and NoSQL databases.
  • Knowledge of Git, CI/CD, and data pipeline monitoring.
  • Strong analytical, troubleshooting, and communication skills.
Preferred Qualifications:
  • Experience with Kafka or other streaming technologies.
  • Familiarity with Delta Lake and cloud-based data architectures.
  • Experience with data modeling and data governance.
  • Experience working in Agile/Scrum environments.
Work Location: Hybrid remote in Aldie, VA 20105