Senior Data Engineer
Job Description
Job Overview:
We are seeking a skilled professional with strong expertise in SQL, Python, Spark, and leading AI/ML frameworks to design and build scalable, intelligent data solutions. The ideal candidate will have hands-on experience with big data platforms and distributed data processing.
Key Responsibilities:
" Extensive experience in SQL and databases " Develop and optimize scalable data pipelines using Apache Spark " Build and deploy AI/ML models leveraging modern frameworks " Work with large datasets using platforms like Delta Lake and other big data technologies " Manage and integrate multiple databases for efficient data processing " Collaborate with cross-functional teams to deliver data-driven solutions Required Skills: " Strong proficiency in SQL and Spark " Experience with AI/ML frameworks (e.g., TensorFlow, PyTorch, or similar) " Hands-on experience with big data platforms such as Delta Lake " Solid understanding of distributed data processing and database management