Data Engineer
Job Title: Data Engineer
Skills:
Azure Data Platform, Databricks, Data Lake, Python, SQL, and Data Pipeline development.
Experience: 8+ years
Location: Dallas, TXWe at Coforge are hiring a Data Engineer with the following skillset:
Key Responsibilities:
We are seeking an experienced Data Engineer with strong expertise in Azure Data Platform, Databricks, Data Lake, Python, SQL, and Data Pipeline development. The ideal candidate will be responsible for designing, building, and optimizing scalable data solutions that support analytics, reporting, and business intelligence initiatives. The candidate should have hands-on experience in modern cloud-based data engineering and big data technologies. Design, develop, and maintain scalable data pipelines for data ingestion, transformation, and processing. Build and optimize data solutions using Azure Data Factory (ADF), Azure Databricks, and Azure Data Lake Storage (ADLS).Develop ETL/ELT workflows to process large volumes of structured and unstructured data. Write efficient and optimized code using Python and SQL for data transformation and integration. Implement data models and ensure data quality, integrity, and governance standards. Collaborate with business stakeholders, architects, data analysts, and data scientists to understand data requirements. Monitor, troubleshoot, and enhance the performance of data pipelines and cloud data platforms. Implement best practices for security, scalability, reliability, and automation within the Azure ecosystem. Support data migration and modernization initiatives from on-premises to cloud platforms.
Required Skills:
10 years of experience in Data Engineering.
Strong hands-on experience with Microsoft Azure data services.
Expertise in Azure Databricks and Apache Spark-based processing.
Experience with Azure Data Lake Storage (ADLS).Proficiency in Python and SQL.Experience building and maintaining complex ETL/ELT data pipelines.
Strong understanding of data warehousing concepts and dimensional modeling.
Experience with data integration, transformation, and orchestration tools.
Knowledge of data quality, governance, and performance optimization techniques.