{"schemaVersion":"jobsearcher.job.v1","id":"0e09e5335f376be5d09166ba","url":"https://jobsearcher.com/jobs/0e09e5335f376be5d09166ba","canonicalUrl":"https://jobsearcher.com/jobs/0e09e5335f376be5d09166ba","title":"Sr. Data Engineer","description":"Job Description:\nThe Senior Data Engineer with expertise in Azure Synapse Analytics and Microsoft Fabric will design, develop, and implement scalable data solutions to support analytics and reporting needs.\nThe role involves creating, optimizing, and managing data pipelines to efficiently move and transform data across the Azure ecosystem.\nThe candidate will be responsible for setting up and managing data lakes to store large volumes of structured and unstructured data, ensuring high availability and security.\nThey will collaborate with cross- functional teams to gather data requirements and create efficient, scalable architectures.\nStrong experience in ETL development, data modeling, and cloud technologies like Azure Data Factory, Azure Data Lake, and Synapse Analytics is essential.\nThe candidate will also ensure data quality, security, and compliance with governance standards.\nDuties / Responsibilities:\n1. Create and optimize complex data pipelines using Azure Data Factory, Synapse Analytics, and other Azure tools to extract, transform, and load data efficiently.\n2. Implement and maintain Azure Data Lake solutions to store large volumes of structured and unstructured data, ensuring scalability, performance, and security.\n3. Integrate data from various sources, including relational databases, NoSQL databases, APIs, and flat files, into the Azure environment for analysis and reporting.\n4. Design and develop robust data architectures, optimizing for performance and scalability in Azure Synapse Analytics and Azure Data Lake environments.\n5. Develop efficient ETL/ELT processes using Azure Data Factory or other Azure tools to ensure timely and accurate data loading and transformation.\n6. Ensure data pipelines run smoothly by monitoring, troubleshooting, and resolving issues to minimize downtime and data inconsistencies.\n7. Continuously optimize data pipelines and query performance, especially within Azure Synapse to handle large data sets and complex transformations efficiently.\n8. Work closely with data scientists, analysts, and business teams to understand data requirements and deliver scalable data solutions that support analytics needs.\n9. Implement and enforce security best practices, ensuring data lakes, pipelines, and analytics solutions comply with Azure security standards and data governance policies.\n10. Design and implement logical and physical data models that support high performance querying and reporting within Azure Synapse.\n11. Implement data quality checks, data validation processes, and error handling within data pipelines to ensure accuracy and consistency of data.\n12. Ensure adherence to data governance frameworks, managing data lineage, metadata, and ensuring compliance with organizational and regulatory requirements.\n13. Implement data partitioning and indexing strategies to improve query performance within data lakes and Synapse.\n14. Automate data ingestion, transformation, and processing tasks to ensure efficient and scalable data workflows within the Azure environment.\n15. Create and maintain detailed documentation for data architectures, pipelines, processes, and data models, ensuring transparency and ease of maintenance.\n16. Provide technical guidance and mentorship to junior data engineers, sharing best practices and ensuring adherence to high-quality engineering standards.\n17. Monitor resource utilization in Azure environments, planning for future data growth and ensuring efficient use of cloud resources.\n18. Strong knowledge of Medallion architecture.\n19. Experience in setting up parquet and delta file structures.\n20. Experience in working with non-structured data sources.\n21. Strong knowledge of consuming and exposing data from various data sources like XML, JSON etc.\n22. Continuously stay informed on the latest features and best practices in Azure Synapse Analytics, Microsoft Fabric, and the Azure ecosystem, implementing improvements as needed.\n23. Strong knowledge of python for creating and scheduling data pipelines.\n24. Implement real-time data ingestion and processing pipelines using technologies like Azure Stream Analytics, Event Hubs.\n25. Design and implement a data mesh architecture to support decentralized data ownership and self-service data infrastructure, ensuring scalable and flexible data management across the organization.\n26. Architect and manage multi-cloud data solutions, integrating data across different cloud platforms (e.g., AWS, OCI) with Azure Synapse for a unified data and analytics ecosystem.\n27. Design and manage hybrid data architectures that integrate on- premises data centers with Azure cloud environments, ensuring seamless data movement and synchronization between cloud and on-prem systems.\n28. Utilize advanced data cataloging tools such as Azure Purview to create an enterprise-wide data catalog, enabling efficient data discovery and usage across various teams.\n29. Create and automate end-to-end machine learning pipelines that integrate data ingestion, feature engineering, model training, and deployment using Azure ML, Python (scikit-learn, TensorFlow, PyTorch), and Azure Synapse Analytics.\n30. Utilize Python-based data augmentation techniques or synthetic data generation (e.g., GANs or SMOTE) to enrich datasets for machine learning training, especially in cases where data is limited or imbalanced.\nPreferred Experience/Qualification/Knowledge Skills:\nEducation: Bachelor’s Degree in Information Systems, Computer Science, or related scientific or technical field and three (5) years minimum of relevant experience.\nGeneral Experience: Work Experience: 5+ years of experience designing and implementing data solutions and creating data pipelines at enterprise-level applications.\nIndustry Knowledge: Preferred to have experience in water and wastewater industry understanding of oracle utility applications.\nProject Experience: Demonstrated experience working on large-scale data projects in diverse team environments with a focus on analytics, business intelligence, and enterprise systems.\nSpecialized Experience: Data Modeling: Extensive experience with data modeling and database design.\nEnterprise Analytics: Proven expertise in implementing enterprise- wide analytics and business intelligence solutions, including data integration from multiple systems into a single data repository\nSkillset: Database & Data Structures: Deep understanding of database design principles, SQL, PL/SQL, and Oracle database management systems, including performance optimization and troubleshooting.\nData Governance & Quality: Familiarity with data governance frameworks, ensuring data integrity, quality, and security within an enterprise context.\nData Lakes: Strong experience in creating data lakes and data warehouses.\nPython: Strong knowledge of writing python code to create and manage data pipelines\nCommunication & Collaboration: Excellent verbal and written communication skills, with the ability to work closely with stakeholders to translate business needs into technical solutions.\nProblem-Solving: Strong analytical skills and problem-solving abilities, especially when working with large, complex datasets.\nPlease submit your resume in word format.\nJob Type: Contract\nPay: Up to $60.00 per hour\nSchedule:\n8 hour shift\nApplication Question(s):\nPreferred to have experience in water and wastewater industry understanding of oracle utility applications.(y/n)-\nExperience:\nPython: 6 years (Required)\nDatabase & Data Structures: 6 years (Required)\ndesign, create and implement data solutions, data pipelines: 6 years (Required)\ncreating data lakes and data warehouses.: 6 years (Required)\nWork Location: Hybrid remote in Laurel, MD 20723","company":"Cilable","rawCompany":"cilable","city":"Laurel","state":"MD","isRemote":false,"isActive":false,"createdAt":"2026-08-06T12:19:18.009Z","occupations":[{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-1243.00","title":"Database Architects","slug":"database-architects"},{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Sr. Data Engineer","description":"Job Description:\nThe Senior Data Engineer with expertise in Azure Synapse Analytics and Microsoft Fabric will design, develop, and implement scalable data solutions to support analytics and reporting needs.\nThe role involves creating, optimizing, and managing data pipelines to efficiently move and transform data across the Azure ecosystem.\nThe candidate will be responsible for setting up and managing data lakes to store large volumes of structured and unstructured data, ensuring high availability and security.\nThey will collaborate with cross- functional teams to gather data requirements and create efficient, scalable architectures.\nStrong experience in ETL development, data modeling, and cloud technologies like Azure Data Factory, Azure Data Lake, and Synapse Analytics is essential.\nThe candidate will also ensure data quality, security, and compliance with governance standards.\nDuties / Responsibilities:\n1. Create and optimize complex data pipelines using Azure Data Factory, Synapse Analytics, and other Azure tools to extract, transform, and load data efficiently.\n2. Implement and maintain Azure Data Lake solutions to store large volumes of structured and unstructured data, ensuring scalability, performance, and security.\n3. Integrate data from various sources, including relational databases, NoSQL databases, APIs, and flat files, into the Azure environment for analysis and reporting.\n4. Design and develop robust data architectures, optimizing for performance and scalability in Azure Synapse Analytics and Azure Data Lake environments.\n5. Develop efficient ETL/ELT processes using Azure Data Factory or other Azure tools to ensure timely and accurate data loading and transformation.\n6. Ensure data pipelines run smoothly by monitoring, troubleshooting, and resolving issues to minimize downtime and data inconsistencies.\n7. Continuously optimize data pipelines and query performance, especially within Azure Synapse to handle large data sets and complex transformations efficiently.\n8. Work closely with data scientists, analysts, and business teams to understand data requirements and deliver scalable data solutions that support analytics needs.\n9. Implement and enforce security best practices, ensuring data lakes, pipelines, and analytics solutions comply with Azure security standards and data governance policies.\n10. Design and implement logical and physical data models that support high performance querying and reporting within Azure Synapse.\n11. Implement data quality checks, data validation processes, and error handling within data pipelines to ensure accuracy and consistency of data.\n12. Ensure adherence to data governance frameworks, managing data lineage, metadata, and ensuring compliance with organizational and regulatory requirements.\n13. Implement data partitioning and indexing strategies to improve query performance within data lakes and Synapse.\n14. Automate data ingestion, transformation, and processing tasks to ensure efficient and scalable data workflows within the Azure environment.\n15. Create and maintain detailed documentation for data architectures, pipelines, processes, and data models, ensuring transparency and ease of maintenance.\n16. Provide technical guidance and mentorship to junior data engineers, sharing best practices and ensuring adherence to high-quality engineering standards.\n17. Monitor resource utilization in Azure environments, planning for future data growth and ensuring efficient use of cloud resources.\n18. Strong knowledge of Medallion architecture.\n19. Experience in setting up parquet and delta file structures.\n20. Experience in working with non-structured data sources.\n21. Strong knowledge of consuming and exposing data from various data sources like XML, JSON etc.\n22. Continuously stay informed on the latest features and best practices in Azure Synapse Analytics, Microsoft Fabric, and the Azure ecosystem, implementing improvements as needed.\n23. Strong knowledge of python for creating and scheduling data pipelines.\n24. Implement real-time data ingestion and processing pipelines using technologies like Azure Stream Analytics, Event Hubs.\n25. Design and implement a data mesh architecture to support decentralized data ownership and self-service data infrastructure, ensuring scalable and flexible data management across the organization.\n26. Architect and manage multi-cloud data solutions, integrating data across different cloud platforms (e.g., AWS, OCI) with Azure Synapse for a unified data and analytics ecosystem.\n27. Design and manage hybrid data architectures that integrate on- premises data centers with Azure cloud environments, ensuring seamless data movement and synchronization between cloud and on-prem systems.\n28. Utilize advanced data cataloging tools such as Azure Purview to create an enterprise-wide data catalog, enabling efficient data discovery and usage across various teams.\n29. Create and automate end-to-end machine learning pipelines that integrate data ingestion, feature engineering, model training, and deployment using Azure ML, Python (scikit-learn, TensorFlow, PyTorch), and Azure Synapse Analytics.\n30. Utilize Python-based data augmentation techniques or synthetic data generation (e.g., GANs or SMOTE) to enrich datasets for machine learning training, especially in cases where data is limited or imbalanced.\nPreferred Experience/Qualification/Knowledge Skills:\nEducation: Bachelor’s Degree in Information Systems, Computer Science, or related scientific or technical field and three (5) years minimum of relevant experience.\nGeneral Experience: Work Experience: 5+ years of experience designing and implementing data solutions and creating data pipelines at enterprise-level applications.\nIndustry Knowledge: Preferred to have experience in water and wastewater industry understanding of oracle utility applications.\nProject Experience: Demonstrated experience working on large-scale data projects in diverse team environments with a focus on analytics, business intelligence, and enterprise systems.\nSpecialized Experience: Data Modeling: Extensive experience with data modeling and database design.\nEnterprise Analytics: Proven expertise in implementing enterprise- wide analytics and business intelligence solutions, including data integration from multiple systems into a single data repository\nSkillset: Database & Data Structures: Deep understanding of database design principles, SQL, PL/SQL, and Oracle database management systems, including performance optimization and troubleshooting.\nData Governance & Quality: Familiarity with data governance frameworks, ensuring data integrity, quality, and security within an enterprise context.\nData Lakes: Strong experience in creating data lakes and data warehouses.\nPython: Strong knowledge of writing python code to create and manage data pipelines\nCommunication & Collaboration: Excellent verbal and written communication skills, with the ability to work closely with stakeholders to translate business needs into technical solutions.\nProblem-Solving: Strong analytical skills and problem-solving abilities, especially when working with large, complex datasets.\nPlease submit your resume in word format.\nJob Type: Contract\nPay: Up to $60.00 per hour\nSchedule:\n8 hour shift\nApplication Question(s):\nPreferred to have experience in water and wastewater industry understanding of oracle utility applications.(y/n)-\nExperience:\nPython: 6 years (Required)\nDatabase & Data Structures: 6 years (Required)\ndesign, create and implement data solutions, data pipelines: 6 years (Required)\ncreating data lakes and data warehouses.: 6 years (Required)\nWork Location: Hybrid remote in Laurel, MD 20723","datePosted":"2026-08-06T12:19:18.009Z","dateModified":"2026-08-06T12:19:18.009Z","hiringOrganization":{"@type":"Organization","name":"Cilable","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Laurel","addressRegion":"MD","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"0e09e5335f376be5d09166ba"},"url":"https://jobsearcher.com/jobs/0e09e5335f376be5d09166ba"}}