Data Engineer
Key ResponsibilitiesDesign, develop, and maintain scalable ETL/ELT pipelines for structured and unstructured data.Build and optimize data warehouses, data lakes, and cloud-based data platforms.Develop data architectures that support AI, machine learning, and advanced analytics use cases.Collaborate with Data Scientists, AI Engineers, and business stakeholders to understand data requirements.Create and maintain data ingestion frameworks from multiple sources including APIs, databases, cloud storage, and third-party systems.Ensure data quality, integrity, security, and governance across platforms.Monitor and optimize data pipeline performance, reliability, and scalability.Support AI model training and deployment by preparing and managing large datasets.Implement automation and orchestration workflows using modern data engineering tools.Build and maintain metadata management, data cataloging, and monitoring solutions.Troubleshoot production data issues and implement preventive solutions.Stay updated with emerging AI technologies, data engineering trends, and industry best practices.Design, develop, and maintain scalable ETL/ELT pipelines for structured and unstructured data.Build and optimize data warehouses, data lakes, and cloud-based data platforms.Develop data architectures that support AI, machine learning, and advanced analytics use cases.Collaborate with Data Scientists, AI Engineers, and business stakeholders to understand data requirements.Create and maintain data ingestion frameworks from multiple sources including APIs, databases, cloud storage, andthird-party systems.Ensure data quality, integrity, security, and governance across platforms.Monitor and optimize data pipeline performance, reliability, and scalability.Support AI model training and deployment by preparing and managing large datasets.Implement automation and orchestration workflows using modern data engineering tools.Build and maintain metadata management, data cataloging, and monitoring solutions.Troubleshoot production data issues and implement preventive solutions.Stay updated with emerging AI technologies, data engineering trends, and industry best practices.Required QualificationsBachelor's degree in Computer Science, Data Engineering, Information Systems, or a related field.5+ years of professional experience in Data Engineering.Strong experience with Python and SQL.Experience building and maintaining ETL/ELT pipelines.Hands-on experience with cloud platforms such as AWS, Azure, or Google Cloud Platform.Strong knowledge of data warehousing concepts and modern data architectures.Experience working with large-scale datasets and distributed processing frameworks.Strong understanding of database technologies including SQL and NoSQL databases.Experience with workflow orchestration tools such as Airflow, Prefect, or similar platforms.Knowledge of version control systems such as Git.Excellent problem-solving and analytical skills.Preferred QualificationsExperience with Spark, Databricks, Kafka, or Snowflake.Experience supporting MLOps and AI deployment workflows.Knowledge of containerization technologies such as Docker and Kubernetes.Experience with real-time streaming data pipelines.Relevant cloud certifications or data engineering certifications.Exposure to Generative AI, LLM applications, and AI agent frameworks