AI_Observability_and_Evaluation

AI Observability and Evaluation

1. Arize Phoenix --> https://docs.arize.com/phoenix
2. Comet --> OPIK
3. Langchain ---> Langsmith

Evaluation Frameworks

1. https://github.com/Vvkmnn/awesome-ai-eval?tab=readme-ov-file
2. https://substack.com/home/post/p-177866676
3. https://boringbot.substack.com/p/beyond-sounds-good-a-practical-guide
4. https://github.com/aishwaryanr/awesome-generative-ai-guide/blob/main/free_courses/ai_evals_for_everyone/README.md

Other project reference

1. https://github.com/anjijava16/AI_Agent-_Evaluation_Databricks/tree/develop