v0.1.0

What's Changed

• add initial embeddings.encode_kwargs by @lucasiscovici in #371
• feat(testset_generator): support error catching in generation process by @yuukidach in #368
• added class for FastEmbed by @tinomaxthayil in #379
• Updated NLI Verdicts to Binary Format by @lucasiscovici in #384
• added docs for ragas embeddings by @tinomaxthayil in #386
• fix context in _answer_correctness.py by @lucasiscovici in #385
• docs: AI copilot implementation by @nickscamara in #294
• fix: faithfulness for evasive/reject answers by @shahules786 in #392
• Added prompt class by @tinomaxthayil in #388
• Context precision with ground truth by @shahules786 in #391
• Added note to answer_relevance by @shahules786 in #399
• Import evaluate function before patching RagasLLM, fixes #301 by @HySoaKa in #377
• Fix: Added ground_truths arg type-hint info in the eval function by @MANISH007700 in #404
• Typo and phrasing correction by @TruscaPetre in #408
• Small improvements to documentation custom LLMs by @TruscaPetre in #410
• feat(metrics): skip embedding process when the corresponding weight is zero by @yuukidach in #409
• added prompt objects to metrics by @tinomaxthayil in #401
• feat: Automatic Prompt adaptation [language] by @shahules786 in #407
• Update _faithfulness.py by @Robs1999 in #416
• fix(metrics): avoid dividing by zero in correctness by @yuukidach in #421
• Feature/doc update ragas score by @prufrock349 in #417
• Docs: Prompts and prompt adaptation by @shahules786 in #419
• fix(metrics): wrong usage of prompt by @yuukidach in #422
• fix: context_utilization name override by @jjmachan in #424
• feat/executor: make ragas faster and more robust to run by @jjmachan in #390
• fix: Import PrompValue by @shahules786 in #427
• fix: add uuid to analytics by @shahules786 in #428
• feat: added async version for json_load by @jjmachan in #430
• fix: comment error in analytics by @jjmachan in #433
• fix: payload in analytics by @shahules786 in #434
• fix: tests for analytics by @jjmachan in #435
• Docs: tracing and logging by @shahules786 in #436
• feat: global prompt adaptation by @shahules786 in #432
• chore: remove mac artifacts from store by @jjmachan in #438
• fix: vary temperature based on strictness by @shahules786 in #437
• docs: custom llms by @shahules786 in #442
• feat: improving testset generation by @jjmachan in #381
• Fix: context_recall AttributeError by @0ENZO in #453
• Update faithfulness.md by @francesco-defalco in #451
• Fixing typo in faithfulness by @jamesbraza in #450
• fix: context_recall example by @shahules786 in #458
• fix: answer relevancy parsing by @shahules786 in #461
• feat: MVP for the new TestsetGenerator - SimpleEvolution by @jjmachan in #464
• fix: clean up embeddings for ragas and add docs for azure embeddings by @jjmachan in #477
• fix: polishing raise_exception and max_workers by @jjmachan in #486
• Convert prompts in testset generation by @shahules786 in #484
• feat(testset generation): implement new TestsetGenerator by @jjmachan in #487
• doc: add community page by @shahules786 in #488
• Fix ValueError: diag requires an array of at least two dimensions #474 by @herman159 in #475
• doc: modify prompt adaptation by @shahules786 in #490
• docs: theming community by @jjmachan in #491
• fix: CP example by @shahules786 in #489
• feat(testset): ported simple, multi_context and reasoning evolutions by @jjmachan in #496
• fix: cleanup old testset generator by @jjmachan in #500
• feat: added tracking of minimal stuff in testset generation by @jjmachan in #509
• feat: added generate_from_langchain function by @jjmachan in #511
• docs: updated testset generation by @shahules786 in #510
• fix: answer_correctness embedding by @jjmachan in #513
• added docs for customisation by @tinomaxthayil in #514
• fix: added rate_limter to langchain wrapper by @jjmachan in #517
• Update testset_generation.md by @Uzarel in #516
• fix: reshape matrix by @shahules786 in #519
• fix (metrics): changed ground_truths -> ground_truth by @jjmachan in #521
• docs: fix spelling by @shahules786 in #522
• fix: removed old prompt by @shahules786 in #523
• feat(testset): added conditional evolution by @jjmachan in #524
• fix: derive answer from relevant context by @shahules786 in #525
• feat(executor): remove the need to have both sync and async versions of the function by @jjmachan in #527
• feat: seed questions using keyphrases by @shahules786 in #526
• docs: updated contributors by @jjmachan in #532
• feat: configure retries and timeouts with evaluations and testset generators by @jjmachan in #534
• Fix case for few shots of context precision metric by @HuskyDanny in #541
• Updated imports, added dotenv by @aevedis in #539
• feat(executor): run executor in different thread to keep things clean by @jjmachan in #544
• add normalization factor to answer similarity score calculation by @enestydarealmc in #538
• Feat: prompt adaptation for test data generation by @shahules786 in #530
• fix:handle non dict output by @shahules786 in #547
• docs: adaptation for test set generator by @shahules786 in #548
• Fix: ensure quality of adapted prompts by @shahules786 in #546
• fix: raise warning for invalid JSON by @shahules786 in #550
• docs: adding code highlighting by @jjmachan in #552
• fix: wrap langchain embeddings automatically by @jjmachan in #553
• Added documentation page: Using Ragas with Athina for production performance metrics by @shivsak in #558
• fix: proper error message and fixed hf embedding error by @jjmachan in #561
• fix: answer_correctness doesn't reset stuff properly by @jjmachan in #562
• docs: fix issue template by @jjmachan in #565
• docs: fix issue template by @jjmachan in #566
• fix: handle non dict cases by @shahules786 in #564
• fix wrong type annotations and nonexistent types by @stydxm in #560
• fix: raise ExceptionInRunner if executor faces any issues by @jjmachan in #569

New Contributors

• @lucasiscovici made their first contribution in #371
• @nickscamara made their first contribution in #294
• @HySoaKa made their first contribution in #377
• @TruscaPetre made their first contribution in #408
• @Robs1999 made their first contribution in #416
• @prufrock349 made their first contribution in #417
• @0ENZO made their first contribution in #453
• @francesco-defalco made their first contribution in #451
• @jamesbraza made their first contribution in #450
• @herman159 made their first contribution in #475
• @Uzarel made their first contribution in #516
• @HuskyDanny made their first contribution in #541
• @aevedis made their first contribution in #539
• @enestydarealmc made their first contribution in #538
• @shivsak made their first contribution in #558
• @stydxm made their first contribution in #560

Full Changelog: v0.0.22...v0.1.0