v0.2.0

What's Changed

• feat: topic adherence metric by @shahules786 in #1327
• feat: tool call accuracy by @shahules786 in #1311
• feat: sql sementic equivalence by @shahules786 in #1323
• feat: Factual correctnes metric by @shahules786 in #1334
• docs: migrating over to mkdocs by @jjmachan in #1301
• feat: Adding transforms for testset generation by @jjmachan in #1344
• docs: traditional metrics by @shahules786 in #1346
• feat: transforms for Knowledge Graphs by @jjmachan in #1345
• docs: core concepts in metrics by @shahules786 in #1347
• chores: cleanup metrics by @shahules786 in #1348
• docs: refactor core concepts by @shahules786 in #1351
• wrap as_complete with async by @liupgd in #1350
• chores: add datasets to init by @shahules786 in #1356
• docs: new getting started by @shahules786 in #1355
• docs: metrics concepts by @shahules786 in #1361
• docs: add mindmap by @shahules786 in #1362
• Fixed Nav, search, and some styling issues for the docs by @joelk9895 in #1363
• feat: transform engine to execute transforms by @jjmachan in #1352
• chores: remove fuzzywuzzy by @shahules786 in #1369
• docs: component guides by @shahules786 in #1365
• chores: fix typo by @shahules786 in #1370
• fix:ensure correct sequence in tool calls by @shahules786 in #1371
• [howtos] update Langfuse cookbook by @jannikmaierhoefer in #1368
• feat: adding an implementation of abstractQA by @jjmachan in #1359
• feat: implement TestsetGenerator by @jjmachan in #1375
• docs: testset generation by @shahules786 in #1373
• feat: added more simulators by @jjmachan in #1376
• Update models in Ragas documentation: change gpt-3.5-turbo-16k to gpt-4o-mini and gpt-4 to gpt-4o by @suekou in #1380
• fix: aspect_critique documentation by @jjmachan in #1382
• docs: added google analytics to mkdocs by @jjmachan in #1384
• docs: fix index for metric/index.md by @jjmachan in #1388
• fix: fixed verdict comparison in evolutions.py by @MarkHmnv in #1366
• feat: output new Testset object for generation by @jjmachan in #1386
• Update answer_relevance.md: Minor spell correct by @soumendrak in #1390
• feat: support for callbacks and traces in testset generation by @jjmachan in #1392
• non-asii characters support in faithfulness by @gargewp in #1396
• feat: get and set prompts mixin by @shahules786 in #1391
• fixes: rename naming in testset generation by @shahules786 in #1393
• chore!: moving to pydantic2 by @jjmachan in #1394
• docs: improve getting started by @shahules786 in #1398
• Fix typo in metric error message by @suekou in #1404
• feat!: moving experimental.testset to replace old testset by @jjmachan in #1401
• feat: renamed sample operations and cleaned up test warnings by @jjmachan in #1407
• added better styling to reder jupyter notebooks nicely. by @zodwick in #1389
• docs: add core concepts for test generation by @shahules786 in #1402
• docs:Auto Gen of Reference Page by @zodwick in #1408
• fix key error for FaithfulnesswithHHEM by @linzzzzzz in #1410
• fix: remove usage of contexts in response relevancy by @shahules786 in #1409
• fix: score for jupyter by @shahules786 in #1411
• feat: NER extractor and Jaccard by @shahules786 in #1406
• feat(styles): refactor CSS to use custom variables by @zodwick in #1413
• docs : add customisation by @shahules786 in #1412
• feat(docs): add support for reusable snippets by @zodwick in #1414
• Feature/css variables by @zodwick in #1415
• docs: fix nav bar by @shahules786 in #1416
• feat: more features to prompt object by @jjmachan in #1418
• chore: add tracking for new testset generation by @jjmachan in #1419
• feat: adapt prompt to different languages by @jjmachan in #1429
• chores: add reference to gitignore by @shahules786 in #1428
• docs: redo intro by @shahules786 in #1427
• Add Custom Ragas Light and Dark Themes (v1) by @zodwick in #1431
• fix attribute error for faithfulness metric by @linzzzzzz in #1436
• docs: language adaptation by @shahules786 in #1446
• fix: data export by @shahules786 in #1461
• feat: save and load Prompts by @jjmachan in #1458
• refactor: convert faithfulness, answer_correctness and noise_sensitivity to new prompt object by @jjmachan in #1462
• Minor typo in _answer_relevance.py by @pjanowski in #1452
• feat: added repr for prompt objects by @jjmachan in #1459
• feat: change context recall and precision prompts to new by @jjmachan in #1467
• docs: fix invalid links and imports by @shahules786 in #1473
• feat: changed summary to new prompt by @jjmachan in #1469
• docs: redo readme by @shahules786 in #1480
• docs: new build process with rtd and API documentation by @jjmachan in #1474
• chore: added install for mkdocs insiders by @jjmachan in #1481
• chores: update gitignore by @shahules786 in #1483
• docs: improve testgen namings by @shahules786 in #1489
• Fixed an issue where non-ASCII characters were changed to Unicode characters within the prompt by @Youngrok123 in #1490
• docs: fix search by @shahules786 in #1491
• feat: added save and load to RagasDataset by @jjmachan in #1492
• docs: moved from ipnb files to md files by @jjmachan in #1482
• feat: set ensure_ascii to false by @jjmachan in #1494
• feat: small refactors and cleanups by @jjmachan in #1493

New Contributors

• @liupgd made their first contribution in #1350
• @joelk9895 made their first contribution in #1363
• @jannikmaierhoefer made their first contribution in #1368
• @suekou made their first contribution in #1380
• @MarkHmnv made their first contribution in #1366
• @soumendrak made their first contribution in #1390
• @gargewp made their first contribution in #1396
• @zodwick made their first contribution in #1389
• @linzzzzzz made their first contribution in #1410
• @pjanowski made their first contribution in #1452
• @Youngrok123 made their first contribution in #1490

Full Changelog: v0.1.20...v0.2.0