From af3b835118f2ec32b0d8a21028ee6b53ba9e4751 Mon Sep 17 00:00:00 2001 From: Kurian Benoy Date: Mon, 18 Mar 2024 13:58:06 +0530 Subject: [PATCH] Update lwai_march_3rdweek.qmd --- posts/2024/lwai_march_3rdweek.qmd | 58 ++++++++++++++++++++++++++++++- 1 file changed, 57 insertions(+), 1 deletion(-) diff --git a/posts/2024/lwai_march_3rdweek.qmd b/posts/2024/lwai_march_3rdweek.qmd index 1d8e1b9e..2263382c 100644 --- a/posts/2024/lwai_march_3rdweek.qmd +++ b/posts/2024/lwai_march_3rdweek.qmd @@ -7,5 +7,61 @@ draft: true --- Hello everyone, this is Kurian posting about some interesting things which happend in the AI world in last week. -Do checkout this weeks news and if you find it interesting do let me know. +Do checkout this weeks news and if you find it interesting do let me know via comments or if we ever meet IRL. + +🗓️ Monday: + +1. Netflix cautions against blindly using cosine similarity as a measure of semantic similarity between learned embeddings, as it can yield arbitrary and meaningless results. + +[Paper Link:](https://arxiv.org/abs/2403.05440) + +[Tweet Link:](https://twitter.com/_reachsumit/status/1767045820384477575) + + +2. Some interesting thoughts by [Peter Gostev](https://www.linkedin.com/in/peter-gostev/) on how LLMs are a lot more cheaper than previous tradional NLP techniques. + +[LinkedIn Post Link](https://www.linkedin.com/posts/peter-gostev_it-is-interesting-to-reflect-how-much-llms-activity-7172001358806405122-S6mj/?utm_source=share&utm_medium=member_desktop) + +3. Researchers have introduced a ‘Mind Wipe’ technique for erasing hazardous knowledge from AI systems, ensuring functionality remains while enhancing safety. Alongside, the Weapons of Mass Destruction Proxy (#WMDP) benchmark, with 4,157 questions targeting biosecurity, cybersecurity, and chemical security, has been made public. + +[Tweet Link:](https://twitter.com/pandeyparul/status/1767190910906057157) + +[Blog Link:](https://www.wmdp.ai/) + +[Paper Link:](https://arxiv.org/abs/2403.03218) + +[Github Link:](https://github.com/centerforaisafety/wmdp) + +🗓️ Tuesday: + +1. Infrastructure details for training llama3 models by facebook has been released. + +[Blog Link:](https://engineering.fb.com/2024/03/12/data-center-engineering/building-metas-genai-infrastructure/) + +[Tweet Link:](https://twitter.com/soumithchintala/status/1767579981419315400) + +2. OpenAI team released something open-source in a while. Transformer Debugger(TDB) is a tool developed by OpenAI's Superalignment team with the goal of supporting investigations into specific behaviors of small language models. + +[Tweet Link:](https://twitter.com/janleike/status/1767347608065106387) + +[Github Repo Link:](https://github.com/openai/transformer-debugger) + +[LinkedIn Post:](https://www.linkedin.com/posts/kurianbenoy_transformer-debugger-tdb-is-a-tool-developed-activity-7173231708165619712-hiZ1?utm_source=share&utm_medium=member_desktop) + +3. Devin AI, the first AI software engineer was really the news of this week. Let's even cover reaction of this news separately. + +[Tweet Link:](https://twitter.com/cognition_labs/status/1767548763134964000) + +[Blog Link:](https://www.cognition-labs.com/introducing-devin) + +4. code2prompt, a CLI tool to convert your codebase into a single LLM prompt with source tree, prompt templating, and token counting was released as open-source software with MIT License by [Mufeed V H](https://twitter.com/mufeedvh) + +[Tweet Link:](https://twitter.com/mufeedvh/status/1767529667496427601) + +[Github Link:](https://github.com/mufeedvh/code2prompt) + +5. [Santhosh Thottingal](https://thottingal.in/) gave a fabulous talk on AI and making it work in my mother tongue Malayalam. The youtube video was published on this day while it was actually delivered in a National Seminar organized by the Tirur regional centre of Sree Sankaracharya University of Sanskrit on January 6, 2024. + +[Video Link:](https://www.youtube.com/watch?v=aE7o62zS_eI) +