A curated list for vision-and-language navigation. ACL 2022 paper "Vision-and-Language Navigation: A Survey of Tasks, Methods, and Future Directions"
-
Updated
May 2, 2024
#
vision-and-language-navigation
Here are 22 public repositories matching this topic...
A curated list of research papers in Vision-Language Navigation (VLN)
computer-vision awesome-list arxiv papers natural-language-understanding vision-and-language vision-and-language-navigation
-
Updated
Apr 17, 2024
Code of the CVPR 2021 Oral paper: A Recurrent Vision-and-Language BERT for Navigation
transformer bert vision-and-language pre-trained-model vision-and-language-navigation cvpr-oral cvpr2021
-
Updated
Aug 13, 2022 - Python
Code and Data of the CVPR 2022 paper: Bridging the Gap Between Learning in Discrete and Continuous Environments for Vision-and-Language Navigation
computer-vision deep-learning visual-navigation vision-and-language vision-and-language-navigation embodied-ai cvpr2022
-
Updated
Oct 31, 2023 - Python
Pytorch code for ICRA'21 paper: "Hierarchical Cross-Modal Agent for Robotics Vision-and-Language Navigation"
python language deep-neural-networks computer-vision deep-learning robotics navigation transformers pytorch artificial-intelligence supervised-learning bert vision-and-language vision-and-language-navigation habitat-api habitat-sim
-
Updated
Jun 27, 2024 - Python
Repository for Vision-and-Language Navigation via Causal Learning (Accepted by CVPR 2024)
-
Updated
Dec 4, 2024 - Python
Code of the NeurIPS 2021 paper: Language and Visual Entity Relationship Graph for Agent Navigation
-
Updated
Oct 31, 2021 - Python
Code and data of the Fine-Grained R2R Dataset proposed in the EMNLP 2021 paper Sub-Instruction Aware Vision-and-Language Navigation
-
Updated
Oct 26, 2021 - Python
Fast-Slow Test-time Adaptation for Online Vision-and-Language Navigation
-
Updated
Oct 15, 2024 - Python
Planning as In-Painting: A Diffusion-Based Embodied Task Planning Framework for Environments under Uncertainty
-
Updated
Dec 11, 2023 - Python
Code for ORAR Agent for Vision and Language Navigation on Touchdown and map2seq
-
Updated
Nov 3, 2023 - Python
[AAAI-25] FLAME: Learning to Navigate with Multimodal LLM in Urban Environments (arXiv:2408.11051)
embodied-agent vision-and-language-navigation vision-language-model multimodal-large-language-models large-multimodal-models
-
Updated
Aug 21, 2024
Companion Repo for the Vision Language Modelling YouTube series - https://bit.ly/3PsbsC2 - by Prithivi Da. Open to PRs and collaborations
multimodal-interactions vision-and-language multimodal-deep-learning multimodal-representation vision-and-language-navigation vision-and-language-pre-training
-
Updated
Aug 16, 2022 - Jupyter Notebook
[ECCV 2022] Official pytorch implementation of the paper "FedVLN: Privacy-preserving Federated Vision-and-Language Navigation"
-
Updated
Oct 8, 2022 - C++
Code for 'Chasing Ghosts: Instruction Following as Bayesian State Tracking' published at NeurIPS 2019
-
Updated
Jan 10, 2020 - C++
LACMA: Language-Aligning Contrastive Learning with Meta-Actions for Embodied Instruction Following
-
Updated
Dec 3, 2023 - C
Official repository of "Mind the Error! Detection and Localization of Instruction Errors in Vision-and-Language Navigation". We present the first dataset - R2R-IE-CE - to benchmark instructions errors in VLN. We then propose a method, IEDL.
-
Updated
Aug 3, 2024 - Python
A list of research papers on knowledge-enhanced multimodal learning
knowledge-graph multi-task-learning visual-reasoning visual-dialog visual-question-answering vision-and-language multimodal-deep-learning visual-storytelling multimodal-retrieval visual-grounding visual-commonsense-reasoning vision-and-language-navigation story-visualization image-text-matching vision-language-transformer image-text-retrieval vision-and-language-pre-training conditional-image-generation knowledge-enhanced-multimodal-learning knowledge-enhanced-vision-language
-
Updated
Dec 8, 2022
Hierarchical Spatial Proximity Reasoning for Vision-and-Language Navigation
-
Updated
Mar 19, 2024 - Python
Improve this page
Add a description, image, and links to the vision-and-language-navigation topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the vision-and-language-navigation topic, visit your repo's landing page and select "manage topics."