Robotics: Science and Systems XIX 2023
DOI: 10.15607/rss.2023.xix.024
|View full text |Cite
|
Sign up to set email alerts
|

Demonstrating Large Language Models on Robots

Google DeepMind

Abstract: LargeLanguage Model Policy Code block_names = detect_objects("blocks") bowl_names = detect_objects("bowls") for bowl_name in bowl_names: if is_empty(bowl_name): empty_bowl = bowl_name break objs_to_stack = [empty_bowl] + block_names stack_objects(objs_to_stack) def is_empty(name):...

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...
1
1

Citation Types

0
2
0

Year Published

2024
2024
2024
2024

Publication Types

Select...
1
1
1

Relationship

0
3

Authors

Journals

citations
Cited by 3 publications
(2 citation statements)
references
References 38 publications
0
2
0
Order By: Relevance
“…STARRED proposes a JAX implementation for the PSF reconstruction (Equation ( 7)) and deconvolution (Equation ( 11)) optimization problems. We use JAX automatic differentiation to compute the gradient of the loss function and accelerate the convergence by using a gradient-informed optimizer, such as adabelief or l-bfgs-b from the OPTAX and JAXOPT library (DeepMind et al 2020;Blondel et al 2021). STARRED supports hardware acceleration on a GPU.…”
Section: Jax Implementationmentioning
confidence: 99%
See 1 more Smart Citation
“…STARRED proposes a JAX implementation for the PSF reconstruction (Equation ( 7)) and deconvolution (Equation ( 11)) optimization problems. We use JAX automatic differentiation to compute the gradient of the loss function and accelerate the convergence by using a gradient-informed optimizer, such as adabelief or l-bfgs-b from the OPTAX and JAXOPT library (DeepMind et al 2020;Blondel et al 2021). STARRED supports hardware acceleration on a GPU.…”
Section: Jax Implementationmentioning
confidence: 99%
“…Software: STARRED (Michalewicz et al 2023), LENSTRONOMY (Birrer et al 2021), PHOTUTILS (Bradley et al 2023), PSFR (Birrer et al 2021), JAX (Bradbury et al 2018), JAXOPT (Blondel et al 2021), OPTAX (DeepMind et al 2020), ASTROPY (Astropy Collaboration et al 2022).…”
Section: Data Availabilitymentioning
confidence: 99%