WebRobot: web robotic process automation using interactive programming-by-demonstration

Rui, Dong,; Huang, Zhicheng; Lam, Ian Iong; Chen, Yan; Wang, Xinyu

doi:10.1145/3519939.3523711

Cited by 12 publications

(1 citation statement)

References 35 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Prior work has explored using PBD for creating web scraping scripts. Rousillon [32] and WebRobot [33] can synthesize nested loop-based scraping logic from user demonstrations by leveraging patterns in the DOM [9]. Our work similarly leverages patterns in the DOM, but we focus on generating parameterized programs that use user-provided parameters.…”

Section: Programming By Demonstrationmentioning

confidence: 99%

ParamMacros: Creating UI Automation Leveraging End-User Natural Language Parameterization

Krosnick

Oney

2022

2022 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC)

View full text Add to dashboard Cite

Prior work in programming-by-demonstration (PBD) has explored ways to enable end-users to create custom automation without needing to write code. We propose a new end-user specification model -asking the end-user to explicitly identify parts of their natural language query that can be generalized. We built a PBD system, ParamMacros, where users first generalize a concrete natural language question -identifying parameters and their possible values -and then create a demonstration of how to answer the question on the website of interest. ParamMacros then infers a generalized program by using the user-provided parameter values to identify relevant patterns in the website's structure. In a lab study we found that participants were able to meaningfully parameterize natural language queries and felt such a parameterization and demonstration process would be useful for creating custom automation.

show abstract

Section: Programming By Demonstrationmentioning

confidence: 99%