Improving Deep Learning For Airbnb Search

Haldar, Malay; Abdool, Mustafa; Ramanathan, P.; Sax, Tyler; Zhang, Lanbo; Mansawala, Aamir; Yang, Shulin; Turnbull, Bradley; Liao, Junshuo

doi:10.48550/arxiv.2002.05515

2020

DOI: 10.48550/arxiv.2002.05515

|View full text |Cite

Preprint

Improving Deep Learning For Airbnb Search

Malay Haldar¹,

Mustafa Abdool²,

P. Ramanathan³

et al.

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...

Citation Types

Supporting

Mentioning

Contrasting

Year Published

2021

Publication Types

Select...

Other1

Relationship

Self Cite0

Independent1

Authors

Journals

Cited by 1 publication

References 10 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

Pre-trained Language Model for Web-scale Retrieval in Baidu Search

Liu¹,

Huang²,

Liu³

et al. 2021

Preprint

View full text Add to dashboard Cite

Retrieval is a crucial stage in web search that identifies a small set of query-relevant candidates from a billion-scale corpus. Discovering more semantically-related candidates in the retrieval stage is very promising to expose more high-quality results to the end users. However, it still remains non-trivial challenges of building and deploying effective retrieval models for semantic matching in real search engine. In this paper, we describe the retrieval system that we developed and deployed in Baidu Search. The system exploits the recent state-of-the-art Chinese pretrained language model, namely Enhanced Representation through kNowledge IntEgration (ERNIE), which facilitates the system with expressive semantic matching. In particular, we developed an ERNIE-based retrieval model, which is equipped with 1) expressive Transformer-based semantic encoders, and 2) a comprehensive multi-stage training paradigm. More importantly, we present a practical system workflow for deploying the model in web-scale retrieval. Eventually, the system is fully deployed into production, where rigorous offline and online experiments were conducted. The results show that the system can perform high-quality candidate retrieval, especially for those tail queries with uncommon demands. Overall, the new retrieval system facilitated by pretrained language model (i.e., ERNIE) can largely improve the usability and applicability of our search engine.

show abstract

Pre-trained Language Model for Web-scale Retrieval in Baidu Search

Liu¹,

Huang²,

Liu³

et al. 2021

Preprint

View full text Add to dashboard Cite

show abstract

scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.

Contact Info

customersupport@researchsolutions.com

10624 S. Eastern Ave., Ste. A-614

Henderson, NV 89052, USA

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Blog Terms and Conditions API Terms Privacy Policy Contact Cookie Preferences Do Not Sell or Share My Personal Information

Made with 💙 for researchers

Part of the Research Solutions Family.

Improving Deep Learning For Airbnb Search

Cited by 1 publication

References 10 publications

Pre-trained Language Model for Web-scale Retrieval in Baidu Search

Pre-trained Language Model for Web-scale Retrieval in Baidu Search

Contact Info

Product

Resources

About