Designing Web Crawler Based on Multi-threaded Approach For Authentication of Web Links on Internet

Vayadande, Kuldeep; Shaikh, Rahebar; Narnaware, Tejas; Rothe, Suraj; Bhavar, Neha; Deshmukh, Saurav

doi:10.1109/iceca55336.2022.10009614

Cited by 7 publications

(3 citation statements)

References 15 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Multithreaded Server: A server with multiple threads is referred to as a Multithreaded Server (Vayadande et al, 2022). When a client sends a request, a thread is created which allows the user to interact with the server.…”

Section: Multithreaded Serversmentioning

confidence: 99%

“…It is not difficult to find that data requested by users is highly repetitive, which will lead to a large amount of redundant data transmission. In recent years, the caching problem has attracted the attention of researchers as a method to solve the delay problem (Vayadande et al, 2022). Cache is a new strategy to improve the performance and the service quality of mobile edge networks.…”

Section: Related Workmentioning

confidence: 99%

See 1 more Smart Citation

Analysis of Multi-Threading and Cache Memory Latency Masking on Processor Performance Using Thread Synchronization Technique

Ehis

2023

Braz. J. of Sci.

View full text Add to dashboard Cite

Multithreading is a process in which a single processor executes multiple threads concurrently. This enables the processor to divide tasks into separate threads and run them simultaneously, thereby increasing the utilization of available system resources and enhancing performance. When multiple threads share an object and one or more of them modify it, unpredictable outcomes may occur. Threads that exhibit poor locality of memory reference, such as database applications, often experience delays while waiting for a response from the memory hierarchy. This observation suggests how to better manage pipeline contention. To assess the impact of memory latency on processor performance, a dual-core MT machine with four thread contexts per core is utilized. These specific benchmarks are chosen to allow the workload to include programs with both favorable and unfavorable cache locality. To eliminate the issue of wasting the wake-up signals, this work proposes an approach that involves storing all the wake-up calls. It asserts the wake-up calls to the consumer and the producer can store the wake-up call in a variable. An assigned value in working system (or kernel) storage that each process can check is a semaphore. Semaphore is a variable that reads, and update operations automatically in bit mode. It cannot be actualized in client mode since a race condition may persistently develop when two or more processors endeavor to induce to the variable at the same time. This study includes code to measure the time taken to execute both functions and plot the graph. It should be noted that sending multiple requests to a website simultaneously could trigger a flag, ultimately blocking access to the data. This necessitates some computation on the collected statistics. The execution time is reduced to one third when using threads compared to executing the functions sequentially. This exemplifies the power of multithreading.

show abstract

Section: Multithreaded Serversmentioning

confidence: 99%

Section: Related Workmentioning

confidence: 99%

Analysis of Multi-Threading and Cache Memory Latency Masking on Processor Performance Using Thread Synchronization Technique

Ehis

2023

Braz. J. of Sci.

View full text Add to dashboard Cite

show abstract

“…The application of this technology is not limited to obtaining information, but also provides students with unique opportunities to process and analyze large-scale data through automation. So that they can better deal with complex problems in the real world and achieve more significant achievements in the field of artificial intelligence [6][7][8][9] .…”

Section: Introductionmentioning

confidence: 99%

Transformation of Scientific Research Projects into Teaching Content for Artificial Intelligence Majors in “Web Crawler” Unit

Sun,

Chen

2024

Advances in Intelligent Systems Research

View full text Add to dashboard Cite

Cultivating advanced specialized talents and promoting scientific and technological development are important functions of higher education, and the two complement each other and have unity. This paper practices the teaching concept of research feedback, integrating teacher research and teaching, and using project-based teaching methods to cultivate applied undergraduate talents. We organize the course content of "Python Programming" according to the training needs of artificial intelligence majors. This paper introduces the teaching design of the unit "web crawler". Through teaching practice, we have realized that integrating scientific research into teaching can improve teaching quality and better cultivate high-quality talents.

show abstract

UNFAZEDROADS: Pothole Management System

Vayadande,

Kothari,

Yargop

et al. 2024

Innovations in Sustainable Technologies and Computing

View full text Add to dashboard Cite

Designing Web Crawler Based on Multi-threaded Approach For Authentication of Web Links on Internet

Cited by 7 publications

References 15 publications

Analysis of Multi-Threading and Cache Memory Latency Masking on Processor Performance Using Thread Synchronization Technique

Analysis of Multi-Threading and Cache Memory Latency Masking on Processor Performance Using Thread Synchronization Technique

Transformation of Scientific Research Projects into Teaching Content for Artificial Intelligence Majors in “Web Crawler” Unit

UNFAZEDROADS: Pothole Management System

Contact Info

Product

Resources

About