Research Article
[Retracted] Analysis of Application Data Mining to Capture Consumer Review Data on Booking Websites
Algorithm 1
Web Crawling Algorithm [
43].
(1) | Take the input as IURL from the user | (2) | Process (URL) | | { Get the main URL in lower case | | if the web page exists | | apply timestamp | | else display error message and | | exit } Initialize the queues “todo” = URL and done’ | | initialize n = 1; Extract links(todo[k]) { | | While(todo ! empty) do If the page has frames then { For(i = 1 to no.of frames) do | | Extract links(URLi) } If the page has forms then Omit them | | Else { While(!EOF URL) do { Parse the document for anchor tags <a> Get the | | child URL – CURL If the domains of the URL and CURL are equal | | Then Enter CURL in to “todo” queue | | Else Extract links(todo[++k]) } } Enter the url in to “done” queue and increment n } | | Initialize the array select[n]6. Display the web graph | | selection() { For (all web graph nodes) do { If (web graph node is selected) | | Select[i] = 1 Else Select[i] = 0 } } download(select[n]) | | { For(i = 1 to n) If select[i] = 1 then Save done[i] in temp folder } | | Update (URLs) Exit |
|