[Retracted] Advertising Popularity Feature Collaborative Recommendation Algorithm Based on Attention-LSTM Model

Su, Yang; Kong, Xiangwei; Liu, Guobao

doi:https://doi.org/10.1155/2021/9940232

Security and Communication Networks

On this page

Abstract Introduction Related Work Experimental Results and Analysis Conclusions Data Availability Disclosure Conflicts of Interest References Copyright Related Articles

Research Article Retraction

!

This article has been Retracted. To view the article details, please click the ‘Retraction’ tab above.

Special Issue

Massive Machine-Type Communications for Internet of Things

View this Special Issue

Research Article | Open Access

Volume 2021 | Article ID 9940232 | https://doi.org/10.1155/2021/9940232

[Retracted] Advertising Popularity Feature Collaborative Recommendation Algorithm Based on Attention-LSTM Model

Yang Su,¹Xiangwei Kong,²and Guobao Liu³

Academic Editor: Jian Su

Received28 Sept 2021

Revised11 Nov 2021

Accepted06 Dec 2021

Published18 Dec 2021

Abstract

To accurately predict the click-through rate (CTR) and use it for ad recommendation, we propose a deep attention AD popularity prediction model (DAFCT) based on label recommendation technology and collaborative filtering method, which integrates content features and temporal information. First, we construct an Attention-LSTM model to capture the popularity trends and exploit the temporal information based on users’ feedback; finally, we use the concatenate method to fuse temporal information and content features and design a Deep Attention Popularity Prediction (DAVPP) algorithm to solve DAFCT. We experimentally adjust the weighted composite similarity metric parameters of Query pages and verify the scalability of the algorithm. Experimental results on the KDDCUP2012 dataset show that this model collaborative filtering and recommendation algorithm has better scalability and better recommendation quality. Compared with the Attention-LSTM model and the NFM model, the F1 score of DAFCT is improved by 9.80 and 3.07 percentage points, respectively.

1. Introduction

At present, global Internet advertising has a scale of hundreds of billions of dollars, and search advertising has become an important form of online advertising [1]. The advertising industry has gradually developed from targeted delivery, where the value of ad delivery can be precisely measured, with a user-friendly and advertiser-beneficial advertising market [2]. Search engine revenue (Revenue Per Search, RPS) is one of the important evaluation indicators of the success of the search advertising recommendation system, which can be reflected by the pricing method of search advertising (such as CPC, Cost Per Click) and the ability of ads to attract users to click (Click-ThroughRate, CTR); that is, RPS = CTR × CPC [3]. Therefore, it is important to predict CTR accurately and use it reasonably for ad recommendation.

Predicting the popularity of ads in advance is an important part of many applications, such as recommendations, advertising, and information retrieval [4, 5]. By observing a large number of user feedback behaviors on YouTube and sites, we found that the popularity of some ads tends to increase after user feedback for a period of time after they are posted. To capture the dynamic change process of ad popularity, this paper first uses Recurrent Neural Network (RNN) to model and calculate the trend index of ads, and discretion the amount of likes and stomps of ads to transform the popularity prediction task into a classification problem; the popularity of ads is classified into “popular,” the popularity of advertisements is classified into “popular” and “unpopular” categories, and the content features of advertisements are modeled using a neural network model; finally, the popularity of advertisements and content features are fused to predict the popularity of advertisements [6].

The macroscopic accumulation process based on the amount of user feedback to predict popularity has great practical value, and Long Short-Term Memory (LSTM) networks can effectively capture the change process of events [7], which is widely used in stock trend prediction [8], temperature change trend prediction [9], and depression trend prediction in medical research [10], and so on. LSTM networks can effectively capture the popularity trends of advertisements, and researchers have used LSTM networks to model and predict the popularity dynamics of advertisements and achieved good results [11]. Inspired by these research works, this paper adopts LSTM networks to model the popularity trends of advertisements and capture the trends of the popularity of advertisements.

Social tagging is a representation of collective intelligence in the Web 2.0 era, which is a bridge between users and resources. Tagging system has been widely used not only in the fields of music, movies, and books [12] but also in advertising recommendation. At present, the tag ad recommendation method mainly obtains its recommendation rules by analyzing the relationship between tags (AD keywords), users, and resources (ads) [13]. For example, [14] proposes an improved FolkRank ad recommendation method, which iteratively computes to the user, resource, and tag tried to find the recommendation tags, where resources correspond to ads in the ad recommendation system and tags correspond to ad keywords. Agarwal et al. [15] analyze the similarity of users’ behavioral trajectories in different time gaps and uses the similarity between time gaps as the weight value to collaboratively recommend the ads viewed by users in different time gaps. Therefore, how to reasonably find the combination of tag recommendation technology and collaborative filtering technology and fully explore the relationship between ad keywords, Query pages, and ads is one of the keys to improve the quality of ad recommendation.

A comprehensive analysis of the existing research results shows that the dynamic change process of popularity is difficult to capture, but the content features of advertisements have a great influence on the performance of popularity prediction models. At present, there are few research works that combine the change process of popularity and content features modeling. LSTM networks are efficient to be applied to model the dynamic change process of popularity [16] and can effectively capture the change trend of popularity. The deep learning-based model of NFM, for example, effectively combines linear second-order feature interactions and nonlinear higher-order feature interactions and has excellent model representation and generalization capabilities but cannot capture the trend of popularity changes of advertisements. In this paper, we propose DAFCT, which combines content features and temporal information of advertisements, has excellent feature representation and generalization ability and can capture the popularity trends of advertisements.

The contributions of this paper are as follows: CTR and make rational use of it for advertising recommendation. Based on label recommendation technology and collaborative filtering method, DAFCT integrating content features and timing information is proposed. We use concatenate method to integrate temporal information and content features, and design a deep attention popularity prediction algorithm to solve DAFCT. The experimental results on KDDCUP2012 dataset demonstrate that the proposed model has better scalability and better recommendation quality.

Attention-based LSTM networks reduce the reliance on external information [17] and have been widely used in text classification, sentiment analysis, and click-through rate prediction. He et al. [18] proposed a Deep Temporal Context Network to predict the popularity of posts by modeling the dynamic change process of the popularity of face book tweets, and the prediction results showed that the model has significant ability to predict the long-term popularity dynamics. Chen et al. [19] modeled the popularity of citations by introducing attention into the LSTM network to predict the popularity of citations with an accuracy of 85% on the computer science citation dataset. Lynch et al. [20] constructed time series information by analyzing feedback events such as Fork and Star of projects on Github, and used LSTM to model the time series information on Github and predict the popularity trend. Gao et al. [21] analyzed the number of macro events such as clicks, views, retreats, and likes of online articles and introduced the attention mechanism into the LSTM network to model the change process of WeChat articles over time to predict the popularity trend and further integrated the content features, so as to predict the popularity of WeChat articles.

Deep learning-based popularity prediction models have been a hot research topic in academia and industry since 2016, and the Deep Neural Network (DNN) model proposed by [22], which is modeled based on content features such as image pixels and image descriptions, was initially applied to advertising click-through rate prediction and later widely used in popularity prediction studies. To improve the prediction performance, [23] improved the deep learning model and proposed a Neural Collaborative Filtering (NCF) model based on the neural network and experimentally verified that the prediction accuracy of NCF model reached 87.30%.

Recently, deep learning-based models have been applied to user preference prediction [24], app popularity prediction [8], and movie popularity prediction [9]. Some of the deep learning models mainly analyze the effect of content features on prediction performance [25], while another part of more novel research work focuses on the performance of classification models [11], where one of the more famous deep learning-based classification models is the Neural Factorization Machine (NFM) [26], which has a better performance than traditional the more famous deep learning-based classification model is NFM, which has better feature representation than the traditional deep neural network models. Ma et al. [27] proposed a collaborative filtering ad recommendation algorithm without location bias, which takes into account the influence of ad position on CTR and uses the relevance of page and ad instead of user’s rating of the product.

The aforementioned research results only modeled based on the content characteristics of individual items, ignoring the influence of popularity trends on the performance of the popularity prediction model.

3. Proposed Model

3.1. Attention-LSTM Model

In this paper, we use LSTM network to capture the trend of advertisement popularity and introduce the attention mechanism into LSTM network to reduce the interference of external factors, and construct the Attention-LSTM model based on the attention mechanism. To more graphically characterize the growth trend of popularity, this paper uses OA⁃L to represent the trend index of ad popularity, which is calculated by the Attention-LSTM model, and the Attention-LSTM model is shown in Figure 1. By analyzing the feedback information of users’ likes, views, comments, etc., given the time interval t, the amount of user feedback over time is constructed as a time series , and then the feedback series is obtained, and the calculation formula of LSTM network is rewritten aswhere: , , and are the input gate, forgetting gate, and output gate at a given time interval t, respectively; is the hidden output at t − 1; is the input at t − 1; is the cell state at t − 1; and s is the sigmoid activation function.

The computation process of the Attention-LSTM model is as follows：

Given a certain time interval t, the n hidden layer outputs are denoted as

These hidden layer outputs after the softmax layer to obtain the attention weights:

Record the attention weight as :

Then the Attention-LSTM model outputs the popular trend at this time:

From the above calculation, the value of OA⁃L is a number less than 1, which characterizes the trend index of a certain advertisement, and then the popularity of the advertisement is calculated by combining it with the prediction results of the NFM model. From the experimental results, the Attention-LSTM model can effectively capture the popularity trend of advertisements, and it is very helpful to improve the performance of the popularity prediction model [28].

3.2. NFM Model

The content of ads, including ad types and numerical information, usually provides useful information for popularity prediction and is one of the key factors affecting the popularity of ads. For different types of advertisements, different users have different preferences, and their feedback performance is very different [19, 29]. In this paper, we adopt NFM model to model the content features of advertisements; first, we use one-hot coding technique to convert the type features into one-hot vectors, then we input the one-hot vectors of ad types into the embedding layer of NFM model, and then the ad type features and numerical features are combined by a second-order feature interaction pool layer, which is input into the hidden layer to obtain the content features of advertisements. The NFM model combines linear second-order feature interactions and nonlinear higher-order feature interactions to learn features from sparse data, which effectively improve the feature representation capability. Figure 2 shows the NFM model for content feature learning, which includes three layers: input layer, embedding layer, and memory layer. The specific description is as follows. We describe each of its components in the form of data.

For example, given the set of ad types as , for the i (i = 1, 2,...,k) ad mi types, the one-hot feature vector x of the ad types is dimensioned down using the embedding technique to obtain the embedding vector representation of the video types:where is the embedding vector for the i-th ad type, is the one-hot vector for the i-th ad type.

Input the embedding vector to the second-order interaction layer:where means , the second-order interaction layer is a pooling operation that converts the embedding matrix of text features into a vector. The output of the second-order interaction layer is input to the hidden layer and is computed aswhere σ, , and are the sigmoid function, the weight matrix, and bias vector of the hidden layer, respectively, and L is the number of layers of the hidden layer [30].

The output of the NFM model is obtained by feeding the output of the hidden layer to the fully connected layer:where is the linear part of the NFM model, is the initialized weight, represents the weight of the i-th feature, and is the nonlinear part, i.e., DNN, q is the weight matrix of the output layer.

3.3. DAFCT

The temporal information in the process of popularity change is difficult to capture, while the content features of ads largely determine the popularity of ads, which are an essential condition for the popularity prediction task [31]. In this paper, DAFCT first adopts RNN to mine the temporal information to capture the popularity trend of advertisements and introduces the attention mechanism to eliminate the interference of external factors; then adopts deep neural network to process the content features, and adopts embedding technique to reduce the computational complexity of the model for sparse and high-dimensional features; finally, the concatenate method is used to combine the temporal information and content features.

Given n ads, denote the popularity of the ad by and denote all n popularity as P:

Equation (11) is the linking probability of the ad, which is the popularity of the ad. Combining the popularity trend of the Attention-LSTM model and the output of the NFM model, a fully connected layer calculateswhere OA⁃L is the popularity trend index of the advertisement, and ONFM is the prediction result of the NFM model. After substitution into equation (12), we get the prevalence:

3.4. Collaborative Filtering Ad Recommendation Algorithm

Based on the model design, the collaborative filtering and recommendation algorithms in this paper is described in Algorithm 1.

	Input: Target Query page (i = 1, 2, ..., m), Query page set Q(\|Q \| = r), ad keyword set K (\|K\| = n), ad set A, CTR set C, number of neighbors N.
Output the best recommended ad set for the target Query page A
Step 1	For each Query page in the set, 1 ≤ j ≤ Q, j ≠ 1, the loop performs the following operations.
Step 2	Calculate the co-hit similarity between Query pages .
Step 3	Calculate the similarity of co-labeling between Query pages .
Step 4	Calculate the similarity of co-contained relationships between Query pages .
Step 5	Calculate the combined similarity between Query pages .
Step 6	Sort the remaining objects in the set, except the target Query page , from largest to smallest, according to .
Step 7	select the top n query pages in the set as the nearest neighborhood of the target query page .
Step 8	Select the top N ads with the highest predicted click-through rate in the set A’ as the TOP-N best recommended ad set A. The key time overhead of the ADR-CF_T algorithm is the similarity calculation between Query pages, and the time overhead for calculating the co-hit similarity SimQA between Query pages is the same as the traditional CF algorithm [32].

4. Experimental Results and Analysis

In this paper, the training dataset of track in KDDCUP2012 [33] is selected as the experimental data. This data provides the search advertisement click data of Tencent Soso, with a total size of 10.6 GB and 149,639,105 data. In this paper, the five attributes of data attributes, namely, Click, Impression, AdID, QueryID, and QueryID, are selected as the experiments of the search ad recommendation system. Impression, AdID, QueryID, KeywordID.

4.1. Data Preprocessing

In this paper, we first randomly sampled the original data and selected 1,000,000 pieces of data; according to the data requirements of this experiment, we deleted 7 other attribute columns and got 641,566 pieces of data after removing duplicate items. To avoid the serious data sparsity problem, we select the Query pages and advertisements with at least 30 clock records, leaving 19,436 data, including 10,936 Query pages, 8,789 advertisements, and 10,439 advertising keywords. In each Query page, 80% of the ads are randomly selected as the training set, and the remaining data are used as the test set.

4.2. Evaluation Metrics

Since the Top-N recommendation approach is adopted, Precision, Recall, and F-measure calculated for different number of neighbors are used to evaluate the quality of the search ad recommendation system in this paper. They define as following [11, 13, 14], respectively.

4.3. Analysis of Results

4.3.1. Parameter Adjustment

In the collaborative filtering ad recommendation algorithm with labels, the key similarity calculation method is to weight the co-hit similarity, co-matched label similarity, and co-contained relationship similarity among Query pages to make the similarity calculation more accurate. In this paper, we select 10%, 20%, and 30% data sets for experiments, respectively, and observe the changes of MAE (α, β) by taking values of α and ß iteratively, and weigh the weight of each similarity measure. Considering α + β + γ = 1, only α and ß are taken as dependent variables, and the experimental results are shown in Figures 3–5.

Figures 3–5, we can see that the variation of α and ß can affect the prediction accuracy of the ad recommendation algorithm, and the performance of the proposed collaborative filtering ad recommendation algorithm with labels is optimal when 0.2 ＜ α ＜ 0.4 and 0.4 ＜ ß ＜ 0.6. In this paper, the optimal values of α, β, and γ are selected as 0.2, 0.4, and 0.4, respectively.

4.4. Scalability Verification

To test the scalability performance of ADR-CF_T algorithm, this paper compares the execution time of 20%, 40%, 60%, and 80% of the data set size with the overall data set by randomly selecting the data set size, and the experimental results are shown in Figure 6.

From Figure 6, it can be seen that as the data size increases, the execution time of the algorithm changes from slowly increasing to sharply increasing and gradually and smoothly increasing. It can be seen that the growth of the execution time of the collaborative filtering ad recommendation algorithm with labels is within an acceptable range when the data size increases, so the algorithm has good scalability.

4.5. Recommended Quality Comparison Experiment

In this paper, the data set is divided into two parts: a training set and test set, where the training set accounts for 80% and the test set accounts for 20%. The recommendation list is output by Top-N, and the accuracy, recall, and F-measure is used to evaluate the recommendation quality of the experiment. To more obviously show the effectiveness of the collaborative filtering ad recommendation algorithm with labels proposed in this paper, the weight reconciliation factors α, β, and γ are adjusted to 1 respectively, that is, the user-based collaborative ad recommendation algorithm [3], the label-based ad recommendation algorithm [15], and the label-item relationship-based ad recommendation algorithm [16] are obtained. To compare the recommendation quality of the above three algorithms and the proposed collaborative filtering ad recommendation algorithm with labels, three sets of experiments are designed in this paper: recommendation quality comparison of each algorithm for TOP5 recommendation, recommendation quality comparison of each algorithm with different N values, and recommendation quality optimization degree comparison.

4.5.1. TOP5 Comparison of Recommendation Quality of Each Algorithm

In this paper, the proposed collaborative filtering ad recommendation algorithm with tags is compared with the user-based collaborative ad recommendation algorithm, the tag-based ad recommendation algorithm, and the ad recommendation algorithm based on the relationship between tags and items in terms of accuracy, recall, and F-measure value. The experimental results are shown in Table 1 and Figure 7.

Through comparison, it is found that the collaborative filtering ad recommendation algorithm with labels proposed in this paper improves 52% in accuracy, 25% in recall, 46% in F-measure value, and nearly 41% in overall effectiveness over the traditional collaborative filtering algorithm. Since this paper considers the influence of three factors, namely CTR, ad keywords, and the relationship between ad keywords and ads, when calculating the similarity between Query pages, the integrated similarity calculation method can effectively reflect the preference information of Query pages for ads, the relevance of ad keywords for Query pages, and ads as well as the characteristics of the ads themselves for a more complete description. Meanwhile, the weight reconciliation factors α, ß, and γ of the similarity metric proposed in this paper are found to have a greater impact on the prediction accuracy of the recommendation algorithm by analyzing their values.

4.5.2. Comparison of the Recommendation Quality of Each Algorithm with Different N Values

The selection of the number of nearest neighbors also affects the recommendation quality of the recommendation algorithm; therefore, this paper compares the accuracy, recall, and F-measure of the user-based collaborative ad recommendation algorithm, the tag-based ad recommendation algorithm, the tag-item relationship-based ad recommendation algorithm, and the proposed collaborative ad recommendation algorithm with tags for the cases of 5, 10, 15, 20, 25, and 30, respectively. The accuracy, recall, and F-measure of the user-based collaborative ad recommendation algorithm, the label-based ad recommendation algorithm, the label-item relationship-based ad recommendation algorithm, and the collaborative filtering ad recommendation algorithm with labels proposed in this paper are compared, and the comparison results are shown in Figures 8–10.

By comparison, the proposed collaborative filtering ad recommendation algorithm with labels improves the accuracy by at least 17%, the recall by at least 0.9%, and the F-measure by at least 21% compared with the other three algorithms when 25 ads are recommended for each page. As the number of nearest neighbors increases, the recommendation effect appears to decrease rather than increase. This is because the number of truly similar Query pages in the ad recommendation system is limited. When more dissimilar neighbors are selected, these Query pages show ads with higher click-through rates from the dissimilar Query pages, resulting in a decrease in recommendation quality.

Therefore, only by correctly selecting similar Query pages as nearest neighbors in the ad recommendation system can we obtain the desired collaborative recommendation effect。

4.5.3. Recommended Quality Optimization Degree Comparison

In this paper, the accuracy and recall of four recommendation algorithms are fitted with Gaussians to verify the degree of optimization of the recommendation results, corresponding to a Gaussian fitting function of and a thrust coefficient of 95%. The accuracy and recall Gaussian fitting curves of the recommendation results of each algorithm are shown in Figure 11.

The Gaussian fitted curves show that the user-based collaborative ad recommendation algorithm and the tag and item relationship-based ad recommendation algorithm have intersection points as the recall rate increases, and the coefficients provided in Table 2 give the intersection point coordinates of (0.0472, 0.0168). In the interval [0.0472, 0.08], the accuracy of the user-based collaborative ad recommendation algorithm is higher than that of the ad recommendation algorithm based on the relationship between tags and items, and the degree of difference gradually decreases. With the increase of recall, the accuracy of the collaborative filtering ad recommendation algorithm with labels proposed in this paper is significantly higher than the other three algorithms, compared with the lowest accuracy of the label-based ad recommendation algorithm, which is consistent with the results of the previous experiment.

5. Conclusions

In this paper, we propose a deep attention popularity prediction model DAFCT that combines content features and temporal information, which can effectively express the popularity trend of ads and improve the performance of popularity prediction. The experimental results show that the collaborative filtering ad recommendation algorithm with labels have better scalability and better recommendation quality than the traditional collaborative filtering algorithm, label-based recommendation algorithm, and recommendation algorithm based on the relationship between labels and items. However, the algorithm does not consider other factors affecting the click-through rate of ads, such as location and bidding price. Therefore, the next step will be to consider combining with machine learning algorithms, mining the attributes of ads themselves, extracting feature information, analyzing the factors affecting the click-through rate of ads in practical applications, and improving the recommendation accuracy.

Data Availability

The dataset used in this paper are available from the corresponding author upon request.

Disclosure

This paper is a teaching demonstration course of “double base” construction of Ideological and political demonstration course “advertising planning,” China (Grant no. 2020szsfkc0110).

Conflicts of Interest

The authors declare that there are no conflicts of interest.

References

K. Ding, R. Wang, and S. Wang, “Social media popularity prediction: a multiple feature fusion approach with deep neural networks,” in Proceedings of the 27th ACM International Conference on Multimedia, pp. 2682–2686, New York, NY,, October 2019.
View at: Publisher Site | Google Scholar
G. Szymanski and P. Lininski, “Model of the effectiveness of google adwords advertising activities,” in Proceedings of the 2018 IEEE 13th international scientific and technical conference on computer sciences and information technologies (CSIT), vol. 2, pp. 98–101, IEEE, Lviv, Ukraine, November 2018.
View at: Publisher Site | Google Scholar
H. Yu, Y. Hu, and P. Shi, “A prediction method of peak time popularity based on twitter hashtags,” IEEE Access, vol. 8, pp. 61453–61461, 2020.
View at: Publisher Site | Google Scholar
M. B. Moran, K. Heley, and K. Baldwin, “Selling tobacco: a comprehensive analysis of the US tobacco advertising landscape,” Addictive Behaviors, vol. 96, pp. 100–109, 2019.
View at: Publisher Site | Google Scholar
Y. Zhang, F. Fu, Z. Wen et al., “Segment location and ground glass opacity ratio reliably predict node-negative status in lung cancer,” The Annals of Thoracic Surgery, vol. 109, no. 4, pp. 1061–1068, 2020.
View at: Publisher Site | Google Scholar
C. Zhang, T. Xie, K. Yang et al., “Positioning optimisation based on particle quality prediction in wireless sensor networks,” Networks, vol. 8, no. 2, pp. 107–113, 2019.
View at: Publisher Site | Google Scholar
L. Wang, C. Zhang, Q. Chen et al., “A Communication Strategy of Proactive Nodes Based on Loop Theorem in Wireless Sensor Networks,” in Proceedings of the 2018 Ninth International Conference on Intelligent Control and Information Processing (ICICIP), Wanzhou, China, November2018.
View at: Publisher Site | Google Scholar
Y. Ding, Y. Zhu, J. Feng, P. C. Zhang, and Z. Cheng, “Interpretable spatio-temporal attention LSTM model for flood forecasting,” Neurocomputing, vol. 403, pp. 348–359, 2020.
View at: Publisher Site | Google Scholar
J. Dan, X. Rongbin, X. Xin, and X. Ying, “Multi-view feature transfer for click-through rate prediction - ScienceDirect,” Information Sciences, vol. 546, pp. 961–976, 2021.
View at: Publisher Site | Google Scholar
Y. Li, Z. Zhu, D. Kong, H. Hua, and Z. Yao, “Evolutionary attention-based LSTM for time series prediction,” Knowledge-Based Systems, vol. 181, Article ID 104785, 2019.
View at: Publisher Site | Google Scholar
X. Ying, J. Dan, W. Xinmei, and X. Rongbin, “Robust transfer integrated locally kernel embedding for click-through rate prediction,” Information Sciences, vol. 491, pp. 190–203, 2019.
View at: Publisher Site | Google Scholar
X. Fan, Y. Wang, and M. Zhang, “Network traffic forecasting model based on long-term intuitionistic fuzzy time series,” Information Sciences, vol. 506, pp. 131–147, 2020.
View at: Publisher Site | Google Scholar
A. Deligiannis, C. Argyriou, and D. Kourtesis, “Building a cloud-based regressio model to predict click-through rate in business messaging campaigns,” International Journal of Modeling and Optimization, vol. 10, no. 1, pp. 26–31, 2020.
View at: Publisher Site | Google Scholar
Y. Sun, B. Guo, Z. Li, C. Jiahui, W. Liang, and Y. Zhiwen, “Leveraging User Profiling in Click-Through Rate Prediction Based on Zhihu Data,” in Proceedings of the 2019 2nd China Symposium on Cognitive Computing and Hybrid Intelligence (CCHI), IEEE, Xi’an, China, September2019.
View at: Publisher Site | Google Scholar
D. Agarwal, Bo Long, J. Traupman, D. Xin, and L. Zhang, “LASER: a scalable response prediction platform for online advertising,” in Proceedings of the 7th ACM International Conference on Web Search and Data Mining, pp. 173–182, ACM, New York, NY, USA, February2014.
View at: Publisher Site | Google Scholar
G. Andrew, R. Arora, J. A. Bilmes, and K. Livescu, “Deep canonical correlation analysis,” in Proceedings of the 30th International Conference on Machine Learning, pp. 1247–1255, Atlanta, G A, USA, June 2013.
View at: Google Scholar
J. Gligorijevic, D. Gligorijevic, I. Stojkovic, X. Bai, A. Goyal, and Z. Obradovic, “Deeply supervised model for click-through rate prediction in sponsored search,” Data Mining and Knowledge Discovery, vol. 33, no. 5, pp. 1446–1467, 2019.
View at: Publisher Site | Google Scholar
K. He, X. Zhang, S. Ren, and J. Sun, “Deep residual learning for image recognition,” in Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 770–778, Las Vegas, NV, USA, June 2016.
View at: Publisher Site | Google Scholar
Li Cheng, Y. Lu, Q. Mei, D. Wang, and S. Pandey, “Click through prediction for advertising in twitter timeline,” in Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 1959–1968, ACM, New York, NY, USA, August 2015.
View at: Publisher Site | Google Scholar
C. Lynch, K. Aryafar, and J. Attenberg, “Images don’T lie: transferring deep visual semantic features to large-scale multimodal learning to rank,” in Proceedings of the 22Nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 541–548, ACM, New York, NY, USA, August 2016.
View at: Publisher Site | Google Scholar
L. Gao, Z. Guo, H. Zhang, X. Xing, and T. S. Heng, “Video captioning with attention-based LSTM and semantic consistency,” IEEE Transactions on Multimedia, vol. 19, no. 9, pp. 2045–2055, 2017.
View at: Publisher Site | Google Scholar
H. Brendan McMahan, G. Holt, D. Sculley et al., “Arnar mar hrafnkelsson, tom boulos, and jeremy kubicaad click prediction: a view from the trenches,” in Proceedings of the 19th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 1222–1230, ACM, New York, NY, USA, August 2013.
View at: Publisher Site | Google Scholar
M. Oquab, L. Bottou, I. Laptev, and J. Sivic, “Learning and transferring mid-level image representations using convolutional neural networks,” in Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition, pp. 1717–1724, Columbus, OH, USA, June 2014.
View at: Publisher Site | Google Scholar
K. Weinberger, A. Dasgupta, J. Langford, A. Smola, and J. Attenberg, “Feature hashing for large scale multitask learning,” in Proceedings of the 26th International Conference on Machine Learning, pp. 1113–1120, ACM, New York, NY, USA, February 2009.
View at: Publisher Site | Google Scholar
F. Codevilla, A. M. Lopez, V. Koltun, and A. Dosovitskiy, “On offline evaluation of vision-based driving models,” in Proceedings of the European Conference on Computer Vision (ECCV), pp. 236–251, Munich, Germany, September 2018.
View at: Publisher Site | Google Scholar
Y. Huang, “Comparative analysis of typical low rank coal pyrolysis technology based on a nonlinear programming model,” Energy & Fuels, vol. 31, no. 11, pp. 12977–12987, 2017.
View at: Publisher Site | Google Scholar
C. Ma, Z. Yan, and C. W. Chen, “LARM: A Lifetime Aware Regression Model for Predicting Youtube Video popularity,” in Proceedings of the 2017 ACM on Conference on Information and Knowledge Management, pp. 467–476, Singapore, November 2017.
View at: Publisher Site | Google Scholar
Z. Gharibshah, X. Zhu, A. Hainline, and M. Conway, “Deep learning for user interest and response prediction in online display advertising,” Data Science and Engineering, vol. 5, no. 1, pp. 12–26, 2020.
View at: Publisher Site | Google Scholar
C. Dai, X. Liu, and J. Lai, “Human action recognition using two-stream attention based LSTM networks,” Applied Soft Computing, vol. 86, Article ID 105820, 2020.
View at: Publisher Site | Google Scholar
S. Dombrovska, V. Shvedun, V. Streltsov, and K. Husarov, “The prospects of integration of the advertising market of Ukraine into the global advertising business,” Problems and Perspectives in Management, vol. 16, no. 2, p. 321, 2018.
View at: Publisher Site | Google Scholar
M. Wu, S. X. Zhu, and R. H. Teunter, “Advance selling and advertising: a newsvendor framework,” Decision Sciences, vol. 52, no. 1, pp. 182–215, 2021.
View at: Publisher Site | Google Scholar
K. Iwama and Y. Kano, “Japanese advertising slogan generator using case frame and word vector,” in Proceedings of the 11th International Conference on Natural Language Generation, pp. 197-198, Tilburg, The Netherlands, November 2018.
View at: Google Scholar
S. You, L. Zhou, Y. Liu, and H. Liu, “A novel user preference prediction model based on local user interaction network topology,” in Proceedings of the International conference in Communications, Signal Processing, and Systems, pp. 2213–2221, Springer, Singapore, January 2017.
View at: Publisher Site | Google Scholar

Copyright

Copyright © 2021 Yang Su et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

364

Downloads

540

Citations

Security and Communication Networks

Massive Machine-Type Communications for Internet of Things

[Retracted] Advertising Popularity Feature Collaborative Recommendation Algorithm Based on Attention-LSTM Model

Abstract

1. Introduction

2. Related Work

3. Proposed Model

3.1. Attention-LSTM Model

3.2. NFM Model

3.3. DAFCT

3.4. Collaborative Filtering Ad Recommendation Algorithm

4. Experimental Results and Analysis

4.1. Data Preprocessing

4.2. Evaluation Metrics

4.3. Analysis of Results

4.3.1. Parameter Adjustment

4.4. Scalability Verification

4.5. Recommended Quality Comparison Experiment

4.5.1. TOP5 Comparison of Recommendation Quality of Each Algorithm

4.5.2. Comparison of the Recommendation Quality of Each Algorithm with Different N Values

4.5.3. Recommended Quality Optimization Degree Comparison

5. Conclusions

Data Availability

Disclosure

Conflicts of Interest

References

Copyright