Abstract

Crowdsourcing is an effective tool to allocate tasks among workers to obtain a cumulative outcome. Algorithmic game theory is widely used as a powerful tool to ensure the service quality of a crowdsourcing campaign. By this paper, we consider a more general optimization objective for the budget-free crowdsourcer, profit maximization, where profit is defined as the difference between the benefit obtained by crowdsourcer and payments to workers. Based on the framework of random sampling and profit extraction, we proposed a strategy-proof profit-oriented mechanism for our problem, which also satisfies computational tractability and individual rationality and has a performance guarantee. We also extend the profit extract algorithm to the online case through a two-stage sampling. Also, we study the setting in which workers are not trusted, and untrustworthy workers would infer others’ true type. For untrustworthy workers, we introduce a differentially private mechanism, which also has desired properties. Finally, we will conduct numerical simulations to show the effectiveness of our proposed profit maximization mechanisms. By this work, we enrich the class of competitive auctions by considering a more general optimization objective and a more general demand valuation function.

1. Introduction

With the rapid development of the Internet and communication technology in recent decades, the Internet has become an important market for labor hirings, such as Amazon MTurk and Meituan. Compared to traditional labor markets, such online platforms are known as crowdsourcing markets, in which the service subscriber could divide microtasks to the geographically distributed workers. There are various applications of crowdsourcing or crowdsensing in practice, such as healthcare [1], smart city [2], and localization [3].

In order to incentivize workers’ participation, the platform needs to pay compensations to the worker for the completion of tasks. The strategic behavior of online workers is a reasonable assumption, since all workers are rational individuals, who will seek to increase their utility by misreporting. Thus, we must design mechanisms to tackle the strategic workers. Algorithmic mechanism design is a branch of economic theory and game theory, which allows the designer to achieve desired objectives with strategic participants. Algorithmic mechanism design is also known as reverse game theory, which has been widely applied in our daily life, such as markets, sponsored search auctions, and voting procedures.

In reality, a data broker may hire online workers to label data and build through a crowdsourcing campaign. The data broker is aimed to reselling the dataset to earn profits. Instead of finishing a specific set of tasks, the service subscriber is budget-free, whose target is profit-oriented, where profit is defined as the difference between payments to workers and the revenue. In this paper, we introduce a mechanism for profit-oriented crowdsourcer. Without loss of generality, we assume the crowdsourcer’s revenue function is symmetric submodular, which means the marginal revenue will decrease, as more data are sold. We design a strategy-proof mechanism based on random sampling, which also satisfies all desirable properties. Meanwhile, we extend the mechanism to the online setting. For the untrustworthy worker, we design a differentially private mechanism, which also has desired properties. Finally, we conduct numerical experiments to demonstrate the effectiveness of our proposed profit maximization mechanisms.

Remark 1. Compared to our earlier version [4], we simplify the competitive ratio from to with the same allocation and payment function and different method of analysis. Also, we get a new competitive ratio for the online auction. Furthermore, we propose a profit-maximized differentially private mechanism for privacy-aware workers. Simulations are based on a real-world dataset instead of following some distributions.

The contributions of this work are summarized as follows: (i)Compared to the existing work on profit-oriented auction design, we study mechanisms for the buyer with a more generalized utility function, which is symmetric submodular(ii)Drawing from the idea behind the online learning, we introduce a novel multistage sampling framework for online profit maximized auctions(iii)We also study the mechanism for untrustworthy sellers. The proposed differentially private mechanism has good properties of individual rationality and approximate truthfulness and has a performance guarantee.

Algorithmic game theory has become a useful method to build incentive auctions in the crowdsourcing system due to the strategic behavior of workers. Yaron [5] is the first person who studied the budget-constraint mechanism design which then became the major category of auctions for crowdsourcing auction design, i.e., [617]. In particular, Yaron proposed a method for provable guarantee auctions in crowdsourcing markets with fixed budget [7]. Biswas et al. proposed a multiarmed bandit setting under a budget constraint, in which the background that every task is with an invariable duration and unknown user abilities and due to the fixed budget, cost, and quality should be balanced when assigning tasks to workers [8]. Eric and Jason studied the budget constraint crowdsourcing auction with a Bayesian environment, who also proposed a posted price mechanism for their problem [10].

This paper involves the study of revenue maximization, which was broadly studied by the community of economists, and the satisfactory solution is known in the Bayesian condition with a single-dimensional type of sellers [18].

In recent time, one branch of research for the area of mechanism design suggests that even in the worst condition, in which the buyer has nothing about the knowledge of seller’s valuation, it is likely to maximize the buyer’s profit with a performance lower bound. A representative example of this area is a competitive digital auction, which is by getting certain knowledge from the sellers through bootstrapping, proposing the method of set partition and profit-extract, where its utility is measured by omniscient cases [1921]. Several researchers have improved on the framework of competitive auctions; for example, Carry et al. introduced an extended competitive auction, which is adapted to auctions with structured goods [22]; Ray et al. considered how to maximize the profit of prior-free procurement auction when the auctioneer wants to purchase multiple homogeneous goods [23]; Zoe et al. found that according to the competitive mechanism, the multiunit budget-constrained auction problem proposed by Christien et al. [24] can be solved, where the quantity of the identical commodity is limited and each bidder’s private type is her cost and her budget constraint to maximize the sale revenue. Christien et al. built conditions that characterizes lower bound for all monotonic measurements [24]. Meanwhile, the methods used in this paper are built by random sampling and profit-extract framework introduced and lack full stop [19]. The differences on our proposal are major three points as follows: (a) the buyer’s revenue function; (b) the final objective; and (c) the number of units that every worker could provide.

3. Preliminaries

In our setting, there is a crowdsourcer and a group of workers who participate in the crowdsourcing auction. The crowdsourcer is the buyer in the market, who hires workers to build datasets and aims to sell data to earn profit. Workers are sellers in the market, who provide service to the buyer and get a return for their participation. The crowdsourcer’s target is profit maximization, where the profit is defined as the difference between the revenue of data and compensations to workers.

Since the crowdsourcer will allocate tasks to the worker through an auction, every worker will submit a bid to the buyer. The bids of workers are bidimensional, where means the maximum number of tasks that the worker could finish and denotes his unit private cost. If the quantity of tasks that are assigned to worker is larger than , it will make the cost of worker to . Let index the bidding profile of all workers. Based on the reported bidding profile of workers, the decision made by the buyer consists of two schemes: (i)An allocation scheme(ii)A payment scheme

Herein, is the compensation to the worker and denotes the task number which is needed to be performed by worker .

Meanwhile, let and index the capacity vector and cost vector, respectively. In the end, the winners in the auction will perform tasks, and the crowdsourcer will pay them compensations.

We denote as the quota of purchased unit service, and all purchased service is homogeneous. The revenue of the crowdsourcer is a function of , which is only related the cardinality of , i.e., . In each round , the revenue of the crowdsourcer increases by an incremental value when adding a new item . denotes the marginal contribution for -th unit, when units have been added. Meanwhile, we have . Formally, the revenue function of the crowdsourcer is a symmetric submodular function. The revenue function is as follows: in which is a list of sorted nonnegative numbers. is an extremely large number. The assumption of the symmetric submodularity of the revenue function is reasonable, due to the demand curve in economic theory.

For an auction , with a bidding profile , the profit obtained by the crowdsourcer is calculated by the difference between revenue achieved and the compensation to workers:

Also, we index as .

Let index the utility got by worker . Formally, is defined as

Next, we will present several properties which are often desired by the designer. (i)Truthful: given any worker , his utility is never increased by lying.(ii)Individual rationality: given any worker , his utility is never negative by participating the auction.(iii)Computational tractability: all outcomes of the mechanism are computed in a polynomial time.(iv)Competitive profit: when compared with the omniscient mechanism that could get a best result , the auction could get an unchanged part of . If , in which represents an unchanged number, we will regard this mechanism achieves -competitive to .

4. Performance Benchmark

In the rest of the paper, the optimal omniscient auction would be used as the benchmark and compared with our designed auction. In the optimal omniscient auction, the buyer has the full knowledge of the real information of all workers. There will be a clear price or purchasing price in such auctions. Purchasing price for the whole workers is the same numbers; then, it is named the optimal single-price omniscient mechanism, or it is named the optimal multiple price omniscient mechanism.

For omniscient auctions, the buyer has the knowledge of workers’ capacity and cost. With a revenue function , the crowdsourcer will procure the labor service with the price of worker’s cost greedily in the optimal multiple price omniscient mechanism, until the marginal revenue is lower than next worker’s cost. Thus, the profit achieved in such auctions is

Next, we would like to introduce the optimal single-price omniscient mechanism , in which only one clear price will be adopted for all winners. Note the threshold payment adopted by is the highest cost of the whole winners in this auction. Such utility achieved through could be written as

For and , we have the result as follows:

Theorem 1. .

Proof. Since is the optimal result, we obtain that Also, we have

In the end, we get

5. A Mechanism with Competitive Profit

When workers are strategic, the information of workers is unknown. The challenge is whether we can and how to reliably obtain a profit that is competitive to the profit of omniscient auctions, despite the challenge posed by information incompleteness and rational behavior of the users. Without prior knowledge of workers, a profit competitive auction seems a natural fit. The main idea behind our designed auction is to measure the optimal result through a sampling set of workers, and a profit-extract algorithm extracts the expected profit. This method is based on the framework of random sampling and profit extractor [22].

5.1. The Profit Extractor

At first, the profit extraction algorithm for a buyer, who has the revenue function and expected profit , is presented in the following algorithm that will use workers’ reported bidding profile as inputs and as outputs.

The workflow of the above algorithm is as follows and presented in Algorithm 1: we make the workers into a sorted list according to one’s reported unit cost firstly. Then, let be the cost of -th service in the sorted list. After this, we set a clear price in the interval in -th unit service to procure all units of . Then, the expected profit is achieved. Obviously, is the maximum number to purchase. After this, if is liked to be achieved, we need to find the last unit service , and his cost is used as the clear price. service is named as stopping unit, and the worker who provides is named stopping worker. If we find , the purchasing quota will be with the clear price . Else, and will both be zero. In the end, is the clear price to buy units from workers. The worker interacts with the buyer in a random order, and the mechanism stops when is larger than the reported cost.

Through the above algorithm, every worker provides units with the payment , in which is random, due to the fact that the units are chosen randomly from workers. The expected benefit of worker could be calculated:

Every worker will not provide more than his capacity; otherwise, he would get the benefit.

1: Input: Reported capacity and reported cost ;
2: Sort the workers according to his cost, and initiate the vector to every worker as ;
3: Find out the unit so that
and ;
4: Find out the ending items satisfying ;
5: if exists then
6:  ; ;
7: else,;
8: ;
9: while and do
10:  Select a worker from randomly;
11:  ;
12:  ifthen
13:   ; ;
14: end while
15: Output:

Lemma 1. For the auction , there is no worker could increase his utility by misreporting his capacity.

Proof. Obviously, every worker reporting a lower amount would neither change the procurement number nor change the purchasing price; thus, misreporting would not increase his utility. When it came to higher bid, we use as the current quota and as the clear price. Given a worker whose capacity is , if he reports his capacity , and his units will be provided and get a higher benefit . We use and to index the procured amount and the clear price separately. Then, we have that 1 of the below equations will be true: (1) and (2) . represents and ; i.e., the capacity bid of worker will be the sum of , thus, , and it implies , and we have a contradiction; implies or . We have already presented would reach a contradiction. Meanwhile, it is obviously that would not happen.☐

Furthermore, we could show no worker could increase his utility by lying about his unit cost.

Theorem 2. is truthful.

Proof. According to Lemma 1, it only needs to prove the whole workers would bid his unit cost truthfully. Given a worker , there will be 2 cases to discuss:
1) . This seller is the stopping worker or a seller in front of the stopping worker. It is easy to see that every worker would get a utility at least zero by reporting one’s true cost. If a worker increases his reported cost which is lower than the clear price, then the clear price and procuring quota will not change. Thus, worker ’s utility is invariable. If a worker increases his reported cost which is more than the purchasing price, there will be two cases: (1) a worker () would be the new stopping worker; thus, the purchasing price and the procuring amount would decrease, and the worker would lose in the game, whose utility will be zero. (2) The mechanism is a failure, and no task is allocated to the workers, and all workers would achieve a zero benefit. For the aforementioned two possibilities, worker ’s benefit will decrease,. Worker is after the stopping worker. If worker increases his bidding, , and his utility will be the same. If his bidding cost decreases, there will be two cases: (1) and would not change; and (2) the worker will provide some service at a price which is lower than his true cost. Then, his utility will not be positive. In the above two cases, the worker’s benefit will not increase.☐

Combining the above two cases, the lemma holds.

Theorem 3. is individually rational.

Proof. Given a worker , he reports . The purchasing price would satisfy . Therefore, of his units would be sold with . Based on Theorem 2, each worker’s benefit would report his true type; thus, each worker is larger than zero.☐

Next, we will show that, for an arbitrary group of workers, the designed algorithm could achieve any target profit .

Lemma 2. Algorithm achieves benefit if and gets otherwise.

Proof. According to Lemma 1, any worker’ biding information will be his true cost. implies that through equation (4). It would be 2 possibilities: (1): if we assume that and set the clear price as , we obtain . The cost of every first service is lower than . Therefore, we could use the above and to achieve a predetermined profit .(2): if we assume that and set , which implies . Meanwhile, because could be get by the concept of , , and , which implies . Therefore, we could use the above and to achieve a predetermined profit .

Also, if , then nothing would be bought from workers and the profit is zero.

5.2. The Profit Competitive Auction

Until now, a profit-extract algorithm has been introduced. Through this algorithm, we could obtain Algorithm 2.

1: Input: capacity bid and unit cost bid ;
2: Partition bids, u.a.r. into two sets and with equal probabilities;
3: ;
;
4: Choose a set from randomly;
iffailthen

This algorithm is based on random sampling and presented in Algorithm 2, where workers are partitioned into 2 groups. Next, of every group is calculated. In the end, the extractor algorithm will be applied to one of two groups to get the profit which is calculated by the other group. In our method, at least one of the two partitions will achieve profits.

Theorem 4. finishes in polynomial time.

Proof. In the complexity of, the profit extractor algorithm is. The algorithm contains a dividing process and two times of calculating and one time of profit-extractor algorithm. Thus, the mechanism could be calculated in polynomial time.☐

Theorem 5. is truthful.

Proof. Given a set of workers , whose bidding types are , the allocation and compensation vectors are calculated via performing , in which and have nothing related to . Thus, based on Lemma 2, for every worker in , reporting his true type is the best strategy. Drawing from , we also have the conclusion in .

As for the performance of our designed algorithm, we could have the result as follows.

Lemma 3. With an arbitrary bidding profile , the algorithm gets a profit .

Proof. Assume in the algorithm, and according to Lemma 2, will be achieved in line 3. Meanwhile, with , the achieved value is . In the end, with , the profit could also be achieved.☐

Theorem 6. achieves 4-competitive to .

Proof. Let index the -th worker’s sold service for . We use to index the workers who sold services to , indexes the used purchasing price. We use and to denote the sellers from , and be divided to subgroups and separately. Thus, . It implies , and . Meanwhile, we get due to the fact that we could achieve a benefit by procuring units with . Also,

Based on Lemma 3, achieves a benefit of

Because , are two partitions of all workers,

The value of above equation reaches the minimum with . As increases, the value would approach .

In the end, we have

6. Online Profit-Maximizing Mechanism

Until now, we have introduced an offline mechanism; the buyer and worker will interact through a sealed bid auction. But it is hard to gather all workers in a time in practice; it motivates us to design an online profit-oriented auction. The parameters and settings of online auctions are similar to the one of offline auction, but there will be a time duration between the starting time and ending time. All workers will arrive and participate in the auction. The arrival time of each worker is i.i.d. and followed some unknown distributions.

When we design the auction of the online setting, it is necessary to consider the following challenges: (1) the auction needs to incentivize the seller to report his true type; (2) the auction needs to decide the purchasing quota before all workers’ arrival; and (3) the auction needs to handle the online arrival of workers. To handle the hurdle, we proposed a two-stage sampling, enlightened by the online learning. The auction will partition the time into two substages. The first stage will be used for learning, and the other is for earning profit. The first substage will be terminated by ; the next substage will start at and end at . The workers in the first substage will be rejected automatically, which will be used to learn the information for making decision in the substage. While the first substage is terminated, we will use workers, who arrived in this substage, to build a sample to calculate and . With and , we could extract profit from workers in the second substage.

1: Set ;
2: whiledo
3: if there is a worker arriving at then
4: ;
5: end while
6: and ;
7: whiledo
8: if there is a worker arriving at then
9: if and then
10:  and ;
11: else;
12: end while
13: Output: and ;

The auction does not terminate until is obtained. Intuitively, the stop criterion is to guarantee that our obtained profit is not a negative value number, because the utility function of the crowdsourcer is monotone decreasing with . The crowdsourcer procures too many units from workers, which might result in a loss. Since the online profit-oriented auction is extended by the offline profit-extract, it will share some properties.

Lemma 4. The online profit-oriented auction is computed in polynomial time computationally tractable

Proof. The mechanism has an online decision operation, one time of calculating optimal profit , and single time of running Profit extracts in Algorithm 3, which all will be finished in a polynomial time, since Algorithm 3 will run few times of profit extraction algorithms.☐

Lemma 5. The online profit oriented auction is individually rational.

Proof. It is trivial, since our proposed mechanism is a posted-price mechanism. Therefore, we have the lemma.☐

Lemma 6. The online profit oriented auction is truthful.

Proof. It is trivial, since our proposed mechanism is a posted-price mechanism. Thus, the lemma holds.☐

Let and index the subsets of that appears in the first and second halves of the input workers, separately. Because the types of all workers are i.i.d., they could be chosen in the set under the same probability. The sampling set is a randomized subset of since all users arrives in a random order. Thus, the number of workers ininwould follow a hypergeometric distribution. We index the total services of the workers whose cost is lower than as in the subset and in the subset , in which and are two random partitions. Because the types of all workers are i.i.d. and the two subsets are generated from a hypergeometric distribution, let us assume has an invariant ratio to , which bounded by for any given clear price , in which is a small invariant value between (0,1) if . Then, we could obtain . Then, we get the lemma as follows.

Lemma 7. The online profit oriented auction is -competitive to .

Proof. We index the profit for the optimal omniscient auctions for the first sub-stage as . According to Theorem 10, it implies that -competitive to . Thus, we only need to prove the ratio of to . There will be 2 possibilities: (i)The auction gets the target profit by the second substage. Therefore, it implies (ii)The auction is failed to get while the mechanism ends. It is easy to see . The obtained is formulated by

Thus, combining two possibilities, the lemma holds.

By the aforementioned lemmas, we can get the theorem as follows.

Theorem 7. The online profit oriented auction is the computational efficiency, individual rationality, and truthfulness and has -competitive to .

7. Differentially Private Mechanism

In this part, we will study privacy-preserving mechanisms for the profit-oriented crowdsourcing, in which there will be workers acting as attackers who snoop on other workers’ private information [25]. The differentially private algorithm ensures the distribution of results does not change significantly while one item changes her input. Formally, the definition of the differentially private algorithm is

Definition 1 (differential privacy). A randomized algorithm is -differentially private if for an arbitrary input vector and , whose difference is only one worker, and the following formula holds for any payment vector :

The above definition ensures that any alternation in an arbitrary worker’s reported information will not result in a significant change in the outcome of the payment profile, which makes it hard for an attacker to obtain the private types of other workers in the mechanism. Note, unlike the trustworthy case, we wish our mechanism satisfies the following property.

Definition 2 (approximate truthfulness). We say a mechanism approximate truthful, if it satisfies the following equation: in which is a small positive number.

Next, we will design a profit-oriented differentially private auction through the exponential mechanism. The exponential mechanism computes the result over arbitrary domains and ranges instead of a specific value [26]. The definition of the exponential mechanism is as follows:

Definition 3 (exponential mechanism). The exponential mechanisms randomly assign the input set to the outcome . In particular, the exponential mechanism decides the outcome based on the equation as follows: in which is a query function mapping a pair of input data set and the candidate result to a real value.

Algorithm 4 is our proposed exponential mechanism for a profit-oriented auction. We denote as all possible clearing price, which can be get from the cost profile of sellers. Firstly, for each possible purchasing price , sifts out the sellers whose private cost is not higher than and make them a new group . Then, we can compute the maximum amount of service that can be purchased, denoted as , Finally, work out the profit obtained through the workers in , which is indexed by . We will choose the clearing price according to the probability which is proportional to the , where is the optimal outcome of the auction.

7.1. Mechanism Analysis

Theorem 8. Differential privacy mechanism is individually rational.

Proof. When the unit service cost of sellers is more than the clearing price , i.e., , the auctioneer will not purchase services from them; in this case, the utility of sellersis to equal 0. In contrast, when the unit service cost of sellers is no greater than the clearing price , i.e., , the auction possibly purchases services from them; in this case, the utility of sellers is .

In summary, the utility of sellers is no lesser than 0.

1: fordo
2:  
3:  
4:  
5:  
6: end for
7: choose a clearing price with the probability distributions:
8:
9:
10: while and do
11:  Randomly select a bidder from
12:  
13:  
14:  
15: end while
16: Output: the combined allocation and payment

Theorem 9. Differential privacy mechanism satisfies -differentially private.

Proof. We denote and as two input sets with only one different element. With a fixed price , the maximum difference of profit obtained from the two bidding sets is

We use to denote the maximum over all clear prices . Obviously we know that

, we have

Thus, we have

Therefore, the theorem holds.

Theorem 10. Differential privacy mechanism is approximately truthful.

Proof. With the bid vector , the expected utility of seller is as follows: According to Theorem 8, we know so We can prove that the expected utility will not increase when the seller lies about his type. (1)When , if , this is discussed in two cases. If , then the auctioneer will not purchase services from the mobile user ; if , then the auctioneer may purchase the service from the data contributor And then his utility is , which has a negative value. If , then the expected utility is unchanged(2)When , if , the expected utility is unchanged. If , this is discussed in two cases. If , the auctioneer will not purchase from the seller , so the utility is reduced; if , obviously, the expected utility is unchanged(3)When , because the cost of the service beyond the capacity of sellers, so his utility is , when , it is easy to know that the expected utility will not increase

In summary, there is ; thus, we have

We uses to index the maximum amount of services that the sellers can provide, so we get

Combined with the previous formula, we can get

According to Definition 2, the theorem is proved.

Theorem 11. Differential privacy mechanism to obtain a profit of not less than with a probability of at least .

Proof. From [27], we have the following formula:

Due to the fact that and are constants, if we set in the above equation, then, we obtain

So, the theorem is proved.

8. Simulation Study

8.1. Experiment Settings

We conducted two sets of experiments as follows: (1)Firstly, we mainly verify the performance of the algorithm, i.e., the competitive ratio to the single-price omniscient optimal auction(2)Secondly, we demonstrate the performance of the proposed differential privacy mechanism. Also, we also study the sensitivity of parameters and settings to the performance of the mechanism. In addition, the performances of privacy protection are illustrated by analyzing the probability distribution of the results

8.1.1. Profit-PA

Numerical experiments are conducted to illustrate the effectiveness of our designed profit-oriented mechanism. Cost information is hard to obtain from the worker directly; thus, we estimated the cost information according to the historical bidding data. In Weiboyi, a user will provide bidding for recommending a product to her friends and a number of friends that the user has. In Weiboyi, bidding contains both price and the number of friends. Thus, we use them to approximately estimate the cost information and capacity of a worker. We obtained over 10000 bidders in Weiboyi. The information of a selected user is shown in Figure 1. The cost of a seller is from 0 to and the number of friends is from 0 to . We normalize the cost into and the number of friends into . When we select a seller from Weiboyi dataset, we will use the cost and the friends’ number of the seller in Weiboyi to simulate the cost and the friends’ number of a worker in our crowdsourcing platform. We use the following submodular function to measure the buyer’s revenue:

8.1.2. Differential Privacy Mechanism

The private information of service providers is generated by a uniform distribution with intervals of [1, 10] and [0.2, 2]. Here, the minimum cost per unit of service is 0.2, which is a fixed overhead that is inevitably consumed by providing unit services. For the settings of competitive auctions, the cost is from uniform distribution that is known in advance.

In the differential privacy mechanism, is an adjustable variable. The scope of is limited to [0, 1], and experiments are running with values of 0.05, 0.5, and 1, respectively. We will use the method of analyzing the quantity of disclosed privacy proposed in [28].

Definition 4 (privacy leakage). For an arbitrary mechanism , let index the result of . and have only one different input data. and are the outcome of probability distributions of and , separately. The privacy leakage of is the maximum of absolute differences between logarithmic probabilities of the and for any and :

Theoretically, the parameter of differential privacy mechanism is the upper bound of the privacy leakage.

8.2. Experiment Results and Analysis

In Experiment 1, we verify the performance of competitive auctions. For this case, we assume that the cost of the service is from Weiboyi dataset. As can be seen from Figure 2(a), as the number of sellers increases, the profit of both optimal omniscient auction and competitive auction will show an upward trend. In other words, as the market competition increases, the buyer can achieve greater profits.

Similarly, as can be seen from Figure 2(b), the change in the number of sellers has an impact on the winner ratio. This shows that the competitive auction mechanism is robust. As can be seen from Figure 2(b), as the number of workers increases, the winner ratio of both optimal omniscient auction and competitive auction will show a downward trend. In other words, as the number of sellers increases, the winner ratio will be less.

In the second experiment, we mainly verified the performance of the proposed differential privacy mechanism. The costs of the worker are followed by a discrete distribution over the interval [0.2, 2]. From Figure 3(a) as the number of workers increases, the profits show an upward trend, but it is slowly compared with Experiment 1, since the cost of workers is discrete. It can also be seen from Figure 3(a) that the profit of differential privacy mechanism is much lower than the competitive auction, since it is the cost of the privacy protection.

In Figure 3(b), as the parameter changes, the profit of differential privacy mechanism also changes. Although the number of sellers is fixed, this change is not obvious due to the randomness of the differential privacy mechanism. However, when the number of sellers increases and the value of is larger, the profit increases. This is because, with increases, the differential privacy can choose the higher clearing price with a greater probability; that is, it can achieve greater profit.

As we can be seen from Figure 3(c), when the parameter is larger, the privacy leakage will be larger, regardless of the number of sellers. From Figure 3(b), as the value of increases, the profit of differential privacy mechanism will increase; also the privacy leakage will increase. Therefore, the mechanism designer must make trade-offs between profit and privacy leakage.

9. Conclusion

We introduce a profit-oriented mechanism for the crowdsourcing, which is prior-free. Our designed mechanism adopts the framework of profit-extract and random sampling. We show the designed profit-oriented mechanism satisfies the properties of truthfulness, individual rationality, and computation tractability and has a performance lower bound. Through a two-substage sampling, we extended the offline algorithm to the online setting. And we also study the mechanism for our setting with privacy-aware sellers. Simulations are conducted to illustrate the effectiveness of the proposed profit-oriented algorithm.

Data Availability

The data used to support the findings of this study are available from the corresponding author upon request.

Disclosure

This article is an extended version of the paper of Qiao et al. (2018) presented at the 16th ISPA-2018 Melbourne, Australia, December 11-13, 2018 [4].

Conflicts of Interest

The authors declare that they have no conflicts of interest.

Acknowledgments

This paper is supported by the National Key Research and Development Program of China (Grant No. 2018YFB1403400), the National Natural Science Foundation of China (Grant No. 61876080), the Key Research and Development Program of Jiangsu (Grant No. BE2019105), and the Collaborative Innovation Center of Novel Software Technology and Industrialization at Nanjing University.