Big Data Analysis: Is Trademate Profitable?

Short answer: Yes. The Trademate community has made a total turnover of 18 556 824 GBP with a profit of 294 175 GBP. So for every 1 GBP bet, 1.0158 GBP has been won. In other words an average ROI of 1.58% per pound bet. The purpose of this article is to answer investigate to which degree Trademate is profitable, and how the profitability differs between the soft and sharp bookmakers.

Basic Assumptions

For Trademate to be profitable we expect the data to show that we have an edge on both the soft bookmakers and the sharp bookmakers as measured by whether or not we are able to beat the vig free closing line over time. No matter which strategy you are following to become a profitable sports bettor, we always advocate measuring results vs the closing line. You can read more about the closing line here: http://blog.tradematesports.com/trademate-sports/2016/11/16/closing-line-the-most-important-metric-in-sports-trading

Thus what we expect to see when we investigate the Trademate Community data is that there exists a strong correlation between the average flat ROI and the vig free closing line over a large sample size.
 

Trademate Community Data

Sample size selection and limitations

The data that you will see next are the trades registered by the community since we launched Trademate in the beginning of October. With a couple of exceptions. Similar to the first big data stream we have removed all of the half wins and half losses. Second, we have removed all trades where the edge placed = closing edge. This was done to adjust for the issue we have had over the last couple of weeks where the closing lines did not update. This issue has been fixed. However a consequence of this was that we excluded some really good trades that were placed close to kick-off or earlier trades where the edge placed ended up being equal to the closing line. So if anything the closing lines that you will see in the photos are a bit conservative. Third, Bovada has been removed as there were multiple cases of the closing line not registering at all. Fourth, our latest bookmaker additions have not been added, but the sample size on those is rather small anyway <4000.

Flat stake sizing for analysis. Proportional stake sizing for actual trading

We are using flat stakes of 100. Both the ROI and the profits that you can see are thus from flat stake sizing. Similar to the last big data stream this is done to remove the impact that bet sizing would have on the results. Note that we do not consider using flat stakes as an optimal strategy when trading and advocate the use of a proportional staking strategy based on the Kelly Criterion.

The pros of looking at the overall data is that we get a view of the overall profitability and performance of Trademate. The weakness of the overall data is that it includes multiple bets per game, all odds ranges, all edges and all times before kick-off. Thus it is not game theory optimal. For instance multiple users placing the same trade can skew the profits both up and down depending on the outcome. This is why we will also look at what happens when we select 1 random trade per game for different subsets.

ALL TRADES. Sample size: 120k trades

YOU CAN CLICK ON AN IMAGE TO MAKE IT LARGER

Overall Trademate is beating the closing line with an average of 2,7% over a sample size of 120k trades, which is great. So why is there a discrepancy between the ROI and the closing edge?

A known issue with Trademate is that Tennis results are not always updated correctly. This occurs, because Tennis games are often moved back and forth in starting time. So with regards to Tennis our data is only as good as our users are at double checking that the results are correct manually.

ALL TRADES ON TENNIS. Sample size: ≈ 7k trades

YOU CAN CLICK ON AN IMAGE TO MAKE IT LARGER

When we look at the Tennis data alone we can see that either the results being updated wrongly are skewing our profits data (likely explanation), or Tennis is the only individual sports where Trademate fails to make a profit (unlikely explanation) despite having a strong positive closing edge.  In the rest of this article, we will exclude Tennis from the data set. 

ALL TRADES - NO TENNIS. Sample size: 113k trades

Even in the 113k sample size, there is still a discrepancy between the flat ROI and the avg. closing edge. One explanation for this is that the actual profits will vary based on the actual game outcomes. Since we are looking at all of the data the ROI could be skewed if there are some games where a lot of our users place the same bet.

Therefore we will next look at 1 randomly selected trade per game. To clarify if person A bet on the 1x2 home team, person B bet on the -0.5 handicap and person C bet on over 2.5 then only one of these bets will be included. If the game ended 1-0 then two of the trades would win and one would loose. So if we run it multiple times, then different trades will be selected, which is why the ROI can vary.

#1 - 1 random bet per game. Sample size: 25k trades

#2 - 1 random bet per game Sample size: 25k trades

Now why is there still a discrepancy between the flat ROI and the closing edge? It could be that even with a total sample size of 113k total and 25k unique trades, it is still not enough for the variance in the higher odds ranges to even out and converge towards the closing line. As stated previously taking all trades is not game theory optimal either. So what happens if we start to tighten up our presets?
 

All trades (No tennis). All edges, Odds 0-5. Hours before kickoff 0-5. Sample size: 89k trades

Once we narrowed our presets and reduced our odds range the correlation between the ROI and closing line appears to be stronger.

So next let’s have a look at the odds above 5.

All trades (No tennis). Odds: 5-100. Time: 0-100. Edge: 0-100. Sample size: ≈ 7k trades.

 

Variance

The closing looks great at 6.8%, but the ROI is at negative -4.1%. The sample size is only 6830 trades, so it indicates that the variance has not evened out. Because it will take a larger sample size for the variance to even out at 10 in odds, than at 2 in odds. Because the win probability is only 10% vs 50%. So if you place 100 trades in both ranges, the +- deviations in actual ROI vs theoretical will be larger in the 10 in odds range than at the 2 in odds range. 

Favorite-Longshot bias: Overvaluing underdogs and undervaluing favorites.

Another possible explanation for why there is a discrepancy is larger in the higher odds ranges besides variance is that there really is something in the favorite longshot bias. Meaning that bookmakers have a higher margin on the underdogs, causing the odds you get offered to be lower than the true odds and that they have lower margins on the favorites. From a business point of view it makes sense that you would need to have higher margins on good that are sold more rarely, underdogs, and can have lower margins on goods you sell a higher volume of, favorites. If the favorite longshot bias is in fact true, which industry research also suggests, then it would imply that edges on really low odds are currently undervalued by our algorithm, while higher odds are overvalued. For example it could be that a 0.1% edge at 1.2 in odds really is a 1% edge or that a 4% edge on a 7 in odds really is only a 3% edge. Please note that the edge % mentioned are arbitrarily selected for illustrative purposes. We are currently working on adjusting our algorithm to take the fav-longshot bias into consideration. But as a temporary solution it would be wise to employ a margin of safety of 1-2% when betting on higher odds ranges, 5 and above.

#1 Random Odds 0-5. Hours before kickoff 0-5. Sample size: 22k trades

#2 Random Odds 0-5. Hours before kickoff: 0-5. 22k trades

When we select one random trade per game it still appears to be a discrepancy.  

If we tighten up the odds range and time before kick-off even further

All edges. Odds: 0-2,5. Hours: 0-2,5. Sample size: 53k trades

#1 Random. All edges. Odds: 0-2,5. Hours: 0-2,5. Sample size: ≈17k trades

#2 Random. All edges. Odds: 0-2,5. Hours: 0-2,5. Sample size: ≈17k trades

The correlation between the ROI and closing edge starts to get stronger. In the overall 2,5 odds and 2,5 hours subset the ROI is even higher than the closing, which indicates a run good.
 

The Asian bookmakers

On all trades the community is beating the vig-free closing line by 0,3%. With an ROI of 0.6%. So actually there appears to be a slight run good. It is likely that the closing lines for the sharps have been more affected than the softs by removing the trades where edge placed = closing edge, because the majority of trades in Asia are placed closer to kick-off. This would imply that the actual average closing edge would be slightly higher. Now from the raw data that includes all trades, even where the closings have not updated the flat ROI on the sharps is -0.06% and the average closing is 0.99%. So that the actual avg. closing lies somewhere between 0.99% and 0.3%. That the flat ROI deviates from the closing is not surprising when we are looking at a sample set that includes all trades placed, which is not an optimal strategy on the Asians. When the average closing edge is at <1% there is also a fine margin for whether the ROI runs +- 1%, the difference between profits and loosing money. Also, when having a breakeven flat ROI on the sharps using a flat stake sizing strategy, one would expect that using a proportional stake sizing strategy should bring profits. Because this would result in placing larger bets on lower odds (larger win probability) and higher edges (more value).

ALL ASIAN TRADES. Sample size: 24k trades

Let's have another look at Tennis. 

TENNIS ASIAN ONLY. Sample size: 700 trades

I do not know exactly what conclusion to draw from this data. I would expect the sharp traders to be more thorough in double checking their Tennis results, as the overall edges are smaller there, it is a lot more important to keep track of performance. The closing edge is solid, but the results are just insane. So either Tennis is extremely profitable on the sharps, there is a crazy run good or something is again wrong with the reporting of results. 

ALL TRADES ON ASIANS, NO TENNIS. Sample size: 24k trades

Tennis has once again been excluded in the remaining data presented. 

What does it look like if we use 1 random bet per game?  Here are 3 tries. Sample size: 12k trades

I think we can all agree that one should not take any trade that exists on the sharps and use a rather narrow preset.

Odds: 0 - 2,5 Hours: 0 - 2,5. Sample size: ≈ 17k trades

#1 Random trade per game. Odds: 0-2,5 Hours: 0 - 2,5. Sample size: 9k trades

#2 Random trade per game. Odds: 0-2,5 Hours: 0 - 2,5. Sample size: 9k trades

#3 Random trade per game. Odds: 0-2,5 Hours: 0 - 2,5. Sample size: 9k trades

Overall the correlation between the ROI and closing edge appears to be strong. That the ROI is higher in one of the simulations could be explained by run good or that the actual closing edge and thus closing EV is slightly higher. Another important element to keep in mind is that a) The sharps do not limit. And b) Using a flat staking strategy as we have done in this analysis is not a game theory optimal strategy. By using a proportional staking strategy one would expect the actual profits to be better than the flat profits. 

Also remember that the goal of a sports trader and the purpose of Trademate is to beat the no vig closing line. The reason we say that we want to place our bets as close to kick-off as possible is that it is more likely to remain an edge when the game kicks off and lead to a higher average closing edge. But this is only one way of beating the closing. If you are able to beat the closings by taking earlier positions then that is great, as long as you know the higher risk you are taking with placing trades when the odds is more volatile. Another point to emphasize is that Trademate is a tool traders can use to identify +EV bets prior to kick-off, but it is your job as a trader, to make sure that the trades you are taking end up with a +Closing EV. 


Soft bookmakers

Finally let’s have a quick look at the softs. I think the numbers speak for themselves here and that how to interpret them have already been covered previously in this post.

All trades (No tennis). Sample size: 89k

Odds: 0 - 5 Hours 0-5. Sample size: 69k

1 Random trade per game. Odds: 0 - 5 Hours 0- 5. Sample size: 18k

 

CONCLUSION

Again I would like to emphasize that we benchmark results versus the no vig closing line. If you do not believe that beating the closing line will lead to profits in the long term, then we are not the service for you. Also we deliver the tool, but it is your job as a trader to pick trades that end up with a positive closing edge. We do our best to help you on the way by sharing our information and knowledge. We host regular big data streams where we dive into the community stats. In the latest video we also looked at the data for individual sports. However this video is available for customers only.

Calculating Expected Profits

You can calculate your expected monthly profits by using the following formula:  

Expected Profits = ( Starting Bankroll * Average ROI^Number of times you turnover your bankroll in a month )  - Starting Bankroll

With a starting bankroll of €5 000 on the softs bookies with a 2,2% avg flat ROI and given that you manage to turnover your bankroll twice per week you could expect to earn:

€5000 * 1,022^8 = €5 950 - €5000 = €950. If you bring all your money into the next month you will have €5 950*1,022^8 = €7 081 -€5950 = €1131. So the compound growth gives a potentially high profit growth. With an average stake size of €25 per bet or 0.5% of the total bankroll one would need to make 200 bets per week to reach that number. If you start with a lower bankroll, you will need a higher turnover, meaning more trades to make the same expected profits. Also, note that one would expect the actual profits to be higher in practice, because using a proportional staking strategy such as the Kelly Criterion is superior to a flat staking strategy and results in an actual ROI that is larger than the flat ROI used in the analysis of the community data.

Steps to reduce variance

Also note that valuebetting inherently contains a lot of variance. This will cause the actual profits in a given month to fluctuate from the expected profits. However, the variance does even out over a large sample size, but an early run bad can have a detrimental effect on your bankroll. Thus it makes sense to take steps to reduce the variance such as to:

  1. Bet on lower odds ranges (E.g. < 3 )  

  2. Use 30% Kelly stake sizing

  3. Bet closer to kick-off when the odds is more stable.

Following these steps will also reduce your potential turnover and thus the pace of your profit growth. So as a sports trader you need to evaluate to which degree you can tolerate risk and how it fits with your overall strategy. At a minimum one should use a 30 - 50% Kelly. However one can go for higher odds ranges, just know that you might need to reach a couple of thousand trades for the variance to even out.