This Just Took Me 6 Hours Manual Data Mining - Appreciate



  • Edit: Scroll the tread for periodic updates of the data.

    @Metropolis_山の中の市 Gave me the idea but it got a bit out of hand. I worked out all the forum sign ups from the start of time. This lets us know the relative volume of new users that are joining FI . Forum users do not show all new FI sign ups, however they give us a idea if new sign up are in decline, flat or increasing. Here is the data I've got. My eyes are bleeding as I had to do all this manually.

    Thing to note

    New user sign up are flying in 2019 like nothing we have seen before.
    Over all user grow is really steady over all, but is spiking this year.
    Also one weirdo signed up at 12.04 New Years in 2018??????

    Top chart is the one to look at. It shows users added to the forum per day. It's flying. Weird drop off late January 2018. No idea why. Averages climbing all the time, but as you can see from the late spike, user growth is at a all time high going into 2019. Pretty steady at 30 - 50 users added per day for most of 2018, now it's going over 100 per day. Growth looks very strong.

    0_1547506341446_Users signing up vs Date.png

    0_1547506360136_Users signing up and Total.png

    Raw data from my spreadsheet

    Date Users signing up Total
    16/5/17 2 2
    17/5/17 2 4
    18/5/17 1 5
    19/5/17 0 5
    20/5/17 0 5
    21/5/17 0 5
    22/5/17 0 5
    23/5/17 0 5
    24/5/17 0 5
    25/5/17 0 5
    26/5/17 0 5
    27/5/17 0 5
    28/5/17 0 5
    29/5/17 0 5
    30/5/17 0 5
    31/5/17 0 5
    1/6/17 0 5
    2/6/17 0 5
    3/6/17 0 5
    4/6/17 0 5
    5/6/17 0 5
    6/6/17 0 5
    7/6/17 0 5
    8/6/17 51 56
    9/6/17 69 125
    10/6/17 29 154
    11/6/17 23 177
    12/6/17 41 218
    13/6/17 27 245
    14/6/17 18 263
    15/6/17 17 280
    16/6/17 22 302
    17/6/17 18 320
    18/6/17 9 329
    19/6/17 23 352
    20/6/17 21 373
    21/6/17 26 399
    22/6/17 22 421
    23/6/17 17 438
    24/6/17 13 451
    25/6/17 27 478
    26/6/17 19 497
    27/6/17 19 516
    28/6/17 19 535
    29/6/17 24 559
    30/6/17 30 589
    1/7/17 15 604
    2/7/17 17 621
    3/7/17 28 649
    4/7/17 26 675
    5/7/17 33 708
    6/7/17 28 736
    7/7/17 19 755
    8/7/17 23 778
    9/7/17 19 797
    10/7/17 29 826
    11/7/17 25 851
    12/7/17 22 873
    13/7/17 19 892
    14/7/17 19 911
    15/7/17 15 926
    16/7/17 11 937
    17/7/17 28 965
    18/7/17 21 986
    19/7/17 26 1012
    20/7/17 43 1055
    21/7/17 26 1081
    22/7/17 21 1102
    23/7/17 19 1121
    24/7/17 19 1140
    25/7/17 22 1162
    26/7/17 35 1197
    27/7/17 17 1214
    28/7/17 34 1248
    29/7/17 25 1273
    30/7/17 32 1305
    31/7/17 45 1350
    1/8/17 36 1386
    2/8/17 59 1445
    3/8/17 43 1488
    4/8/17 47 1535
    5/8/17 36 1571
    6/8/17 25 1596
    7/8/17 45 1641
    8/8/17 40 1681
    9/8/17 37 1718
    10/8/17 39 1757
    11/8/17 55 1812
    12/8/17 24 1836
    13/8/17 30 1866
    14/8/17 24 1890
    15/8/17 34 1924
    16/8/17 31 1955
    17/8/17 50 2005
    18/8/17 37 2042
    19/8/17 28 2070
    20/8/17 26 2096
    21/8/17 29 2125
    22/8/17 43 2168
    23/8/17 45 2213
    24/8/17 57 2270
    25/8/17 52 2322
    26/8/17 19 2341
    27/8/17 12 2353
    28/8/17 36 2389
    29/8/17 40 2429
    30/8/17 40 2469
    31/8/17 58 2527
    1/9/17 26 2553
    2/9/17 11 2564
    3/9/17 33 2597
    4/9/17 25 2622
    5/9/17 23 2645
    6/9/17 25 2670
    7/9/17 29 2699
    8/9/17 38 2737
    9/9/17 22 2759
    10/9/17 28 2787
    11/9/17 36 2823
    12/9/17 27 2850
    13/9/17 19 2869
    14/9/17 39 2908
    15/9/17 25 2933
    16/9/17 25 2958
    17/9/17 21 2979
    18/9/17 41 3020
    19/9/17 46 3066
    20/9/17 27 3093
    21/9/17 31 3124
    22/9/17 29 3153
    23/9/17 15 3168
    24/9/17 29 3197
    25/9/17 30 3227
    26/9/17 35 3262
    27/9/17 27 3289
    28/9/17 46 3335
    29/9/17 40 3375
    30/9/17 28 3403
    1/10/17 22 3425
    2/10/17 35 3460
    3/10/17 41 3501
    4/10/17 26 3527
    5/10/17 32 3559
    6/10/17 33 3592
    7/10/17 29 3621
    8/10/17 15 3636
    9/10/17 28 3664
    10/10/17 28 3692
    11/10/17 22 3714
    12/10/17 32 3746
    13/10/17 20 3766
    14/10/17 15 3781
    15/10/17 18 3799
    16/10/17 39 3838
    17/10/17 25 3863
    18/10/17 26 3889
    19/10/17 20 3909
    20/10/17 28 3937
    21/10/17 23 3960
    22/10/17 26 3986
    23/10/17 22 4008
    24/10/17 41 4049
    25/10/17 25 4074
    26/10/17 30 4104
    27/10/17 43 4147
    28/10/17 15 4162
    29/10/17 17 4179
    30/10/17 35 4214
    31/10/17 28 4242
    1/11/17 67 4309
    2/11/17 45 4354
    3/11/17 35 4389
    4/11/17 29 4418
    5/11/17 22 4440
    6/11/17 17 4457
    7/11/17 30 4487
    8/11/17 28 4515
    9/11/17 26 4541
    10/11/17 24 4565
    11/11/17 25 4590
    12/11/17 23 4613
    13/11/17 27 4640
    14/11/17 28 4668
    15/11/17 35 4703
    16/11/17 32 4735
    17/11/17 33 4768
    18/11/17 17 4785
    19/11/17 21 4806
    20/11/17 19 4825
    21/11/17 27 4852
    22/11/17 10 4862
    23/11/17 21 4883
    24/11/17 46 4929
    25/11/17 17 4946
    26/11/17 13 4959
    27/11/17 22 4981
    28/11/17 20 5001
    29/11/17 18 5019
    30/11/17 21 5040
    1/12/17 16 5056
    2/12/17 20 5076
    3/12/17 20 5096
    4/12/17 21 5117
    5/12/17 21 5138
    6/12/17 28 5166
    7/12/17 20 5186
    8/12/17 25 5211
    9/12/17 15 5226
    10/12/17 20 5246
    11/12/17 26 5272
    12/12/17 19 5291
    13/12/17 30 5321
    14/12/17 20 5341
    15/12/17 21 5362
    16/12/17 22 5384
    17/12/17 23 5407
    18/12/17 36 5443
    19/12/17 28 5471
    20/12/17 22 5493
    21/12/17 31 5524
    22/12/17 12 5536
    23/12/17 0 5536
    24/12/17 0 5536
    25/12/17 0 5536
    26/12/17 0 5536
    27/12/17 11 5547
    28/12/17 42 5589
    29/12/17 52 5641
    30/12/17 19 5660
    31/12/17 13 5673
    1/1/18 37 5710
    2/1/18 49 5759
    3/1/18 47 5806
    4/1/18 64 5870
    5/1/18 42 5912
    6/1/18 36 5948
    7/1/18 42 5990
    8/1/18 41 6031
    9/1/18 39 6070
    10/1/18 54 6124
    11/1/18 54 6178
    12/1/18 25 6203
    13/1/18 1 6204
    14/1/18 4 6208
    15/1/18 2 6210
    16/1/18 2 6212
    17/1/18 1 6213
    18/1/18 2 6215
    19/1/18 3 6218
    20/1/18 1 6219
    21/1/18 1 6220
    22/1/18 2 6222
    23/1/18 3 6225
    24/1/18 1 6226
    25/1/18 4 6230
    26/1/18 4 6234
    27/1/18 2 6236
    28/1/18 1 6237
    29/1/18 2 6239
    30/1/18 0 6239
    31/1/18 12 6251
    1/2/18 30 6281
    2/2/18 21 6302
    3/2/18 21 6323
    4/2/18 21 6344
    5/2/18 32 6376
    6/2/18 37 6413
    7/2/18 28 6441
    8/2/18 26 6467
    9/2/18 33 6500
    10/2/18 24 6524
    11/2/18 20 6544
    12/2/18 25 6569
    13/2/18 31 6600
    14/2/18 38 6638
    15/2/18 31 6669
    16/2/18 29 6698
    17/2/18 20 6718
    18/2/18 31 6749
    19/2/18 30 6779
    20/2/18 35 6814
    21/2/18 35 6849
    22/2/18 32 6881
    23/2/18 25 6906
    24/2/18 31 6937
    25/2/18 33 6970
    26/2/18 36 7006
    27/2/18 31 7037
    28/2/18 35 7072
    1/3/18 41 7113
    2/3/18 31 7144
    3/3/18 26 7170
    4/3/18 31 7201
    5/3/18 30 7231
    6/3/18 31 7262
    7/3/18 27 7289
    8/3/18 25 7314
    9/3/18 26 7340
    10/3/18 29 7369
    11/3/18 14 7383
    12/3/18 40 7423
    13/3/18 14 7437
    14/3/18 27 7464
    15/3/18 21 7485
    16/3/18 22 7507
    17/3/18 28 7535
    18/3/18 38 7573
    19/3/18 45 7618
    20/3/18 36 7654
    21/3/18 39 7693
    22/3/18 40 7733
    23/3/18 26 7759
    24/3/18 18 7777
    25/3/18 22 7799
    26/3/18 34 7833
    27/3/18 21 7854
    28/3/18 37 7891
    29/3/18 23 7914
    30/3/18 24 7938
    31/3/18 23 7961
    1/4/18 27 7988
    2/4/18 28 8016
    3/4/18 35 8051
    4/4/18 26 8077
    5/4/18 20 8097
    6/4/18 35 8132
    7/4/18 30 8162
    8/4/18 22 8184
    9/4/18 50 8234
    10/4/18 33 8267
    11/4/18 29 8296
    12/4/18 19 8315
    13/4/18 20 8335
    14/4/18 33 8368
    15/4/18 16 8384
    16/4/18 23 8407
    17/4/18 28 8435
    18/4/18 18 8453
    19/4/18 20 8473
    20/4/18 24 8497
    21/4/18 21 8518
    22/4/18 15 8533
    23/4/18 25 8558
    24/4/18 19 8577
    25/4/18 23 8600
    26/4/18 26 8626
    27/4/18 22 8648
    28/4/18 18 8666
    29/4/18 17 8683
    30/4/18 19 8702
    1/5/18 25 8727
    2/5/18 41 8768
    3/5/18 25 8793
    4/5/18 14 8807
    5/5/18 12 8819
    6/5/18 12 8831
    7/5/18 18 8849
    8/5/18 16 8865
    9/5/18 16 8881
    10/5/18 21 8902
    11/5/18 26 8928
    12/5/18 16 8944
    13/5/18 25 8969
    14/5/18 20 8989
    15/5/18 15 9004
    16/5/18 27 9031
    17/5/18 22 9053
    18/5/18 21 9074
    19/5/18 16 9090
    20/5/18 22 9112
    21/5/18 22 9134
    22/5/18 16 9150
    23/5/18 23 9173
    24/5/18 15 9188
    25/5/18 30 9218
    26/5/18 25 9243
    27/5/18 18 9261
    28/5/18 31 9292
    29/5/18 14 9306
    30/5/18 25 9331
    31/5/18 21 9352
    1/6/18 25 9377
    2/6/18 15 9392
    3/6/18 28 9420
    4/6/18 28 9448
    5/6/18 32 9480
    6/6/18 27 9507
    7/6/18 39 9546
    8/6/18 25 9571
    9/6/18 29 9600
    10/6/18 24 9624
    11/6/18 23 9647
    12/6/18 27 9674
    13/6/18 29 9703
    14/6/18 35 9738
    15/6/18 17 9755
    16/6/18 15 9770
    17/6/18 22 9792
    18/6/18 11 9803
    19/6/18 17 9820
    20/6/18 11 9831
    21/6/18 14 9845
    22/6/18 15 9860
    23/6/18 19 9879
    24/6/18 12 9891
    25/6/18 15 9906
    26/6/18 15 9921
    27/6/18 19 9940
    28/6/18 14 9954
    29/6/18 17 9971
    30/6/18 12 9983
    1/7/18 17 10000
    2/7/18 23 10023
    3/7/18 16 10039
    4/7/18 14 10053
    5/7/18 14 10067
    6/7/18 26 10093
    7/7/18 18 10111
    8/7/18 9 10120
    9/7/18 17 10137
    10/7/18 27 10164
    11/7/18 19 10183
    12/7/18 34 10217
    13/7/18 18 10235
    14/7/18 26 10261
    15/7/18 23 10284
    16/7/18 25 10309
    17/7/18 33 10342
    18/7/18 34 10376
    19/7/18 28 10404
    20/7/18 28 10432
    21/7/18 38 10470
    22/7/18 39 10509
    23/7/18 43 10552
    24/7/18 36 10588
    25/7/18 43 10631
    26/7/18 45 10676
    27/7/18 55 10731
    28/7/18 59 10790
    29/7/18 61 10851
    30/7/18 49 10900
    31/7/18 42 10942
    1/8/18 54 10996
    2/8/18 53 11049
    3/8/18 47 11096
    4/8/18 41 11137
    5/8/18 58 11195
    6/8/18 58 11253
    7/8/18 72 11325
    8/8/18 71 11396
    9/8/18 76 11472
    10/8/18 62 11534
    11/8/18 58 11592
    12/8/18 60 11652
    13/8/18 64 11716
    14/8/18 58 11774
    15/8/18 53 11827
    16/8/18 58 11885
    17/8/18 58 11943
    18/8/18 38 11981
    19/8/18 58 12039
    20/8/18 59 12098
    21/8/18 40 12138
    22/8/18 49 12187
    23/8/18 40 12227
    24/8/18 56 12283
    25/8/18 22 12305
    26/8/18 43 12348
    27/8/18 46 12394
    28/8/18 35 12429
    29/8/18 35 12464
    30/8/18 50 12514
    31/8/18 30 12544
    1/9/18 42 12586
    2/9/18 35 12621
    3/9/18 33 12654
    4/9/18 23 12677
    5/9/18 30 12707
    6/9/18 34 12741
    7/9/18 33 12774
    8/9/18 30 12804
    9/9/18 36 12840
    10/9/18 29 12869
    11/9/18 35 12904
    12/9/18 33 12937
    13/9/18 52 12989
    14/9/18 42 13031
    15/9/18 40 13071
    16/9/18 22 13093
    17/9/18 31 13124
    18/9/18 23 13147
    19/9/18 38 13185
    20/9/18 21 13206
    21/9/18 57 13263
    22/9/18 36 13299
    23/9/18 47 13346
    24/9/18 42 13388
    25/9/18 52 13440
    26/9/18 41 13481
    27/9/18 43 13524
    28/9/18 27 13551
    29/9/18 29 13580
    30/9/18 34 13614
    1/10/18 42 13656
    2/10/18 32 13688
    3/10/18 29 13717
    4/10/18 29 13746
    5/10/18 24 13770
    6/10/18 33 13803
    7/10/18 32 13835
    8/10/18 39 13874
    9/10/18 50 13924
    10/10/18 44 13968
    11/10/18 34 14002
    12/10/18 26 14028
    13/10/18 26 14054
    14/10/18 43 14097
    15/10/18 45 14142
    16/10/18 42 14184
    17/10/18 62 14246
    18/10/18 46 14292
    19/10/18 31 14323
    20/10/18 17 14340
    21/10/18 33 14373
    22/10/18 32 14405
    23/10/18 21 14426
    24/10/18 33 14459
    25/10/18 25 14484
    26/10/18 21 14505
    27/10/18 10 14515
    28/10/18 23 14538
    29/10/18 9 14547
    30/10/18 34 14581
    31/10/18 29 14610
    1/11/18 31 14641
    2/11/18 34 14675
    3/11/18 18 14693
    4/11/18 38 14731
    5/11/18 33 14764
    6/11/18 30 14794
    7/11/18 27 14821
    8/11/18 27 14848
    9/11/18 32 14880
    10/11/18 29 14909
    11/11/18 29 14938
    12/11/18 27 14965
    13/11/18 31 14996
    14/11/18 24 15020
    15/11/18 30 15050
    16/11/18 17 15067
    17/11/18 12 15079
    18/11/18 23 15102
    19/11/18 22 15124
    20/11/18 23 15147
    21/11/18 32 15179
    22/11/18 32 15211
    23/11/18 12 15223
    24/11/18 19 15242
    25/11/18 33 15275
    26/11/18 23 15298
    27/11/18 24 15322
    28/11/18 29 15351
    29/11/18 28 15379
    30/11/18 36 15415
    1/12/18 32 15447
    2/12/18 33 15480
    3/12/18 48 15528
    4/12/18 40 15568
    5/12/18 39 15607
    6/12/18 38 15645
    7/12/18 26 15671
    8/12/18 14 15685
    9/12/18 31 15716
    10/12/18 43 15759
    11/12/18 35 15794
    12/12/18 40 15834
    13/12/18 46 15880
    14/12/18 34 15914
    15/12/18 41 15955
    16/12/18 44 15999
    17/12/18 51 16050
    18/12/18 52 16102
    19/12/18 57 16159
    20/12/18 57 16216
    21/12/18 39 16255
    22/12/18 47 16302
    23/12/18 46 16348
    24/12/18 48 16396
    25/12/18 29 16425
    26/12/18 36 16461
    27/12/18 62 16523
    28/12/18 70 16593
    29/12/18 50 16643
    30/12/18 62 16705
    31/12/18 50 16755
    1/1/19 81 16836
    2/1/19 90 16926
    3/1/19 116 17042
    4/1/19 96 17138
    5/1/19 72 17210
    6/1/19 96 17306
    7/1/19 122 17428
    8/1/19 133 17561
    9/1/19 122 17683
    10/1/19 102 17785
    11/1/19 113 17898
    12/1/19 101 17999
    13/1/19 118 18117
    14/1/19 129 18246



  • @Misto I have no idea how you did this, but it’s good! Nice to see steady growth, and also a welcome sight to see the numbers ramping up now. Successful marketing campaign by the looks of things, and would be interesting to see when FI capitalise on this for the share split.
    Cheers @Misto, your hard work is very appreciated!



  • @Misto you bloody nutter 😄 I can believe your eyes are bleeding. Great work- you “took one for the team” there. Keep this up and FI will employ you.
    So the graphs are self explanatory- but the raw data, the first part is the date, but the second number is what? Total users?



  • @Valhalla date, sign ups that day, total users I think?



  • @GregF said in This Just Took Me 6 Hours Manual Data Mining - Appreciate:

    @Misto I have no idea how you did this, but it’s good! Nice to see steady growth, and also a welcome sight to see the numbers ramping up now. Successful marketing campaign by the looks of things, and would be interesting to see when FI capitalise on this for the share split.
    Cheers @Misto, your hard work is very appreciated!

    @Misto I'll second what @GregF wrote, amazing work mate 💪🏻💪🏻💪🏻



  • @GregF gotcha. Makes sense now, cheers. P.s the guy who signed up 12.04 on New Year’s Eve had blatantly got dumped by his girlfriend and was sleeping in the car.



  • @GregF yep just that. Spreadsheet headers didn't copy and paste over to well, but I was done. So I left it off centre sorry.



  • You are a psychopath 😲



  • @Misto Impressive Misto. Sorry if i created work for you...

    I wonder what the average amount deposited is from those new users. That's aimed at FI by the way, not you! Hopefully they love this as much as we do and put in more money as they progress.

    I almost guarantee the amount deposited will increase post-split even though dividends in real-term stay the same. The effect of lowering prices.

    What this means for us, and what we should aim for is a lower average (and median) portfolio value spread over a large amount of users, as opposed to very large portfolios dominating. This lowers the risk and makes it more secure.

    Oh, and what a strange decision to make on NYE!



  • What the actual fook...



  • @Misto no apologies necessary mate, you did far more than I would have ever done!!



  • @Metropolis_山の中の市 looking at this data I'm half expecting a large deposit spike in a few months with the larger than normal sign ups. Logic is, I think most new users start with a small deposit than once they find their feet, they jump in with real money. I know I did that and alot if others aswell.



  • @Misto absolutely. That’s how everyone starts unless you are a bit nuts 🥜



  • Great info...gives us all confidence for future trading



  • Well done that man.



  • Nice work!



  • @Misto mate great work!

    How did you work out the new user sign ups though I am interested?



  • @B1992G Just to be clear it only new users signing up to the forum, not everyone that has signed up to Football Index as awhole. I still think this is useful because we can reasonably assume that overall new users to the index is relative to the number of new users on the forum.

    I went to https://forums.footballindex.co.uk/users?page=767 which shows the forum users. Then if you move your mouse over the "2 years ago" "11 months ago" ect it gives you the exact date and time that user signed. I then went through all 767 pages like that inputting them into a spreadsheet to find the any treads.



  • @Misto Jesus you don't waste your evenings do you haha!!

    great work



  • Great work cheers


Log in to reply
 

Looks like your connection to Forum was lost, please wait while we try to reconnect.