data leakage on `random-acts-of-pizza`

[dexhunter]

Description

The field giver_username_if_known can be exploited by agent to achieve perfect prediction

This field directly reveals the outcome:

• If giver_username_if_known != "N/A" → Someone gave pizza → Request was successful (100% correlation)
• If giver_username_if_known == "N/A" → No known giver → Request likely failed

The solution would be removing this field. Let me know if this makes sense, if so, could the team please add this to known issue section in README? Thank you in advance!

[thesofakillers]

Seems like this leakage is present in the kaggle competition itself:

• https://www.kaggle.com/competitions/random-acts-of-pizza/discussion/10411
• https://www.kaggle.com/competitions/random-acts-of-pizza/discussion/8341

So a fix where we drop the field isnt really feasible without diverging from the leaderboard.

I'd suggest dropping this competition entirely as the fix to catalogue in known issues. cc @joe-needham / @benarnav

[joe-needham]

Thanks for flagging, #109 catalogues this issue now!