tuantran/local_leaderboard_run

#2

This PR changes the default DATASET_CONFIG and EXAMPLES_CONFIG to accept the "user-defined" dataset and make it co-exist with the S3-locating ones in the defaul setting.

In addition, we ensure the files in these local datasets can be displayed in the browser by introducing a new route ("/files"), which will open the binary streamf of the team and strealine the content to the client machine

To test this, follow the README file, then uncomment the line #7 in backend/config.py and comment line #9 (switching ABS_DATASET_PATH to local "./data") and run gunicorn, to see if the local data is properly loaded.

AI at Meta org

This PR changes the default DATASET_CONFIG and EXAMPLES_CONFIG to accept the "user-defined" dataset and make it co-exist with the S3-locating ones in the defaul setting.

In addition, we ensure the files in these local datasets can be displayed in the browser by introducing a new route ("/files"), which will open the binary streamf of the team and strealine the content to the client machine

antoinetran changed pull request status to open

Just qq in your comments it says serve_file_path can serve for S3 but think its just locally as it is now? Otherwise lgtm - nice you can configure the local load directory!

Also this HF UI is so bad, can't even comment on the files

valeriulacatusu changed pull request status to merged
AI at Meta org

@mduppes yeah you are right - it is just local for now. I think we could extend to other path / urls

Sign up or log in to comment