FanPost

[Plan] Basketball data gathering and number crunching

Hey guys,

I've been planning to write about this for quite some time. By the end of April I'll finish my second semester studying mathematical statistics, and I have already studied some econometrics before and I'm starting to "get it" (although I'll admit that I need to improve).

I would like to start up some kind of project of my own, doing some basketball data analysis. Before starting out, I plan to gather as much available data from the internet as possible.

What I am planning to do:

  • Create a database from online available data for input.
  • Since I don't have the hardware (or the money) to share this data, I plan to share the scripts that build the database.
  • Do a methodology research on current analytic models.
  • Do some modelling.
The software I'm planning to use would be
  • python3 for fetching the data and generating the database
  • postgresql for storing and managing the data
  • and R for analysis.
First of all, I plan to get every possible bit of information from basketball-reference, including
  • parsing play-by-play data
  • and parsing shot charts (I promised this to vjl)
If you have any suggestions from where I can download _raw_ data, or suggestions about how the DB should look like or suggestions about stuff to read, I'd be very thankful. Note that I don't need the data to be in a fancy format (like csv or whatever), I just need it to be parseable. Also I promise to share anything I stumble upon.
Whoever's interested could write me here or if there's a PM possible here somewhere, drop me one and I'll send my email address.
The project is a semi-longterm one, that is, I'd like to come up with some results by the end of August. I hope something nice will come out of it for all of us.
PS. (Only very loosely related) If you haven't already known: www.quandl.com is something of a must for anyone interested in data.
X
Log In Sign Up

forgot?
Log In Sign Up

Please choose a new SB Nation username and password

As part of the new SB Nation launch, prior users will need to choose a permanent username, along with a new password.

Your username will be used to login to SB Nation going forward.

I already have a Vox Media account!

Verify Vox Media account

Please login to your Vox Media account. This account will be linked to your previously existing Eater account.

Please choose a new SB Nation username and password

As part of the new SB Nation launch, prior MT authors will need to choose a new username and password.

Your username will be used to login to SB Nation going forward.

Forgot password?

We'll email you a reset link.

If you signed up using a 3rd party account like Facebook or Twitter, please login with it instead.

Forgot password?

Try another email?

Almost done,

By becoming a registered user, you are also agreeing to our Terms and confirming that you have read our Privacy Policy.

Join Canis Hoopus

You must be a member of Canis Hoopus to participate.

We have our own Community Guidelines at Canis Hoopus. You should read them.

Join Canis Hoopus

You must be a member of Canis Hoopus to participate.

We have our own Community Guidelines at Canis Hoopus. You should read them.

Spinner.vc97ec6e

Authenticating

Great!

Choose an available username to complete sign up.

In order to provide our users with a better overall experience, we ask for more information from Facebook when using it to login so that we can learn more about our audience and provide you with the best possible experience. We do not store specific user data and the sharing of it is not required to login with Facebook.

tracking_pixel_9347_tracker