I update this menu list as I continue development:
I thought it would be cool to go on a journey and create something. I used to work in the computer game industry, where I would frequent studios like, getting the low down on things before most, get to play games months before any release day. One thing I found interesting is the studios spend loads of time looking at social media to help make design decisions or pin point issues. There is a plethora of information publicly available on the WWW. I'm super interested in free text and documentation classification. So, I'm going on a little bit of a mission.. create a rough platform that would help munge all this data in one place. Below is a few things that come to mind: DATASETS YOUTUBE Probably starting with the data apis, from my very thorough 2 minute read I can tell that there is some possibility to search for videos containing key words. Same as youtube, Reddit has a developer section for APIS. I could get all the latest or greatest community information from sub-reddits like r/callofduty or r/destiny. Using keywords, I could create a call from the Twitter API's for any hashtags for these games. FORUMS This is a tricker one, no API's but hey... if it's on the net it should be easy-ish. TOOLS n STUFF LANGUAGE Since leaving my last role (where I coded in python for 4.5 years), I have forced myself to only use Java for all things backend. The first couple of months sucked, but I found when I went back to Python I saw myself missing Java in pretty quick succession, so I have become a nipple high wearing tracksuit wearing Java developer.... sue me. I will probably use some Angular to do stuff and attempt to make something pretty with bootstrap. DATA STORAGE This is going to be an interesting one as I'm primarily working with text... I'm going to have a go at some graph databases, of which I seem to always get pointed to Neo4j. This will be my first time in Neo4j , so I will be a newbie and plenty of forgiveness is needed. OTHERSTUFF I will use a bunch of text based data mining techniques like sentiment analysis for measuring things like subjectivity and objectivity, which is going to be interesting due to the language gamers use to show delight or loathing is not usually typical to normal text. I will probably use jsoup as a parser for any sites that don't have any API'S. Before I start on this journey I have a few things to ask:
I plan to have a pretty crappy version up and running before the large Destiny release in September, so I can see if this even works. Hold tight! It's going to be a rough ride (mainly for me!). Go to my next post to see more
0 Comments
Leave a Reply. |
AuthorNew Zealand big data nerd, facial hair sculptor and classic car fanatic. Owner of needles.io, freelance big data consultant, ex Activision. Archives
April 2016
Categories |