8th-9th June
I have been busy creating the entity relationships, you can see a screen shot of the data for Destiny Activities and the associated relationships. You can see already it's not very clean, two entries for the same activity (inherited from the dubious website I ripped it from).
Another way ensure we only have unique entity nodes is to issue a statement in Neo4j like so:
"CREATE CONSTRAINT ON (activity:Activity) ASSERT activity.isbn IS UNIQUE;" If you try and create the same node, Neo4J will issue you something back like this: "Neo.ClientError.Schema.ConstraintViolation" I am also tackling these duplicate entries by writing each entry into a hashset and if it doesn't exist, write it to a JSON Array: if (!hs.contains(finalNodes.toString())) {
12th June
I finished off the entity JSON create scripts and now I'm working back on what I call the NEO4J utils library and it's going really well! I built a class with a couple of functions which create nodes and relationships (using the restful APIs), tested it end to end to ensure it all worked, as you can see below it's only two nodes but it's great to see it working:
More progress: Things are starting to get exciting, I just did a test load of all the medal entities, you can see below I haven't added the relationships but in an hour (probably a day) or so I plan to have that running.
Some time later: I made some pretty good progress with the entities and the relationships, after 2 weeks of automating I have the Destiny medals and their relationships all stored in NEO4J. Below you can see a video where I did a "MATCH ALL" type query to see all my hard work in action!
What you're seeing: "Medals" in pink, "Medal Types" in yellow and "Medal Weight" in red. All the lines joining the nodes are relationships
It's fair to say I'm getting pretty amped about this, I need to spend some time mapping out what's next, I'm assuming that I'm going to be stepping into document classification using Reddit posts.
Go to my next post
1 Comment
HAZZA
8/14/2017 07:36:59 pm
frgergrg
Reply
Leave a Reply. |
AuthorNew Zealand big data nerd, facial hair sculptor and classic car fanatic. Owner of needles.io, freelance big data consultant, ex Activision. Archives
April 2016
Categories |