Work, day 33

So my equation parser now seems to work very well. The extraction of parts seems to work in almost all cases. It’s now just a matter of getting it to correctly interpret signs, which is actually really annoting (the extractor is already at over 3000 lines, and that’s just the part that extracts… not the classifier or preprocessing for extraction or tagging for extraction).
Also got systems parsing (i.e. You work at a job that makes $5/hour and you would get a bonus of $200. You could get a new job that makes $7/hour.) working relatively well. It was annoying getting it to work correctly with years (things like “In 1916, there were…”).
Overall though, I’m happy with my parser.

Passed two more 10-rating songs in ITG today-Hispanic Panic with a B and Bend Your Mind with a B-. I actually really like Bend Your Mind… the steps it in seem completely random and stuff, but it has hands (which I love), and it has amazingly fun (but difficult) crossover holds. Wheeee.
Also came close to an S+ in Land of the Rising Sun (93.39%).

Currently at Alan and Shawn’s house watching movies. Tomorrow is stuff with Tim at his apartment. Sunday is Yearbook proofing. The following week is my last week of work. Time is really flying by…

Ben playing doubles:

You meet the most awesome people playing ITG… this makes three people now I’ve met through ITG.
Whee!

Work, day 20

Work today was kinda slow. I spent most of the morning working on more edge cases for extraction. In the afternoon, I ran various classification experiments to take advantage of the modified tagging. That took about 3 hours to find the optimal algorithms.
Then, all happy, I go to actually create the classifiers.

And get errors.
Well, damn.
So yeah… I basically spent all day getting nothing done. Bleh.

While classification experiments were running, I went and read through my old journal. Read through the 2.5 years of entries. It’s amazing how much my journal has changed and evolved. It’s fun going back and seeing how I was feeling at various times throughout the past few years. Whee. It also occurs to me how boring my journal has gotten. But still, it makes me happy to write about random things, and that’s really the point of this journal.

Dream posts are always fun. Um… so last night I had a dream that I married a porn star. It was very odd. And that’s all I remember, unfortunately.

So I’m feeling really weird today. I’m happy, yes, but there’s a feeling I can’t quite place… nostalgia? Pride? Acceptance? I don’t know.

Wheee.
Tire tracks in mud… so simple, but so pretty.

Various foo

Went to the Allies movie night tonight and saw Rent. It’s a really good film… makes me kinda want to see the Broadway production now. Dunno.

Work today went well. After trying various optimizations on the classification algorithms, I got accuracy to drop and go up… eventually getting a more-or-less best-for-now accuracy of 91%. Not bad at all. Then worked a bit on the extractor. Initial tests gave it a 49% accuracy on extraction… was able to quickly get it up to 75%, and then spent the rest of the day getting it up to 82%. Going to see if I can’t do better tomorrow. The problem is that the ones its missing now are the problems without explicit givens (for example, “How long was the candle when it started burning?” vs. “How long has it been burning if the candle is 6 inches tall?” which I can parse). Meh. Boo for edge cases and special casing everything.

Um… so yeah. Downloaded some of my favorite Rent songs from iTunes (strangely, I’m not too fond of the cover song, “Seasons of Love,” but that might just because I heard it so many times during the movie). A lot of this suff is really good. This music makes me happy. :) Thinking about either getting an iPod or some card games. Which one do people think would be better? Honestly, I’m not sure how much usage I would get out of either. It would be nice to have all my music on the go with me, but I don’t really *need* an iPod, nor do I have that much time to listen to music when I’m not at my computer anyway. The cards would be nice to collect (and some of them are stuff I’ve been looking for for a while), but unless there’s people to play with me, they’re relatively useless as well.

Havn’t taken any pictures in the past 2 days, so here’s a picture of the cloud factory I took last week. Havn’t photoshopped this one at all… maybe I should a bit. Dunno. I think it looks pretty good as it is.

Life is good :D
I’m so lucky in life. Why do I sometimes lose sight of that?

Work, day 17

Yeah so, today I got into work, wrote the final code for the number extraction, wrote a test suite for the entire parser, and hit run.

And got a ClassCastException.
A little bit of WTFing, and I discovered that what I thought were serialized Classifiers were actually serialized Results. Gaah. Spent about an hour regenerating the actual classifiers (luckily I got a new, faster computer so the experiments didn’t take 2 days…).
Then I hit run again.
Just like that, I had an 85% accuracy on the solution classification. I can raise that by improving my preprocessing (the way I’m currently tagging things is faulty). That’s on my todo list for tomorrow. Then, it’s tracking down the errors and seeing if they are easily fixable.
Notes to self: Add in negative ability (- sign, etc) and allow for multiple numbers in a single span.

So yeah… in the 5 hours I had at work today, I accomplished more than I had for the past 6 work days.

Came home feeling completely happy with myself. Amazing how much work manages to affect my mood, even when I don’t think it does. Yesterday I was feeling kinda meh because I hadn’t gotten much (read: anything) done at work. Today I got a lot done. Yay!
Can’t help but feel like I’m still a little behind, but whatever.

Pounded out a prelimary card list for Student Wars: Internships… not that anyone really cares. Will have cards for the PSLC interns and introduce the PSLC faction… which will do something that I’m not quite sure of yet :-P

Pipe! Whee!

Oh, and PICKLES!!! AHHHHH!!
XD XD XD

And thanks to chrisamaphone… WTF WTF WTF

Work, day 10

Whee today was really eventful…

So the morning was really unproductive. I spent it tinkering with my basic text parser to parse the samples into individual “training” files with the correct annotations, and failing miserably. Tinkered with MinorThird stuff and failed at understanding it. Also wrote a huge introspective LJ entry that made me feel a lot better about myself (again)… amazing how writing can help you deal with things, even if it’s not stuff anyone will ever (or will ever have the chance to) read.

Had lunch with Pooja again, and got delicious cookies. Then came back to campus to meet with Quinten (the research programmer)… in about 2 hours, I clarified the problem for him (he was misunderstanding the inputs and such), and we came up with a plan for me to tackle the task… so now I know what I’m doing Monday (and, if I feel motivated enough, this weekend). He’s amazing.

Plan of attack:
Write a pre-processor to do initial tagging of inputs (training data included) and manually annotate training data and write a Mixup program to tag numbers. Use this to extract numbers and given units. Also use it to train classifiers for the conversion type and the given column. Save said classifiers and build a parser that utilizes them when given new unlabelled input. Get MinorThird’s GUI running on my computer at work so all this is possible.

So yeah, I’m feeling a lot better about work… and life in general is still amazing and happy.
I knew I could do it :)

It’s weird… there are people all around me in relationships and hooking up (even in our small group of interns)… and for once, I’m not jealous. I don’t feel left out. It’s a good feeling.
I am missing a certain someone though… a lot… but that’s okay.

Also, I am covered in mosquito bites right now, but it was so worth it. A bunch of KGB peoples went to Frick park (funny… I work in the Frick building downtown), and we had a huge campfire complete with marshmallows, bad stories, and friends. I have pictars up in photos

Went to Eat n’ Park with bohanlon afterward too. Wheee.

My iTunes library has had its biggest infusion of new music in a while. Between the $25 of music from the gift card, and the Cascada CD I ripped from Ally today, there’s over 40 new songs in my library, which is now at 1648 songs. Yay music!

I’ve been experimenting a lot with my artistic shots lately…
I like this a lot better than the full-color one

Ditto with this one (original)

Dunno… it draws your attention more to the relevant parts, and I really like the contrast.

Hmmm… in this one, I think it hurts the overall image more than it helps (original here)… dunno… you just lose the warmth of the fire when you don’t see its light on the other people…

Life is good :)