Here is a nice informative PhD thesis on Reinforcement Learning. Really does a nice job in Chapter 2.2.3 explaining the use of Boltzmann distribution and Q-values. http://www.compapp.dcu.ie/~humphrys/PhD/ch2.html
Swarms within the internet
I was wondering if I had access to the data that AddThis collects if I could identify swarming within the data using the Shapley value idea? Might be interesting.
Github
I am going to be moving the projects that I had as zip files on google code to Github in order to centralize my source code. Hopefully it will be easier to use.
Visualizing Complexity Results
https://app.box.com/s/pd6jz1124xsx5kgvz5i4 I found this image here. I thought it did a good job of visualizing the complexity space. It seems like they have some interesting posts as well.
Chicken Teriyaki
Well I am going to try and make chicken teriyaki. I bought Kikkoman teriyaki sauce and some chicken and I found a recipe for how to cook the chicken that sounds good. So, I will let you know how it goes. If it tastes good I will have another thing I can make that I like!
What is #P (Sharp P)
#P is the set of counting problems whose corresponding decision problem is in NP. Or more formally (from here): A function [math]f:left{0,1right}^*rightarrow mathbb{N}[/math] is in #[math]bf{P}[/math] if there exists a polynomial [math]p: mathbb{N}rightarrow mathbb{N}[/math] and a polynomial-time TM (turing machine) M such that for every [math]xin left{0,1right}^*[/math] [math]f(x)=left|{left{yin left{0,1right}^{p^{(|x|)}}:M(x,y)=1right}}right|[/math]. I later intend to find a proof or develop… Continue reading What is #P (Sharp P)
No Free Lunch (NFL)
My friend Indranil introduced me to the theory of “No Free Lunch”. From Wikipedia article: A conventional, but not entirely accurate, interpretation of the NFL results is that “a general-purpose universal optimization strategy is theoretically impossible, and the only way one strategy can outperform another is if it is specialized to the specific problem under consideration”… Continue reading No Free Lunch (NFL)
Java 3D and Mason
Well I got MASON installed and working. The 3D simulations are pretty neat. But you need to get Java 3D and install it. Some things to remember to speed the process of setting up netbeans for MASON would be that in order to add dll files you need to add something like: -Djava.library.path=”C:Program FilesJavaJava3D1.5.1bin” to the… Continue reading Java 3D and Mason
Web intents seem like a good idea. Can’t wait for chrome to make them available again.
Nonogram
There is a nonogram puzzle game for the kindle fire that I like to play. While I was reading about #P complete on wikipedia I somehow got to 2SAT problems and saw that nonogram’s can be formed as 2SAT problem so as to solve in polynomial time (at least when the heuristics work). Otherwise the problem… Continue reading Nonogram