I just read an article about whale falls. They say the only way to find them so far is basically by accident. They describe these zombie worms that have been so far found at the sites of these falls. Why don’t they inject something into the worms that is traceable and transferable to its offspring.… Continue reading Tracking Zombie Worms
Category: thoughts
Q-Learning with delayed updates
I’m sure someone has thought of this, but I didn’t look. So, what if we delayed the update of the q-value and the policy for x number of time steps. We would keep track of the history and create an average reward. Initialize the policy for each action to be 1/|A| so that we can… Continue reading Q-Learning with delayed updates
ScraperWiki
I found this cool service call ScraperWiki. It allows you to write python, ruby or php scraper as well as a view. You can make the data public so others can view or private. You can also make a view for your data! So I think this is awesome!!! I think for my Adv. AI class… Continue reading ScraperWiki
Bayesian game?
What if we have a stochastic game S and a set of agents A and in each game s we might have a different subset of A playing? What type of game is that? This of course is only relevant when dealing with |A| > 2 agents. Also, the agents that play in each s… Continue reading Bayesian game?
Stochastic Coalitional Game Theory
In my MAS class I am creating a stochastic normal-form game engine and one of the suggested elaborations is to look at coalitional games. So, I was like what if the coalition games were played in a stochastic game setting? So what is that? Well based on these people at USC it is: A real-world adversary… Continue reading Stochastic Coalitional Game Theory
Swarm of text
Can we use the Shapley idea to determine if there is a swarm on twitter based on tweets? A swarm could be thought as a lot of retweets or a tweet with similar words. We could find old tweet swarms characterize them and use them to predict whether certain tweets will become swarms. I think… Continue reading Swarm of text
Swarms within the internet
I was wondering if I had access to the data that AddThis collects if I could identify swarming within the data using the Shapley value idea? Might be interesting.
No Free Lunch (NFL)
My friend Indranil introduced me to the theory of “No Free Lunch”. From Wikipedia article: A conventional, but not entirely accurate, interpretation of the NFL results is that “a general-purpose universal optimization strategy is theoretically impossible, and the only way one strategy can outperform another is if it is specialized to the specific problem under consideration”… Continue reading No Free Lunch (NFL)
Another too difficult CV problem
Take a picture of equations and convert to text to be able to run through something like wolfram alpha.
Distributed 3d modeling using smartphones
You and your friends want to make a 3d model of something big!! Not just a toy or person. Rather your neighborhood or house. Something big. So the idea is to stitch together distributed 2d video to create a 3d model. You would use your smartphones that have gps, bluetooth, accelerometer, altitude data and compass. Send… Continue reading Distributed 3d modeling using smartphones