Site visitors since 01/01/03
AI teaching itself to communicate
Training agents to invent a language - We've just released initial results in which we teach AI agents to create language by dropping them into a set of simple worlds, giving them the ability to communicate, and then giving them goals that can be best achieved by communicating with other agents. If they achieve a goal, then they get rewarded. We train them using reinforcement learning and, due to careful experiment design, they develop a shared language to help them achieve their goals.
Our approach yields agents that invent a (simple!) language which is grounded and compositional. Grounded means that words in a language are tied to something directly experienced by a speaker in their environment, for example, a speaker forming an association between the word "tree" and images or experiences of trees. Compositional means that speakers can assemble multiple words into a sentence to represent a specific idea, such as getting another agent to go to a specific location.
We use discrete communication actions (messages formed of separate, word-like symbols) sent over a differentiable communication channel. A communication channel is differentiable if it allows agents to directly inform each other about what message they should have sent at each time step, by slightly altering their messages to make a positive change in the reward both agents expect to receive. Agents accomplish this by calculating the gradient of future reward with respect to changes in the sent messages (i.e. how much rewards would change with different messages). For example, if one agent realizes that it could have performed a task better if a second agent had sent different information, the first agent can tell the second exactly how to modify its messages to make them as useful as possible. In other words, agents ask the question: 'how should I modify my communication output to get the most communal reward in the future?'.
Previous efforts achieved this sort of differentiable communication by having the agents send a vector of real numbers or a continuous approximation to binary values to each other, or used non-differentiable communication and training. We use the Gumbel-Softmax trick, to approximate discrete communication decisions with a continuous representation during training. This gets us the best of both worlds: during training the differentiable channel means agents can rapidly learn how to communicate with each other via using continuous representation, which at the end of training ends up converging on discrete outputs that are more interpretable and show traits like compositionality.
In the video that follows, we show how our agents evolve languages to fit the complexity of their situation, with solitary agents not needing to communicate, two agents inventing one-word phrases to coordinate with each other in simple tasks, and three agents composing multiple words in sentences to accomplish more challenging tasks.
As of April 23, 2015 - Please Donate
Please Support Keelynet and
help spread the weirdness...
You can download or order our ebooks on CD. We also have unusual DVDs that you might find of interest. And our Collections of files to save you money with ebooks on John Keely, Walter Russell, Chandra Bose, Rejuvenation, Homeopathy and much, much more.
DVD - the Physics of Crystals, Pyramids and Tetrahedrons
This is a wonderful duel DVD set lasting 2 hours and which presents one man's lifelong study of pyramids, crystals and their effects. Several of his original and very creative experiments are explained and diagramed out for experimenters. These experiments include;
1) transmutation of zinc to lower elements using a tetrahedron,
2) energy extraction from a pyramid,
3) determining mathematic ratios of nature in a simple experiment,
4) accelerating the growth of food,
5) increasing the abundance of food,
6) how crystals amplify, focus and defocus energy,
7) using crystals to assist natural healing,
8) how the universe uses spirals and vortexes to produce free energy and MORE...
KeelyNet BBS Files w/bonus PDF of 'Keely and his Discoveries'
Finally, I've gotten around to compiling all the files (almost 1,000 - about 20MB and lots of work doing it) from the original KeelyNet BBS into a form you can easily navigate and read using your browser, ideally Firefox but it does work with IE. Most of these files are extremely targeted, interesting and informative, I had forgotten just how much but now you can have the complete organized, categorized set, not just sprinklings from around the web. They will keep you reading for weeks if not longer and give you clues and insights into many subjects and new ideas for investigation and research. IN ADDITION, I am including as a bonus gift, the book (in PDF form) that started it all for me, 'Keely and his Discoveries - Aerial Navigation' which includes the analysis of Keely's discoveries by Dr. Daniel G. Brinton. This 407 page eBook alone is worth the price of the KeelyNet BBS CD but it will give you some degree of understanding about what all Keely accomplished which is just now being rediscovered, but of course, without recognizing Keely as the original discoverer. Chapters include; Vibratory Sympathetic and Polar Flows, Vibratory Physics, Latent Force in Interstitial Spaces and much more. To give some idea of how Keely's discoveries are being slowly rediscovered in modern times, check out this Keely History. These two excellent bodies of information will be sent to you on CD. If alternative science intrigues and fascinates you, this CD is what you've been looking for...
- More Info
'The Evolution of Matter' and 'The Evolution of Forces' on CD
Years ago, I had been told by several people, that the US government frequently removes books they deem dangerous or 'sensitive' from libraries. Some are replaced with sections removed or rewritten so as to 'contain' information that should not be available to the public despite the authors intent. A key example was during the Manhattan Project when the US was trying to finalize research into atomic bombs. They removed any books that dealt with the subject and two of them were by Dr. Gustave Le Bon since they dealt with both energy and matter including radioactivity. I had been looking for these two books for many years and fortunately stumbled across two copies for which I paid about $40.00 each. I couldn't put down the books once I started reading them. Such a wealth of original discoveries, many not known or remembered today. / Page 88 - Without the ether there could be neither gravity, nor light, nor electricity, nor heat, nor anything, in a word, of which we have knowledge. The universe would be silent and dead, or would reveal itself in a form which we cannot even foresee. If one could construct a glass chamber from which the ether were to be entirely eliminated, heat and light could not pass through it. It would be absolutely dark, and probably gravitation would no longer act on the bodies within it. They would then have lost their weight. / Page 96-97 - A material vortex may be formed by any fluid, liquid or gaseous, turning round an axis, and by the fact of its rotation it describes spirals. The study of these vortices has been the object of important researches by different scholars, notably by Bjerkness and Weyher. They have shown that by them can be produced all the attractions and repulsions recognized in electricity, the deviations of the magnetic needle by currents, etc. These vortices are produced by the rapid rotation of a central rod furnished with pallets, or, more simply, of a sphere. Round this sphere gaseous currents are established, dissymetrical with regard to its equatorial plane, and the result is the attraction or repulsion of bodies brought near to it, according to the position given to them. It is even possible, as Weyher has proved, to compel these bodies to turn round the sphere as do the satellites of a planet without touching it. / Page 149 - "The problem of sending a pencil of parallel Hertzian waves to a distance possesses more than a theoretical interest. It is allowable to say that its solution would change the course of our civilization by rendering war impossible. The first physicist who realizes this discovery will be able to avail himself of the presence of an enemy's ironclads gathered together in a harbour to blow them up in a few minutes, from a distance of several kilometres, simply by directing on them a sheaf of electric radiations. On reaching the metal wires with which these vessels are nowadays honeycombed, this will excite an atmosphere of sparks which will at once explode the shells and torpedoes stored in their holds. With the same reflector, giving a pencil of parallel radiations, it would not be much more difficult to cause the explosion of the stores of powder and shells contained in a fortress, or in the artillery sparks of an army corps, and finally the metal cartridges of the soldiers. Science, which at first rendered wars so deadly, would then at length have rendered them impossible, and the relations between nations would have to be established on new bases."
- More Info
High Voltage & Free Energy Devices Handbook
This wonderfully informative ebook provides many simple experiments you can do, including hydrogen generation and electrostatic repulsion as well as the keys to EV Gray's Fuelless Engine. One of the most comprehensive compilations of information yet detailing the effects of high voltage repulsion as a driving force. Ed Gray's engine produced in excess of 300HP and he claimed to be able to 'split the positive' energy of electricity to produce a self-running motor/generator for use as an engine. Schematics and tons of photos of the original machines and more! Excellent gift for your technical friends or for that budding scientist! If you are an experimenter or know someone who investigates such matters, this would make an excellent addition to your library or as an unforgettable gift. The downloadable HVFE eBook pdf file is almost 11MB in size and contains many experiments, photos, diagrams and technical details. Buy a copy and learn all about hydrogen generation, its uses and how to produce electrostatic repulsion. - 121 pages
- More Info
Hypnosis CD - 3 eBooks with How To Techniques and Many Cases
If you have a few minutes, you might want to read my page on hypnosis and all the amazing things associated with its application. Included is an experience I had when I hypnotized a neighbor kid when I was about 14. As well the hypnotic gaze of snakes, the discovery of 'eyebeams' which can be detected electronically, the Italian Hypnotist Robber who was caught on tape with his eyes glowing as cashiers handed over their money and remembered nothing, glamour and clouding the mind of others, several methods of trance induction and many odd cases, animal catatonia, healing, psychic phenomena, party/stage stunts, including my favorite of negative hallucination where you make your subject NOT see something...much more...if nothing else, its might be a hoot to read.
- More Info
14 Ways to Save Money on Fuel Costs
This eBook is the result of years of research into various methods to increase mileage, reduce pollution and most importantly, reduce overall fuel costs. It starts out with the simplest methods and offers progressively more detailed technologies that have been shown to reduce fuel costs. As a bonus to readers, I have salted the pages with free interesting BONUS items that correlate to the relevant page. Just filling up with one tank of gas using this or other methods explained here will pay for this eBook. Of course, many more methods are out there but I provided only the ones which I think are practical and can be studied by the average person who is looking for a way to immediately reduce their fuel costs. I am currently using two of the easier methods in my own vehicle which normally gets 18-22 mpg and now gets between 28 and 32 mpg depending on driving conditions. A tank of gas for my 1996 Ford Ranger costs about $45.00 here so I am saving around $15-$20 PER TANK, without hurting my engine and with 'greener' emissions due to a cleaner burn! The techniques provided in this ebook begin with simple things you can do NOW to improve your mileage and lower your gas costs. - eBook Download / More Info
The Physics of the Primary State of Matter
The Physics of the Primary State of Matter - published in the 1930s, Karl Schappeller described his Prime Mover, a 10-inch steel sphere with quarter-inch copper tubing coils. These were filled with a material not named specifically, but which is said to have hardened under the influence of direct current and a magnetic field [electro-rheological fluid]. With such polarization, it might be guessed to act like a dielectric capacitor and as a diode...
- More Info
$5 Alt Science MP3s to listen while working/driving/jogging
No time to sit back and watch videos? Here are 15 interesting presentations you can download for just $5 each and listen to while driving, working, jogging, etc. An easy way to learn some fascinating new things that you will find of use. Easy, cheap and simple, better than eBooks or Videos. Roughly 50MB per MP3.
- More Info
15 New Alternative Science DVDs & 15 MP3s
An assortment of alternative science videos that provide many insights and inside information from various experimenters. Also MP3s extracted from these DVDs that you can listen to while working or driving. Reference links for these lectures and workshops by Bill Beaty of Amateur Science on the Dark Side of Amateur Science, Peter Lindemann on the World of Free Energy, Norman Wootan on the History of the EV Gray motor, Dan Davidson on Shape Power and Gravity Wave Phenomena, Lee Crock on a Method for Stimulating Energy, Doug Konzen on the Konzen Pulse Motor, George Wiseman on the Water Torch and Jerry Decker on Aether, ZPE and Dielectric Nano Arrays. Your purchase of these products helps support KeelyNet, thanks!
- More Info
Want to make a difference? If you have the funds, check out;
Jotuo Island - Toengt'ing Lake - 1957 expedition
found flying hunters in ancient labyrinth relief
Cree Indian Prophecy Only after the Last Tree has been cut down,
Only after the Last River has been poisoned,
Only after the Last Fish has been caught,
Only then will you find that
Money Cannot Be Eaten.
Alternative science covers a wide range of interests. Generally, it includes gravity control, free energy, electronic healing techniques, all forms of energy conversion, antigravity, levitation, overunity, time travel (as well as slowing down or speeding up local time).
Also clearly covered is the art of power generation (ideally zero point or aether conversion), space travel, physics of matter and energy, sound/acoustics and how it can be used to produce useful phenomena, electric or magnetic forces to produce useful phenomena, various types of motors, vacuum energy, dimensional travel and shifts, medicine, hydrogen generation and how it is used.
It also covers oil/petroleum and how it can be used to produce energy and products, weather control for cancelling earthquakes, tsunamis, fires, floods and to produce rain or clear weather on demand, oxygen/ozone therapy, nitrogen as a motor driver, water generation and manipulation via steam and vacuum, ecological restoration techniques, biophysics, rejuvenation and an unending list of other subjects, most of which are accepted by 'orthodox' science.