Mix 2 Tablespoons of sugar, 1/3 cup of cornstarch in a small pan, then add 2 cups of cold water. Cook slowly over low heat for about 5 - 6 minutes. You will know it is done when the mixture is a smooth, clear gel. After the mixture has cooled, mix in 1/4 cup non-colored dishwashing liquid. You can divide this up now into the plastic containers and then add the food coloring of choice to each container to get the desired color for each. Wait until bathtime! It won't be the same again!
(Since the paint contains a good amount of dishsoap, it can dissolve in the water. If it's a bright color, do a little test to see if it will leave a residue. Most will clean up easily with a bathtub cleanser).