There are more advanced options, depending on your h.264 encoder. For
example the TI h.264 encoder supports a couple of features, Temporal
Scalability and Chain Free P Frame encoding.
http://processors.wiki.ti.com/index.php/H.264_DM36x_Ver_2.0_Codec#Scalable_video_coding_.E2.80.93_Temporal
http
In the simplest case, H264 defines a protocol that starts with a key frame and
has a succession of difference frames that are much smaller. ie the 24KByte key
frame has all the information needed to draw the whole frame and the 1Kbyte
diff frame has only the changes needed to update the key fram