tl;dr

GIFs are awesome but terrible for quality and performance
Replacing GIFs with <video> is better but has perf. drawbacks: not preloaded, uses range requests
Now you can <img src=".mp4">s in Safari Technology Preview
Early results show mp4s in <img> tags display