According to KIKIYAMA's official website, Yume Nikki was first published on June 26, 2004 under version .00 [1]. Ever since then, KIKIYAMA has made numerous updates, all the way up to version .10 on October 1, 2007 (even though it was completed on September 17, 2007). There isn't a whole lot known about the game's development to this day.
Yume Nikki wasn't exactly popular when it first came out, leading to no one really documenting the different versions. Eventually though, Yume Nikki became popular through Japanese forums such as 2channel [2]. The game even gained an English following after an unofficial English translation was released. By the time all of this happened the current version was released.
Nowadays, older versions are harder to come by because of the explosion of popularity happening much later in the game's lifetime. Despite the fandom's attempts to find these past versions, there is still much to be found. This page documents what we know so far.
Kikiyama HP
On KIKIYAMA's website, KIKIYAMA HP, there are a number of pages dedicated to Yume Nikki. One of which is entitled ゲーム紹介, and contains instructions for how to play the game, as well as controls.
The second page is a log for the bug fix history, and says the bugs in each version of the game, from version 0.04 to 0.10. It mainly talks about bugs while using Cat and Knife effects, as well as sound effect glitches. Interestingly, it says that version 0.10 has some maps that are missing graphics. The fourth page has screenshots of the game, and the fifth is a download link for it.
However, the third page documents past versions of Yume Nikki, all versions from 0.00 to 0.10.