From Zelda Wiki, the Zelda encyclopedia
The first house, inhabited by Din
|Game(s)||The Minish Cap|
After completing the Fortress of Winds, Link can fuse Kinstones with either Din, Nayru, or Farore, who mention that they are looking for a house to move into. Afterwards, Gorman will be renting a home in Castle Town, at which point Link can talk to one of the girls he fused Kinstones with so that she may move in to the new house. By speaking to the girl in the house, Link will be able to obtain one of the Oracle Charms.
To obtain the next house, Link has to complete the Royal Valley and then fuse Kinstones with the carpenter by the Post Office to make Mutoh build a house. The young hero can talk to the two remaining girls to obtain a second Oracle Charm once the house is completed.