Bunji was a hard worker. As a result, Bunji acquired more land and built new additions to his house, and later he was able to construct a new house. This was a considerable achievement, ranking him in the top ten landholders in a village of 130 households. However, as humble and sincere as Bunji was, he could not escape sufferings.

The celebration and joy of the birth of Bunji and Tose’s first son, Kametaro, was short lived, for Kametaro died of an illness three years later. In addition, Bunji and Tose treasured their first daughter, Chise, only to lose her a year later, despite medical attention and prayers. Then, Makiemon, Bunji’s second son, died at the age of seven, presumably in the early stages of smallpox. He also bore the loss of his two oxen, which were considered by farmers to be almost equal in value to family members.

During Bunji’s time, folkloric superstitions, divinations, and folk religions ran rampant among the masses. Most of these beliefs came to Japan from China between the seventh and eleventh centuries, and they eventually became common beliefs. An ominous deity called “Konjin” was part of this folklore. Konjin was thought to be the most powerful deity, and thus became the most feared deity. People believed Konjin resided in various directional locations (determined astrologically). These directions were to be avoided by all who wished to avert Konjin’s wrath. As an ardent follower of these folk beliefs, each time Bunji constructed a new building, such as a bathroom or storehouse, he would have the Days and Directions checked to select an auspicious day and direction. However, as Bunji made additions to his house, he encountered the succession of deaths in his family. Because of his continued misfortunes, Bunji started to suspect whether he had violated construction taboos.