Boku to 5-nin no Furinaite

"I'm Masayoshi Tono—I lost my memory in an accident." Having forgotten even his kind wife, Masayoshi begins investigating his past in order to remember who he is. In the process, he stumbles upon a shocking truth: "I was having affairs with five women." (Source: Coamix, translated)