The hard base, called "ishizuki" in Japanese, is the blackish tip at the end of the stem. Use a knife to cut or scrape off this portion.

The stem can be easily removed by folding it over and pulling it off at the base, where it is attached to the cap. You can also cut it off from under the cap with a knife.