Oh yeah, I’m a big fan of warm lights and have been using them for a while. Still don’t like them bright at night. Lights that are indirect (e.g. under counter) I can deal with being considerably brighter but for your typical table/floor lamp, 60W incandescent equivalent is the upper limit. I don’t like ceiling pot lights at all unless the bulb can be dimmed.
As a sibling comment expresses, it’s their unshaded nature. The light is too direct/harsh and can introduce glare. They can also wind up in peripheral vision easily, particularly when sitting down and looking up at someone standing or at an object high on the wall.
Indirect/shaded lamps that diffuse the light over a larger area and reduce its intensity are preferable.