If you have radiators fitted against external walls, fit reflective panels behind them so that the heat isn’t absorbed by the walls — you don’t have to take the radiator off the wall.
Fit a radiator shelf to direct heat where you want it instead of heat rising up to the ceiling or out of the window.
Don’t fit radiators or electric heaters in a conservatory — you’d be heating the sky. If you heat a conservatory through the year you could double your total fuel bill!