Karthik,
As of BO 4.0 w/ SP05 the patches are cumulative, which mean you DO NOT install incremental patches anymore.
In you case you go straight from BI 4.1 w/ SP2 to SP4 without any issues. If you wait for another 10days, SP5 for BI 4.1 will be out.
Regards,
Ajay