For anyone wanting to get LAMP set-up on their linux distro I came across a cool and quick command. If you do not need to make changes to configuration then this way will do fine.

# apt-get install tasksel

# tasksel install lamp-server

Simple as that!