Balakrishna not attend to Modi's swearing-in ceremony