Hello; I guess you are thinking of moving directly without any specific acclimation process. I move fish this way from tank to tank at times. As stated check temps for sure. I often will move one fish and watch it for signs of stress or shock. If that move goes well i feel safe in tranfering other fish. It may be possible for tanks in the same house to have slightly different water quality, but I have found moves like this to be problem free for the most part.
If when moving a single fish there seems to be some stress, It may be that an acclimation process in in order for future moves. Much like when bringing a fish home from a LFS.