Yes, this caused them to seek remission of sins via being baptized in the name of Jesus(immediately).
The Holy Ghost is not given for the remittion of sins, but the name of Jesus being verbalized during immersion in water is.
By receiving the Holy Spirit they already had the remission of sins.
If one has been "given" the Holy Spirit they are a Christian (1 John 4:13).