Can I use Windows Internet Connection Sharing?

Yes. Internet Connection Sharing (ICS) allows a computer to share its Internet connection with other computers on a local area network. You can create a Network Bridge connecting two or more local area connections and share the Internet connection with the computers on all of them. This is especially useful if your computer is connected to both a wired and wireless network.