Is my seed sent to the server with the libraries or wallet?

When interacting with any of the libraries which are supported by the IOTA Foundation, you can be made sure that your seed will never leave your side. All the essentials, such as signature generation, validation and so forth is done client-side, meaning that it's done locally on your environment. As such, your seed is never sent to your remote node and you don't have to worry about any security issues.