Hi Nexes,
You can still use configuration with WCF REST services. WCF REST just uses common default values if you don't provide any configuration.
Feel free to create a web.config file, add the system.serviceModel tag and a services tag with endpoints. When configuring the binding use a webHttpBinding. Also, you'll need to add a webHttp endpoint behavior. In fact, WCF REST is simply WCF with a webHttpBinding and the webHttpBehavior. You can then add any other behaviors that you need to at the service level or endpoint level.
Hope that helps. If you have more detailed quetions about how to configure a particular thing, just reply back.
Thanks,
~Randall