Directly load GPTBigCode to specified device (#618)

This PR directly load GPTBigCode to specified device, avoiding moving
model between devices.

# What does this PR do?
This PR directly load GPTBigCode to specified device, avoiding moving
model between devices.


## Before submitting
- [ ] This PR fixes a typo or improves the docs (you can dismiss the
other checks if that's the case).
- [x] Did you read the [contributor
guideline](https://github.com/huggingface/transformers/blob/main/CONTRIBUTING.md#start-contributing-pull-requests),
      Pull Request section?
- [ ] Was this discussed/approved via a Github issue or the
[forum](https://discuss.huggingface.co/)? Please add a link
      to it if that's the case.
- [ ] Did you make sure to update the documentation with your changes?
Here are the
[documentation
guidelines](https://github.com/huggingface/transformers/tree/main/docs),
and
[here are tips on formatting
docstrings](https://github.com/huggingface/transformers/tree/main/docs#writing-source-documentation).
- [ ] Did you write any new necessary tests?


## Who can review?

Anyone in the community is free to review the PR once the tests have
passed. Feel free to tag
members/contributors who may be interested in your PR.


@OlivierDehaene OR @Narsil

server/text_generation_server/models/santacoder.py

@@ -51,14 +51,14 @@ class SantaCoder(CausalLM):
                 "pad_token": EOD,
             }
         )
-
+        with device:
-        model = AutoModelForCausalLM.from_pretrained(
+            model = AutoModelForCausalLM.from_pretrained(
-            model_id,
+                model_id,
-            revision=revision,
+                revision=revision,
-            torch_dtype=dtype,
+                torch_dtype=dtype,
-            load_in_8bit=quantize == "bitsandbytes",
+                load_in_8bit=quantize == "bitsandbytes",
-            trust_remote_code=trust_remote_code,
+                trust_remote_code=trust_remote_code,
-        ).to(device)
+            )
 
         super(CausalLM, self).__init__(
             model=model,