.. role:: raw-html-m2r(raw)
:format: html
Azure Document Translation client library for Python
====================================================
Azure Cognitive Services Document Translation is a cloud service that translates documents to and from 90 languages
and dialects while preserving document structure and data format. Use the client library for Document Translation to:
* Translate numerous, large files from an Azure Blob Storage container to a target container in your language of choice.
* Check the translation status and progress of each document in the translation operation.
* Apply a custom translation model or glossaries to tailor translation to your specific case.
`Source code `_ | `Package (PyPI) `_ | `API reference documentation `_ | `Product documentation `_ | `Samples `_
Getting started
---------------
Prerequisites
^^^^^^^^^^^^^
* Python 2.7, or 3.6 or later is required to use this package.
* You must have an `Azure subscription `_ and a
`Document Translation resource `_ to use this package.
Install the package
^^^^^^^^^^^^^^^^^^^
Install the Azure Document Translation client library for Python with `pip `_\ :
.. code-block:: bash
pip install azure-ai-translation-document --pre
..
Note: This version of the client library defaults to the v1.0 version of the service
Create a Document Translation resource
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Document Translation supports `single-service access `_ only.
To access the service, create a Translator resource.
You can create the resource using
**Option 1:** `Azure Portal `_
**Option 2:** `Azure CLI `_.
Below is an example of how you can create a Document Translation resource using the CLI:
.. code-block:: bash
# Create a new resource group to hold the document translation resource -
# if using an existing resource group, skip this step
az group create --name my-resource-group --location westus2
.. code-block:: bash
# Create document translation
az cognitiveservices account create \
--name document-translation-resource \
--custom-domain document-translation-resource \
--resource-group my-resource-group \
--kind TextTranslation \
--sku S1 \
--location westus2 \
--yes
Authenticate the client
^^^^^^^^^^^^^^^^^^^^^^^
In order to interact with the Document Translation service, you will need to create an instance of a client.
An **endpoint** and **credential** are necessary to instantiate the client object.
Looking up the endpoint
~~~~~~~~~~~~~~~~~~~~~~~
You can find the endpoint for your Document Translation resource using the
`Azure Portal `_.
..
Note that the service requires a custom domain endpoint. Follow the instructions in the above link to format your endpoint:
https://{NAME-OF-YOUR-RESOURCE}.cognitiveservices.azure.com/
Get the API key
~~~~~~~~~~~~~~~
The API key can be found in the Azure Portal or by running the following Azure CLI command:
``az cognitiveservices account keys list --name "resource-name" --resource-group "resource-group-name"``
Create the client with AzureKeyCredential
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
To use an `API key `_ as the ``credential`` parameter,
pass the key as a string into an instance of `AzureKeyCredential `_.
.. code-block:: python
from azure.core.credentials import AzureKeyCredential
from azure.ai.translation.document import DocumentTranslationClient
endpoint = "https://.cognitiveservices.azure.com/"
credential = AzureKeyCredential("")
document_translation_client = DocumentTranslationClient(endpoint, credential)
Create the client with an Azure Active Directory credential
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
``AzureKeyCredential`` authentication is used in the examples in this getting started guide, but you can also
authenticate with Azure Active Directory using the `azure-identity `_ library.
To use the `DefaultAzureCredential `_ type shown below, or other credential types provided
with the Azure SDK, please install the ``azure-identity`` package:
``pip install azure-identity``
You will also need to `register a new AAD application and grant access `_ to your
Translator resource by assigning the ``"Cognitive Services User"`` role to your service principal.
Once completed, set the values of the client ID, tenant ID, and client secret of the AAD application as environment variables:
``AZURE_CLIENT_ID``\ , ``AZURE_TENANT_ID``\ , ``AZURE_CLIENT_SECRET``.
.. code-block:: python
from azure.identity import DefaultAzureCredential
from azure.ai.translation.document import DocumentTranslationClient
credential = DefaultAzureCredential()
document_translation_client = DocumentTranslationClient(
endpoint="https://.cognitiveservices.azure.com/",
credential=credential
)
Key concepts
------------
The Document Translation service requires that you upload your files to an Azure Blob Storage source container and provide
a target container where the translated documents can be written. SAS tokens to the containers (or files) are used to
access the documents and create the translated documents in the target container. Additional information about setting this up can be found in
the service documentation:
* `Set up Azure Blob Storage containers `_ with your documents
* Optionally apply `glossaries `_ or a `custom model for translation `_
* Generate `SAS tokens `_ to your containers (or files) with the appropriate `permissions `_
DocumentTranslationClient
^^^^^^^^^^^^^^^^^^^^^^^^^
Interaction with the Document Translation client library begins with an instance of the ``DocumentTranslationClient``.
The client provides operations for:
* Creating a translation operation to translate documents in your source container(s) and write results to you target container(s).
* Checking the status of individual documents in the translation operation and monitoring each document's progress.
* Enumerating all past and current translations operations.
* Identifying supported glossary and document formats.
Translation Input
^^^^^^^^^^^^^^^^^
Input to the ``begin_translation`` client method can be provided in two different ways:
1) A single source container with documents can be translated to a different language:
.. code-block:: python
from azure.core.credentials import AzureKeyCredential
from azure.ai.translation.document import DocumentTranslationClient
document_translation_client = DocumentTranslationClient("", AzureKeyCredential(""))
poller = document_translation_client.begin_translation("", "", "")
2) Or multiple different sources can be provided each with their own targets.
.. code-block:: python
from azure.core.credentials import AzureKeyCredential
from azure.ai.translation.document import DocumentTranslationClient, DocumentTranslationInput, TranslationTarget
my_input = [
DocumentTranslationInput(
source_url="",
targets=[
TranslationTarget(target_url="", language_code="fr"),
TranslationTarget(target_url="", language_code="de")
]
),
DocumentTranslationInput(
source_url="",
targets=[
TranslationTarget(target_url="", language_code="fr"),
TranslationTarget(target_url="", language_code="de")
]
),
DocumentTranslationInput(
source_url="",
targets=[
TranslationTarget(target_url="", language_code="fr"),
TranslationTarget(target_url="", language_code="de")
]
)
]
document_translation_client = DocumentTranslationClient("", AzureKeyCredential(""))
poller = document_translation_client.begin_translation(my_input)
..
Note: the target_url for each target language must be unique.
See the service documentation for all `supported languages `_.
Long-Running Operations
^^^^^^^^^^^^^^^^^^^^^^^
Long-running operations are operations which consist of an initial request sent to the service to start an operation,
followed by polling the service at intervals to determine whether the operation has completed or failed, and if it has
succeeded, to get the result.
Methods that translate documents are modeled as long-running operations.
The client exposes a ``begin_`` method that returns a ``DocumentTranslationLROPoller`` or ``AsyncDocumentTranslationLROPoller``. Callers should wait
for the operation to complete by calling ``result()`` on the poller object returned from the ``begin_`` method.
Sample code snippets are provided to illustrate using long-running operations :raw-html-m2r:`below`.
Examples
--------
The following section provides several code snippets covering some of the most common Document Translation tasks, including:
* :raw-html-m2r:`Translate your documents`
* :raw-html-m2r:`Translate multiple inputs`
* :raw-html-m2r:`List translation operations`
Translate your documents
^^^^^^^^^^^^^^^^^^^^^^^^
Translate the documents in your source container to the target container.
.. code-block:: python
from azure.core.credentials import AzureKeyCredential
from azure.ai.translation.document import DocumentTranslationClient
endpoint = "https://.cognitiveservices.azure.com/"
credential = AzureKeyCredential("")
source_container_sas_url_en = ""
target_container_sas_url_es = ""
document_translation_client = DocumentTranslationClient(endpoint, credential)
poller = document_translation_client.begin_translation(source_container_sas_url_en, target_container_sas_url_es, "es")
result = poller.result()
print("Status: {}".format(poller.status()))
print("Created on: {}".format(poller.details.created_on))
print("Last updated on: {}".format(poller.details.last_updated_on))
print("Total number of translations on documents: {}".format(poller.details.documents_total_count))
print("\nOf total documents...")
print("{} failed".format(poller.details.documents_failed_count))
print("{} succeeded".format(poller.details.documents_succeeded_count))
for document in result:
print("Document ID: {}".format(document.id))
print("Document status: {}".format(document.status))
if document.status == "Succeeded":
print("Source document location: {}".format(document.source_document_url))
print("Translated document location: {}".format(document.translated_document_url))
print("Translated to language: {}\n".format(document.translated_to))
else:
print("Error Code: {}, Message: {}\n".format(document.error.code, document.error.message))
Translate multiple inputs
^^^^^^^^^^^^^^^^^^^^^^^^^
Begin translating with documents in multiple source containers to multiple target containers in different languages.
.. code-block:: python
from azure.core.credentials import AzureKeyCredential
from azure.ai.translation.document import DocumentTranslationClient, DocumentTranslationInput, TranslationTarget
endpoint = "https://.cognitiveservices.azure.com/"
credential = AzureKeyCredential("")
source_container_sas_url_de = ""
source_container_sas_url_en = ""
target_container_sas_url_es = ""
target_container_sas_url_fr = ""
target_container_sas_url_ar = ""
document_translation_client = DocumentTranslationClient(endpoint, credential)
poller = document_translation_client.begin_translation(
[
DocumentTranslationInput(
source_url=source_container_sas_url_en,
targets=[
TranslationTarget(target_url=target_container_sas_url_es, language_code="es"),
TranslationTarget(target_url=target_container_sas_url_fr, language_code="fr"),
],
),
DocumentTranslationInput(
source_url=source_container_sas_url_de,
targets=[
TranslationTarget(target_url=target_container_sas_url_ar, language_code="ar"),
],
)
]
)
result = poller.result()
for document in result:
print("Document ID: {}".format(document.id))
print("Document status: {}".format(document.status))
if document.status == "Succeeded":
print("Source document location: {}".format(document.source_document_url))
print("Translated document location: {}".format(document.translated_document_url))
print("Translated to language: {}\n".format(document.translated_to))
else:
print("Error Code: {}, Message: {}\n".format(document.error.code, document.error.message))
List translation operations
^^^^^^^^^^^^^^^^^^^^^^^^^^^
Enumerate over the translation operations submitted for the resource.
.. code-block:: python
from azure.core.credentials import AzureKeyCredential
from azure.ai.translation.document import DocumentTranslationClient
endpoint = "https://.cognitiveservices.azure.com/"
credential = AzureKeyCredential("")
document_translation_client = DocumentTranslationClient(endpoint, credential)
operations = document_translation_client.list_all_translation_statuses() # type: ItemPaged[TranslationStatus]
for operation in operations:
print("\nID: {}".format(operation.id))
print("Status: {}".format(operation.status))
print("Created on: {}".format(operation.created_on))
print("Last updated on: {}".format(operation.last_updated_on))
print("Total number of translations on documents: {}".format(operation.documents_total_count))
print("Total number of characters charged: {}".format(operation.total_characters_charged))
print("Of total documents...")
print("{} failed".format(operation.documents_failed_count))
print("{} succeeded".format(operation.documents_succeeded_count))
print("{} cancelled".format(operation.documents_cancelled_count))
To see how to use the Document Translation client library with Azure Storage Blob to upload documents, create SAS tokens
for your containers, and download the finished translated documents, see this `sample `_.
Note that you will need to install the `azure-storage-blob `_ library to run this sample.
Troubleshooting
---------------
General
^^^^^^^
Document Translation client library will raise exceptions defined in `Azure Core `_.
Logging
^^^^^^^
This library uses the standard
`logging `_ library for logging.
Basic information about HTTP sessions (URLs, headers, etc.) is logged at ``INFO`` level.
Detailed ``DEBUG`` level logging, including request/response bodies and **unredacted**
headers, can be enabled on the client or per-operation with the ``logging_enable`` keyword argument.
See full SDK logging documentation with examples `here `_.
Optional Configuration
^^^^^^^^^^^^^^^^^^^^^^
Optional keyword arguments can be passed in at the client and per-operation level.
The azure-core `reference documentation `_
describes available configurations for retries, logging, transport protocols, and more.
Next steps
----------
The following section provides several code snippets illustrating common patterns used in the Document Translation Python client library.
More sample code
^^^^^^^^^^^^^^^^
These code samples show common scenario operations with the Azure Document Translation client library.
* Client authentication: `sample_authentication.py `_
* Begin translating documents: `sample_begin_translation.py `_
* Translate with multiple inputs: `sample_translate_multiple_inputs.py `_
* Check the status of documents: `sample_check_document_statuses.py `_
* List all submitted translation operations: `sample_list_all_translations.py `_
* Apply a custom glossary to translation: `sample_translation_with_glossaries.py `_
* Use Azure Blob Storage to set up translation resources: `sample_translation_with_azure_blob.py `_
Async samples
^^^^^^^^^^^^^
This library also includes a complete async API supported on Python 3.6+. To use it, you must
first install an async transport, such as `aiohttp `_. Async clients
are found under the ``azure.ai.translation.document.aio`` namespace.
* Client authentication: `sample_authentication_async.py `_
* Begin translating documents: `sample_begin_translation_async.py `_
* Translate with multiple inputs: `sample_translate_multiple_inputs_async.py `_
* Check the status of documents: `sample_check_document_statuses_async.py `_
* List all submitted translation operations: `sample_list_all_translations_async.py `_
* Apply a custom glossary to translation: `sample_translation_with_glossaries_async.py `_
* Use Azure Blob Storage to set up translation resources: `sample_translation_with_azure_blob_async.py `_
Additional documentation
^^^^^^^^^^^^^^^^^^^^^^^^
For more extensive documentation on Azure Cognitive Services Document Translation, see the `Document Translation documentation `_ on docs.microsoft.com.
Contributing
------------
This project welcomes contributions and suggestions. Most contributions require you to agree to a Contributor License Agreement (CLA) declaring that you have the right to, and actually do, grant us the rights to use your contribution. For details, visit `cla.microsoft.com `_.
When you submit a pull request, a CLA-bot will automatically determine whether you need to provide a CLA and decorate the PR appropriately (e.g., label, comment). Simply follow the instructions provided by the bot. You will only need to do this once across all repos using our CLA.
This project has adopted the `Microsoft Open Source Code of Conduct `_. For more information see the `Code of Conduct FAQ `_ or contact `opencode@microsoft.com `_ with any additional questions or comments.
.. raw:: html
Indices and tables
------------------
* :ref:`genindex`
* :ref:`modindex`
* :ref:`search`
.. toctree::
:maxdepth: 5
:glob:
:caption: Developer Documentation
azure.ai.translation.document.rst