Azure Synapse Analytics Artifacts client library for .NET
This directory contains the open source subset of the .NET SDK. For documentation of the complete Azure SDK, please see the Microsoft Azure .NET Developer Center.
The Azure Synapse Analytics development client library enables programmatically managing artifacts, offering methods to create, update, list, and delete pipelines, datasets, data flows, notebooks, Spark job definitions, SQL scripts, linked services and triggers.
Azure Synapse is a limitless analytics service that brings together enterprise data warehousing and Big Data analytics. It gives you the freedom to query data on your terms, using either serverless on-demand or provisioned resources—at scale. Azure Synapse brings these two worlds together with a unified experience to ingest, prepare, manage, and serve data for immediate BI and machine learning needs.
Getting started
The complete Microsoft Azure SDK can be downloaded from the Microsoft Azure Downloads Page and ships with support for building deployment packages, integrating with tooling, rich command line tooling, and more.
For the best development experience, developers should use the official Microsoft NuGet packages for libraries. NuGet packages are regularly updated with new functionality and hotfixes.
Install the package
Install the Azure Synapse Analytics development client library for .NET with [NuGet][nuget]:
dotnet add package Azure.Analytics.Synapse.Artifacts --version 0.1.0-preview.2
Prerequisites
- An [Azure subscription][azure_sub].
- An existing Azure Synapse workspace. If you need to create an Azure Synapse workspace, you can use the Azure Portal or [Azure CLI][azure_cli].
If you use the Azure CLI, the command looks like below:
az synapse workspace create \
--name <your-workspace-name> \
--resource-group <your-resource-group-name> \
--storage-account <your-storage-account-name> \
--file-system <your-storage-file-system-name> \
--sql-admin-login-user <your-sql-admin-user-name> \
--sql-admin-login-password <your-sql-admin-user-password> \
--location <your-workspace-location>
Authenticate the client
In order to interact with the Azure Synapse Analytics service, you'll need to create an instance of the [ArtifactsClient][development_client_class] class. You need a workspace endpoint, which you may see as "Development endpoint" in the portal, and client secret credentials (client id, client secret, tenant id) to instantiate a client object.
Client secret credential authentication is being used in this getting started section but you can find more ways to authenticate with [Azure identity][azure_identity]. To use the [DefaultAzureCredential][DefaultAzureCredential] provider shown below, or other credential providers provided with the Azure SDK, you should install the Azure.Identity package:
Install-Package Azure.Identity
Examples
The Azure.Analytics.Synapse.Artifacts package supports synchronous and asynchronous APIs. The following section covers some of the most common Azure Synapse Analytics development related tasks:
Notebook examples
Create a notebook
CreateOrUpdateNotebook
creates a notebook.
Notebook notebook = new Notebook(
new NotebookMetadata
{
LanguageInfo = new NotebookLanguageInfo(name: "Python")
},
nbformat: 4,
nbformatMinor: 2,
new List<NotebookCell>()
);
var operation = notebookClient.StartCreateOrUpdateNotebook("MyNotebook", new NotebookResource(notebook));
NotebookResource notebookResource = operation.WaitForCompletionAsync().ConfigureAwait(true).GetAwaiter().GetResult();
Retrieve a notebook
GetNoteBook
retrieves a notebook.
NotebookResource notebook = notebookClient.GetNotebook("MyNotebook");
List notebooks
GetNotebooksByWorkspace
enumerates the notebooks in the Synapse workspace.
Pageable<NotebookResource> notebooks = notebookClient.GetNotebooksByWorkspace();
foreach (NotebookResource notebook in notebooks)
{
System.Console.WriteLine(notebook.Name);
}
Delete a notebook
DeleteNotebook
deletes a notebook.
notebookClient.StartDeleteNotebook("MyNotebook");
To build
For information on building the Azure Synapse client library, please see Building the Microsoft Azure SDK for .NET
Target frameworks
For information about the target frameworks of the Azure Synapse client library, please refer to the Target Frameworks of the Microsoft Azure SDK for .NET.
Key concepts
NotebookControlClient
With a notebook client you can create, update, list, and delete pipelines, datasets, data flows, notebooks, Spark job definitions, SQL scripts, linked services and triggers.
Troubleshooting
Please open issue in github.
Next steps
The next step is adding more examples
Contributing
This project has adopted the Microsoft Open Source Code of Conduct. For more information see the Code of Conduct FAQ or contact opencode@microsoft.com with any additional questions or comments.