semantic-link-labs

New functions

• sempy_labs.gateway
  • restart_gateway
  • shutdown_gateway
• sempy_labs.onelake
  • modify_default_tier
• sempy_labs.semantic_model
  • lineage_view Displays a fully-interactive UI which shows downstream reports of a given semantic model. The downstream reports can be analyzed for broken elements (i.e. visuals/filters etc.) and fixes can be applied in bulk with a single click. This UI also allows downstream reports to be rebinded to a different semantic model (by clicking the checkboxes within the report panels in the diagram. See the screenshot below.

<img width="2716" height="1398" alt="Screenshot 2026-07-20 105511" src="https://github.com/user-attachments/assets/dc1289a7-e983-448c-96ac-1348dc787e00" />

Updated functions

• #1262
• OneLake functions have been moved to the sempy_labs.onelake package (modify_onelake_diagnostics, get_onelake_settings, modify_immutability_policy).

Bug fixes

• #820
• #1111
• #1264
• #1268
• #1269
• #1270
• #1275
• #1284
• #1291

Removed functions

• Removed the add_table_to_direct_lake_semantic_model from sempy_labs.directlake. Instead use add_direct_lake_tables.

Updated Functions

• sempy_labs
  • vertipaq_analyzer Minor makeover in the UI to align to a standard UI for this library. Now features dark mode as an optional parameter (and button within the UI).
  • delta_analyzer Minor makeover in the UI to align to a standard UI for this library. Now features dark mode as an optional parameter (and button within the UI).

Bug Fixes

• #1242 (issue impacting resolving user IDs in the list_data_access_roles function).
• #1243
• #1247
• #1252
• #1253
• DAX Formatting uses the new API from daxformatter.com (thanks @albertospelta!)

Skills

• The ui-styling SKILL.md file can be used to create interactive UI tools in the same style as those in semantic link labs (i.e. Perspective Editor, Vertipaq Analyzer, Delta Analyzer). Plug this skill.md file into your AI of choice and it will create a Fabric Notebook-compatible, modern UI in the style of these tools.

Updated Functions

• sempy_labs
  • generate_direct_lake_semantic_model Added the 'include_descriptions' optional parameter which sets the table/column descriptions in the semantic model according to the table/column descriptions in the lakehouse (if specified).
  • list_data_access_roles The 'Rules' parameter is now 'Roles'. There is a new parameter 'Security' which shows the row level security and column level security for the relevant tables.
  • evaluate_dax_impersonation Now points to the evaluate_dax function in sempy.fabric as this contains a parameter for user impersonation (#1225).
• sempy_labs.admin
  • list_apps Now includes the Workspace Id and Users columns in the output (#1221)
• sempy_labs.lakehouse
  • run_table_maintenance Now includes optional parameters 'z_order' and 'purge_deletion_vectors'.
• sempy_labs.mirrored_catalog 🚀 New!
  • list_mirrored_catalogs
  • delete_mirrored_catalog
  • refresh_catalog_metadata
  • get_mirroring_status
  • list_tables_mirroring_status
• sempy_labs.onelake 🚀 New!
  • export_onelake_lifecycle_policy
  • import_onelake_lifecycle_policy
  • delete_onelake_lifecycle_policy
• sempy_labs.tom
  • sync_descriptions Sets the table/column descriptions according to the source lakehouse (if the table is in Direct Lake mode and its source is a Lakehouse).

Bug Fixes

• #1238
• Fixed issue with functions having circular dependencies.

New Functions

• sempy_labs
  • ConnectMirroredAzureDatabricksCatalog Write SQL or T-SQL statements against a Mirrored Azure Databricks Catalog.
• sempy_labs.lakehouse
  • create_schema Creates a schema within a schema-enabled lakehouse (thanks @pawarbi!).
  • create_materialized_lake_view Creates a materialized lake view in a Fabric lakehouse. Only supported in schema-enabled lakehouses.
• sempy_labs.mirrored_azure_databricks_catalog
  • list_mirrored_azure_databricks_catalogs
  • delete_mirrored_azure_databricks_catalog
  • create_mirrored_azure_databricks_catalog
  • get_mirrored_azure_databricks_catalog
  • update_mirrored_azure_databricks_catalog
• sempy_labs.semantic_model
  • perspective_editor An interactive UI which makes it easy to create/manage perspectives
• sempy_labs.sql_database
  • revalidate_cmk
  • list_restorable_deleted_databases
• sempy_labs.tom
  • get_direct_lake_sources Now available directly in the tom package. Shows a list of all sources used for Direct Lake.
  • add_direct_lake_tables Adds specified tables (in Direct Lake mode) to a Direct Lake semantic model.
  • hide_key_columns Hides Integer columns used in relationships.
  • mark_primary_keys Sets the IsKey property to True for columns on the One side of relationships.
  • get_mini_model_properties Shows the properties of the mini model if the semantic model is a mini model (see the deploy_semantic_model function).
• sempy_labs.workspace
  • apply_workspace_tags
  • unapply_workspace_tags

Updated Functions

• sempy_labs
  • list_data_access_roles Now supports 3 views using the 'view' parameter (Rules, MicrosoftEntraMembers, FabricItemMembers).
  • create_blank_semantic_model Now returns the ID of the created semantic model.
  • deploy_semantic_model added the 'filters' parameter which allows deploying a mini model based on the objects in a perspective as well as filters applied to the underlying tables. This is only supported for single-lakehouse-sourced Direct Lake semantic models.
  • generate_direct_lake_semantic_model Generates a Direct Lake semantic model based on any viable source (Lakehouse, Warehouse, SQL Database, Mirrored Azure Databricks Catalog, or Mirrored Database).
• sempy_labs.admin
  • list_tenant_settings Additional columns added (#1177).
• sempy_labs.sql_database
  • list_sql_databases Added the column 'Sensitivity Label Id' .
• sempy_labs.tom
  • 'Add' functions (i.e. add_table) now return the object that was created. As an example, add_table now returns the created table.

Bug Fixes

• #1163
• #1168
• #1180
• #1220
• Fixed bug in remove_vertipaq_annotations

<img width="1426" height="760" alt="image" src="https://github.com/user-attachments/assets/e3ba31fe-93c8-4160-b6aa-91e117a7a9d3" />

New Functions

• sempy_labs
  • Item recovery
    • list_recoverable_items
    • recover_item
    • permanently_delete_item
  • Bulk Export/Import
    • bulk_export_items
    • bulk_import_items
• sempy_labs.admin
  • enable_item_recovery enables item recovery in a Fabric tenant.

Updated Functions

• sempy_labs
  • vertipaq_analyzer This function has a brand new UI! Plus, new optional parameters (export_lakehouse, export_workspace, export_schema) allow you to export this data as tables to the destination of your choice. This function now displays additional content for Direct Lake semantic models (the Direct Lake Type (OneLake or SQL), Source Name, Source Type, Source Workspace, Source Table Name). The function also shows 'Levels' in the Hierarchy shows the number of levels within the hierarchy. Lastly, the read_stats_from_data will calculate column cardinality for both Import and Direct Lake models (as long as the Direct Lake source is a lakehouse or warehouse). Missing Rows is calculated only for Import models. (#1008, #103).

<img width="998" height="238" alt="image" src="https://github.com/user-attachments/assets/b3867377-2d91-473b-9995-cc9d52aeba74" />

<img width="982" height="190" alt="image" src="https://github.com/user-attachments/assets/1a26267f-5228-4807-a31c-f8a0382fb7eb" />

Bug Fixes

• #1117
• #1140
• #1163
• #1166 thanks @hurtn!

Updates

• Updated sempy_labs to be compatible with Python 3.12 as this is now the default in Fabric notebooks.

Bug Fixes

• #1117

Updated Functions

• sempy_labs
  • delta_analyzer Added a parameter 'visualize' which defaults to True. When 'visualize' is set to True, the function displays the results in an interactive HTML-designed UI. Note that the function still returns the results as a dictionary of dataframes.

<img width="909" height="484" alt="image" src="https://github.com/user-attachments/assets/079148e2-4e48-4d7b-a510-f51f90b731de" />

New Functions

• sempy_labs.admin
  • delete_all_capacity_tenant_setting_overrides thanks @tarente!
• sempy_labs.key_vault 🚀 New!
  • get_secret
  • set_secret
  • delete_secret
  • list_secrets
  • recover_deleted_secret
  • purge_deleted_secret
  • backup_secret
  • restore_secret
  • update_secret
  • list_deleted_secrets
  • list_secret_versions
• sempy_labs.report
  • list_reports Lists the reports in a workspace and their properties (also showing the format of the report ('PBIR' or 'PBIRLegacy').
  • get_report Shows the properties of a single report (also showing the format of the report).
  • upgrade_to_pbir Upgrades a report, a list of reports or all reports in a given workspace (or list of workspaces) to the PBIR format.

Updated Functions

• sempy_labs.directlake
  • update_direct_lake_model_connection Fixed an issue where relationships/measures disappeared when converting from DL on OneLake to DL on SQL.

Bug Fixes

• #406
• #1099
• #1106

Updated Functions

• sempy_labs.sql_endpoint

  • refresh_sql_endpoint_metadata Added the optional 'recreate_tables' parameter.

• sempy_labs

  • All functions which leverage APIs which can be accessed via Service Principal authentication are now enabled. Previously it was limited to those functions which had the client ‘fabric_sp’ in the _base_api function but that is no longer the case.

Bug Fixes

• #406
• #886
• #1076
• #1078
• #1082 (thanks @jdocampo!)
• #1093

New Functions

• sempy_labs.event_schema_set 🚀 New!
  • list_event_schema_sets
  • delete_event_schema_set
• sempy_labs.operations_agent 🚀 New!
  • list_operations_agents
  • delete_operations_agent
• sempy_labs.rti 🚀 New package for Real Time Intelligence functions!
  • nl_to_kql
• sempy_labs.semantic_model
  • enable_query_caching Enable query caching to potentially speed up results. See more details here.
• sempy_labs.surge_protection 🚀 New package for surge protection functions!
  • get_workspace_consumption_rules
  • get_background_operation_rules
  • set_workspace_consumption_rules
  • set_background_operation_rules
  • delete_workspace_consumption_rules
  • delete_background_operation_rules

Updated Functions

• sempy_labs.directlake
  • generate_direct_lake_semantic_model Now supports schema-enabled lakehouses.
• sempy_labs.lakehouse
  • get_lakehouse_columns Added the 'Schema Name' column to the resulting dataframe.

Bug Fixes

• #1014

New Functions

• sempy_labs.daxlib 🚀 New! Semantic Link Labs now offers a seamless integration with DAXLib.org which allows you to easily view user-defined function packages from DAXLib.org as well as add/remove/update these packages in your semantic model. Kudos @edwardpcharles for the inspiration and SQLBI for their support of DAXLib.org.
  • get_package_tmdl
  • get_package_functions
  • add_package_to_semantic_model
  • remove_package_from_semantic_model
  • update_package_in_semantic_model
• sempy_labs.directlake
  • get_direct_lake_sources This function replaces the 'get_direct_lake_source' function and is able to retrieve all Direct Lake sources (#660).
• sempy_labs.kql_dashboard 🚀 New!
  • list_kql_dashboards
  • create_kql_dashboard
  • delete_kql_dashboard
  • create_workspace_monitoring_dashboard Creates a workspace monitoring dashboard based on this template.
• sempy_labs.report.ReportWrapper
  • set_page_order Easily re-order pages (tabs) within a report.

Updated Functions

• sempy_labs
  • model_bpa_rules Updated the rule for ensuring measures are formatted. This rule now accounts for format string expressions.
  • get_item_definition now supports the EventSchemaSet item.
• sempy_labs.admin
  • assign_domain_workspaces Now accepts either the workspace name or ID. Note that the parameter name has changed from 'workspace_names' to 'workspace' (#1040).
• sempy_labs.lakehouse
  • optimize_lakehouse_tables Now supports schema-enabled lakehouses. Simply use the 'schema.table' format in the 'tables' parameter.
  • vacuum_lakehouse_tables Now supports schema-enabled lakehouses. Simply use the 'schema.table' format in the 'tables' parameter.
• sempy_labs.report
  • download_report This function now also supports paginated reports (in addition to Power BI reports). Thanks @MitchSS!
• sempy_labs.tom
  • add_field_parameter This function now has the parameter 'hierarchy_names' which allows you to simulate hierarchies within a field parameter.

Functions moved to a new package

• sempy_labs.connection 🚀 New!
  • Connection functions have been moved to this new package.
• sempy_labs.data_pipeline 🚀 New!
  • Data Pipeline functions have been moved to this new package.
• sempy_labs.external_data_share 🚀 New!
  • External Data Share functions have been moved to this new package.
• sempy_labs.gateway 🚀 New!
  • Gateway functions have been moved to this new package.
• sempy_labs.git🚀 New!
  • Git functions have been moved to this new package.
• sempy_labs.graphql 🚀 New!
  • GraphQL functions have been moved to this new package.
• sempy_labs.kql_database 🚀 New!
  • KQL Database functions have been moved to this new package.
• sempy_labs.kql_queryset 🚀 New!
  • KQL Queryset functions have been moved to this new package.
• sempy_labs.managed_private_endpoint 🚀 New!
  • Managed Private Endpoint functions have been moved to this new package.
• sempy_labs.mirrored_database 🚀 New!
  • Mirrored Database functions have been moved to this new package.
• sempy_labs.mirrored_warehouse 🚀 New!
  • Mirrored Warehouse functions have been moved to this new package.
• sempy_labs.ml_experiment 🚀 New!
  • ML Experiment functions have been moved to this new package.
• sempy_labs.mounted_data_factory 🚀 New!
  • Mounted Data Factory functions have been moved to this new package.
• sempy_labs.notebook 🚀 New!
  • Notebook functions have been moved to this new package.
• sempy_labs.spark 🚀 New!
  • Spark functions have been moved to this new package.
• sempy_labs.sql_endpoint 🚀 New!
  • SQL Endpoint functions have been moved to this new package.

Bug Fixes

• #660
• #690
• #1006
• #1020
• #1021
• #1040
• #1064

New Functions

• sempy_labs
  • list_favorites Lists all items you have marked as a favorite.
  • list_endorsements Lists all items which have been endorsed.
  • takeover_item_ownership Allows you to take over ownership of a report or semantic model.
• sempy_labs.variable_library
  • update_variable Update the properties of a variable (within a variable library).
  • update_variable_library Update the properties of a variable library.
• sempy_labs.dataflow 🚀 New!
  • execute_query
  • list_dataflows, list_dataflow_storage_accounts, assign_workspace_to_dataflow_storage, list_upstream_dataflows, upgrade_dataflow, get_dataflow_definition, discover_dataflow_parameters are now available in the dataflow package. They will remain in sempy_labs for a transition period.
• sempy_labs.eventhouse 🚀 New!
  • Functions related to eventhouses are now available in this package. They will remain in sempy_labs for a transition period.
• sempy_labs.semantic_model 🚀 New!
  • set_endorsement Sets a semantic model as endorsed (i.e. Promoted, Certified etc.).
  • approved_for_copilot Mark a semantic model as approved for Copilot.
  • make_discoverable Mark a semantic model as discoverable (must be endorsed first).

Updated Functions

• sempy_labs.report
  • set_endorsement added new endorsement settings ('Certified', 'Master data'). (#1024)

Bug Fixes

• #949
• #1023
• #1026
• #1034

New Functions

• sempy_labs
  • modify_immutability_policy
• sempy_labs.admin
  • sync_role_assignments_to_subdomains
• sempy_labs.apache_airflow_job 🚀 New!
  • list_apache_airflow_jobs
  • delete_apache_airflow_job
  • list_apache_airflow_job_files
  • delete_apache_airflow_job_file
  • create_or_update_apache_airflow_job_file
• sempy_labs.report
  • set_endorsement Sets the endorsement for a given Power BI report (#1001).
• sempy_labs.variable_library
  • create_variable_library Creates a new variable library in a simplified fashion.
• sempy_labs.warehouse_snapshot 🚀 New!
  • create_warehouse_snapshot
  • delete_warehouse_snapshot
  • list_warehouse_snapshots
  • update_warehouse_snapshot
• sempy_labs.workspace 🚀 New!
  • list_workspace_users
  • update_workspace_user
  • add_user_to_workspace
  • delete_user_from_workspace
  • assign_to_capacity
  • unassign_from_capacity
  • list_role_assignments
  • delete_workspace
  • get_network_communication_policy
  • set_network_communication_policy
  • get_git_outbound_policy
  • set_git_outbound_policy
  • get_outbound_cloud_connection_rules
  • get_outbound_gateway_rules
  • set_outbound_gateway_rules

Updated Functions

• sempy_labs
  • get_tables_mirroring_status Added the 'Last Sync Latency In Seconds' column (#1005).
  • get_item_definition Now supports the 'Ontology' and 'Lakehouse' items.
• sempy_labs.lakehouse
  • create_shortcut_onelake Now supports additional source items (previously only supported lakehouses). Note that the parameter has changed from 'source_lakehouse' to 'source_item' and a new parameter has been added 'source_item_type'. (#501).

Bug Fixes

• #960

New Functions

• sempy_labs
  • cancel_item_job_instance (#950)
• sempy_labs.lakehouse
  • is_schema_enabled identifies whether a lakehouse is schema-enabled.
• sempy_labs.snowflake_database
  • list_snowflake_databases
  • delete_snowflake_database

Updated Functions

• sempy_labs
  • get_item_definition now supports Snowflake Databases, Cosmos DB Databases, and Operations Agents.

Bug Fixes

• #836
• #949
• #970
• #971
• #973
• #975
• #976
• #982

New Functions

• sempy_labs
  • list_domains This is the non-admin version. The admin version of this function already exists in the admin package.
  • get_workspace_git_outbound_policy
  • set_workspace_git_outbound_policy
• sempy_labs.deployment_pipeline
  • deploy_stage_content (#960)
• sempy_labs.directlake
  • set_autosync Sets whether a Direct Lake semantic model detects data changes in OneLake and automatically updates the Direct Lake tables that are included in the semantic model.
• sempy_labs.graph_model 🚀 New!
  • list_graph_models
  • execute_query
  • get_queryable_graph_type
  • refresh_graph
• sempy_labs.lakehouse
  • list_schemas Lists all schemas within a given lakehouse.
  • schema_exists Checks if a schema exists in a given lakehouse.
• sempy_labs.sql_database 🚀 New!
  • start_mirroring
  • stop_mirroring
• sempy_labs.warehouse 🚀 New!
  • list_restore_points
  • create_restore_point
  • delete_restore_point
  • update_restore_point
  • restore_to_restore_point

Updated Functions

• sempy_labs
  • list_lakehouses Added new columns: Schema Enabled, Default Schema, Sensitivity Label Id
• sempy_labs.report.ReportWrapper
  • list_bookmarks Added new columns: Current Page Selected, Apply Visual Display State, Apply To All Visuals (#944).
• sempy_labs.sql_database
  • list_sql_databases, create_sql_database, delete_sql_database, get_sql_database_tables, get_sql_database_columns have been moved from sempy_labs to sempy_labs.sql_database.
• sempy_labs.lakehouse
  • list_lakehouses is now in this package (it will remain in the sempy_labs package for a temporary period). Added new columns: Schema Enabled, Default Schema, Sensitivity Label Id
  • get_lakehouse_tables Updated to use the OneLake APIs for schema-enabled lakehouses.
• sempy_labs.warehouse
  • Moved the following functions to the sempy_labs.warehouse package (they will remain in sempy_labs for now) create_warehouse, delete_warehouse, list_warehouses, get_warehouse_tables, get_warehouse_columns

Bug Fixes

• #938
• #940

New Functions

• sempy_labs
  • OneLake Settings
    • get_onelake_settings
    • modify_onelake_diagnostics
  • Dataflows
    • discover_dataflow_parameters
  • Managed Private Endpoints
    • list_managed_private_endpoint_fqdns
• sempy_labs.deployment_pipeline
  • list_deployment_pipelines
  • list_deployment_pipeline_role_assignments
  • list_deployment_pipeline_stages
  • list_deployment_pipeline_stage_items
  • unassign_workspace_from_stage
  • assign_workspace_to_stage
  • delete_deployment_pipeline
• sempy_labs.graph
  • list_group_transitive_members (#930)

Updated Functions

• sempy_labs.directlake
  • Added the 'columns' parameter to the add_table_to_direct_lake_semantic_model (#814)
• sempy_labs.graph
  • Added output column 'Department' and added optional parameter 'show_manager' to list_users and get_user (#925).

Bug Fixes

• #883
• #884
• #895
• #905
• #906
• #910
• #911
• #913

New Functions

• sempy_labs
  • get_sql_audit_settings
  • update_sql_audit_settings
  • set_audit_actions_and_group
  • list_user_defined_functions Lists the user-defined functions within a semantic model.
• sempy_labs.admin
  • bulk_set_labels
  • bulk_remove_labels
• sempy_labs.eventstream 🚀 New!
  • list_eventstreams
  • create_eventstream
  • delete_eventstream
  • get_eventstream_definition
  • get_eventstream_destination
  • get_eventstream_destination_connection
  • get_eventstream_source
  • get_eventstream_source_connection
  • get_evenstream_topology
  • pause_eventstream
  • puase_eventstream_destination
  • pause_evenstream_source
  • resume_eventstream
  • resume_eventstream_destination
  • resume_eventstream_source
• sempy_labs.graph
  • resolve_sensitivity_label_id
  • add_user_license
  • remove_user_license
• sempy_labs.tom
  • set_compatibility_level Sets the compatibility level of the semantic model.
  • set_user_defined_function Creates a new (or updates an existing) user-defined function in the semantic model.
  • list_user_defined_functions Shows all user-defined functions.

Updated Functions

• sempy_labs
  • list_semantic_model_errors Now shows errors from user-defined functions.
• sempy_labs.tom
  • remove_object Now supports removing user-defined functions.

Bug Fixes

• #870
• #877
• #881
• #882
• #885
• #888
• #889 (thanks @vytautas9!)
• #896 (thanks @richbenmintz!)
• #897

New Functions

• sempy_labs
  • get_connection_string This function replaces the 'get_warehouse_connection_string' and serves as generic function which supports Lakehouses, Warehouses, & SQL Endpoints.
  • bind_semantic_model_connection
  • unbind_semantic_model_connection
• sempy_labs.graph
  • list_sensitivity_labels

Updated Functions

• sempy_labs
  • refresh_sql_endpoint_metadata (#870) Removed the 'tables' parameter as it is no longer supported by the API. Added the 'timeout_unit' and 'timeout_value' parameters as they are now supported by the API.
• sempy_labs.tom
  • convert_direct_lake_to_import (#871)

Bug Fixes

• #383

New Functions

• sempy_labs
  • get_warehouse_connection_string
  • list_data_access_roles
• sempy_labs.admin
  • remove_all_sharing_links
  • remove_sharing_links
• sempy_labs.graph
  • create_user
  • delete_user
  • update_user
  • create_group
  • delete_group
  • update_group
• sempy_labs.report.ReportWrapper
  • list_visual_calculations (#848)

Bug Fixes

• #383
• #800
• #839
• #843
• #855
• #859
• #861

Bug Fixes

• #841
• Fixed typo in sempy_labs.report.report_rebind_all

Announcement on Service Principal Authentication (#171):

All functions in both Semantic Link & Semantic Link Labs which use APIs which inherently support service principal authentication can now be run using the service_principal_authentication context manager.

New Functions

• sempy_labs
  • get_item_definition
  • get_workspace_network_communication_policy
  • set_workspace_network_communication_policy
• sempy_labs.admin
  • list_tenant_keys
  • rotate_tenant_key
• sempy_labs.lakehouse
  • refresh_materialized_lake_views

Updated Functions

• sempy_labs
  • copy_item Added the optional 'keep_existing_bindings' parameter which allows reports to be kept bound to their original semantic model (if the target item already exists).
  • list_item_connections Parameters have changed to 'item' and 'type' (item_name & item_type still work but please use item & type). The 'item' parameter now supports either name or ID.
• sempy_labs.tom
  • convert_direct_lake_to_import Updated the syntax of the newly created import partition.
• sempy_labs.admin
  • list_capacities Added the 'include_tenant_key' parameter.

Bug Fixes

• #485
• #769
• #797 (also added the 'data_source_object_ids' parameter to this function).
• #800
• #808
• #811
• #815
• #821
• #827
• #831
• #833

New Functions

• sempy_labs
  • delete_external_data_share Deletes an external data share item.
  • list_item_labels Shows all items within a workspace and their sensitivity label.
  • list_notebooks
  • search_notebooks Search notebooks for a given string (to identify which notebooks contain that string).
  • copy_item Copies an item (with a definition) to another (specified) location.
• sempy_labs.ml_model
  • activate_ml_model_endpoint_version
  • deactivate_all_ml_model_endpoint_versions
  • deactivate_ml_model_endpoint_version
  • list_ml_model_endpoint_versions
  • score_ml_model_endpoint
  • score_ml_model_endpoint_version
  • create_ml_model, list_ml_models, delete_ml_model have been moved to this package.
• sempy_labs.variable_library
  • get_variable_library
  • list_variables
  • get_variable_library_definition
  • get_variable_values
  • get_variable_value
  • list_variable_libraries, delete_variable_library have been moved to this package.

Updated Functions

• sempy_labs
  • All external data share functions now support service principal authentication.
  • is_default_semantic_model now supports dataset name or ID.
• sempy_labs.graph
  • send_mail Updated the content types to support .geojson files (#520).
• sempy_labs.migration
  • Direct Lake Migration now defaults to migrating to Direct Lake over OneLake (previously defaulted to Direct Lake over the SQL Endpoint).

Removed Functions

• The 'generate_dax_query_view_url' function is no longer supported by the Power BI product team.

Bug Fixes

• #781
• #786
• #789

Updated Functions

• sempy_labs.graph
  • send_mail The following parameters have been added: priority, follow_up_flag, attachments (#520).

Bug Fixes

• #732
• #736
• #742
• #746
• #751
• #752
• #757 (thanks @erlendoeien!)
• is_v_ordered fixed edge case scenario.

New Functions

• sempy_labs
  • Dataflows
    • get_dataflow_definition Gets the definition of a dataflow (Gen1 / Gen2 / Gen2 CI/CD) (#727). Thanks @itsnotaboutthecell!
    • upgrade_dataflow Upgrades a dataflow Gen1 or Gen2 -> Gen2 CI/CD. Thanks @itsnotaboutthecell!
• sempy_labs.admin
  • list_orphaned_workspaces Easily view only orphaned workspaces. Thanks @pawarbi!
• sempy_labs.theme
  • list_org_themes Lists all organizational themes.
  • get_org_theme_json Shows the .json of a given organizational theme.
• sempy_labs.tom
  • set_synonym (#89) Set a synonym on the linguistic metadata of a semantic model.
  • delete_synonym Delete a synonym on the linguistic metadata of a semantic model.

Updated Functions

• sempy_labs
  • list_dataflows Now lists all dataflow generations (Gen1, Gen2, Gen 2 CI/CD). Thanks @itsnotaboutthecell!
• sempy_labs.lakehouse
  • get_lakehouse_tables Now supports schema-enabled lakehouses. Thanks @tarente!
  • run_table_maintenanceNow waits for the table maintenance job to complete. Also returns a dataframe showing the job stats upon completion/failure (#709).
• sempy_labs.report
  • ReportWrapper.list_visuals Added the 'URL' column which provides a link to a focused view of the particular visual (#713).
  • run_report_bpa The 'URL' output now provides direct links to the relevant item (report, page or visual). The new part here is direct links to visuals (same as in list_visuals).
  • ReportWrapper.set_theme Now you can set a theme either using a file path or the theme json itself. There are 2 parameters and you must use only 1 of them (theme_file_path, theme_json). This function was updated to support easily setting a report theme based on an organizational theme using the get_org_theme_json function.
• sempy_labs.tom
  • set_ols The 'column_name' parameter is now optional. If it is not specified, OLS is set on the table (#728).

Bug Fixes

• #718
• #719 thanks @vytautas9!
• #730

New Functions

• sempy_labs
  • list_semantic_model_datasources
  • refresh_sql_endpoint_metadata
• sempy_labs.mirrored_azure_databricks_catalog
  • refresh_catalog_metadata
  • discover_catalogs
  • discover_schemas
  • discover_tables
• sempy_labs.tom
  • format_dax Formats the DAX of measures, calculated columns, calculated tables, calculation items and row level security expressions using the DAX Formatter API.

Bug Fixes

• #699
• #700
• Fixed issue with create_notebook

New Functions

• sempy_labs.report

  • ReportWrapper (Huge thanks to @ruiromano for his partnership in creating and testing the new capabilities within the ReportWrapper)!
    • get Allows you to get the definition of a particular file within a report definition. This also supports specifying a JSONPath.
    • add Allows you to add a file to the definition of a report.
    • update Allows you to update a file's definition within a report.
    • remove Allows you to remove a file from the report definition. This also supports specifying a JSONPath.
    • set_json Allows you to add/update json content for a particular file and JSONPath.
  • connect_report Similar to connect_semantic_model only for reports. Not only has the readonly parameter (setting to False allows you to make changes to the report) but has a 'show_diffs' parameter which shows you a CI/CD color-coded code comparison between the existing json files and what has changed (if changes were made to the report within this function).

• NOTE: functions within the ReportWrapper that update the report (i.e. set_page_visibility) now require the readonly parameter to be set to False (and be executed within the connect_report context manager.

Updated Functions

• get_user_delegation_key has been moved to the sempy_labs package (previously it was in the sempy_labs.lakehouse package)

New Functions

• sempy_labs

  • Semantic Models
    • create_vpax Creates a .vpax file a la Vertipaq Analyzer. Thanks @marcosqlbi & @dgosbell!
    • update_semantic_model_refresh_schedule (#679)
  • Environments
    • list_environments
  • Tags
    • list_tags
    • apply_tags
    • unapply_tags
  • Variable Libraries
    • list_variable_libraries
    • delete_variable_library

• sempy_labs.admin

  • Tags
    • create_tags
    • delete_tag
    • update_tag

• sempy_labs.lakehouse

  • is_v_ordered Checks if a delta table is v-ordered
  • delete_lakehouse (#653)
  • update_lakehouse (#653)
  • load_table (#653)
  • list_livy_sessions
  • get_user_delegation_key

• sempy_labs.tom

  • copy_object Copies/clones an object from one semantic model to another. As an example, this function can copy a table from one semantic model to another.

Updated Functions

• sempy_labs
  • query_kusto Removed logic which caused DateTime columns to display as integers instead of as dates.
  • get_notebook_definition, create_notebook, update_notebook_definition Added the 'format' parameter. Thanks @lBilali!
• sempy_labs.directlake
  • update_direct_lake_model_connection Added the 'tables' parameter to support updating the Direct Lake connection for specific tables in a model (#659).

Bug Fixes

• #462
• #630 (list_blobs now supports pagination)
• #641
• #663
• #668
• #669
• #671
• #675

New Functions

• sempy_labs
  • query_kusto Query a KQL database using either KQL or SQL. Thanks @pawarbi!
  • query_workspace_monitoring View workspace monitoring stats by running either a KQL or SQL query.
• sempy_labs.admin
  • get_refreshables Thanks @ecotte!
  • export_dataflow Thanks @ecotte!

Updated Functions

• sempy_labs
  • backup_semantic_model Added the optional 'password' parameter. Thanks @MitchSS!
  • restore_semantic_model Added the optional 'password' parameter. Thanks @MitchSS!
  • save_as_delta_table This function can now be executed in either a PySpark or pure python notebook. (#623)
• sempy_labs.lakehouse
  • optimize_lakehouse_tables This function can be executed in either a PySpark or pure python notebook (#542)
  • vacuum_lakehouse_tables This function can be executed in either a PySpark or pure python notebook (#542).
  • get_lakehouse_tables Now supports Service Principal authentication (#609). This function can now be executed in either a PySpark or pure python notebook.
  • get_lakehouse_columns Now supports Service Principal authentication. This function can now be executed in either a PySpark or pure python notebook.

Bug Fixes

• #616
• #622
• sempy_labs
  • Fixed issue with Direct Lake semantic models using vertipaq_analyzer
  • Fixed issue with get_semantic_model_size
• sempy_labs.admin
  • list_unused_artifacts Fixed reversed name and ID.
• sempy_labs.directlake
  • Fixed issue in generate_shared_expression for Direct Lake over OneLake connections

• Fixed issue with semantic link scopes for particular Fabric API references
• Fixed issue with create_abfss_path

• Fixed bug regarding duplicated 'resolve' functions.

New Functions

• sempy_labs
  • delta_analyzer_history Thanks @dax-tips!
• sempy_labs.lakehouse
  • recover_lakehouse_object Recovers a deleted object (i.e. table/file/folder) from a lakehouse (#123). Thanks @hurtn!
  • list_blobs lists the blob files for a given lakehouse.
• sempy_labs.report
  • save_report_as_pbip Saves a report in the service as a .pbip file within the specified lakehouse. This is a solution to downloading 'undownloadable' reports/models (which are likely undownloadable due to changes made via XMLA R/W).
• sempy_labs.tom
  • convert_direct_lake_to_import Converts a table which is in Direct Lake mode to import mode using the specified source as the source (lakehouse or warehouse).

Updated Functions

• sempy_labs
  • run_model_bpa_bulk The 'workspace' parameter now supports both workspace names and/or IDs (#568).
• sempy_labs.admin
  • list_domain_tenant_settings_overrides now shows the Domain Id.
  • list_workspaces_tenant_settings_overrides now shows the Workspace Id.
• sempy_labs.directlake
  • generate_shared_expression Added the 'use_sql_endpoint' parameter. If set to False, will build a 'Direct Lake over OneLake' connection to the lakehouse (if a lakehouse is specified as the item type).
• sempy_labs.lakehouse
  • create_shortcut_onelake Added the 'shortcut_conflict_policy' parameter (#587).
• sempy_labs.migration
  • migrate_direct_lake_to_import Added the 'tables' and 'mode' parameters which allow you to migrate a portion of the Direct Lake semantic model to either import or DirectQuery. Specifying tables will only migrate those tables to the mode which you specify.

Bug Fixes

• #561
• #573
• #581
• #595

New Functions

• sempy_labs
  • Semantic Models
    • generate_dax_query_view_url prints a URL which opens DAX Query View with the specified query to the specified semantic model. Thanks @datazoe!
    • delete_semantic_model
  • Workspaces
    • delete_workspace
  • SQL Database
    • create_sql_database
    • delete_sql_database
    • list_sql_databases

Updated Functions

• sempy_labs
  • delta_analyzer added the optional 'schema' parameter to support schema-enabled tables (#547).
  • get_delta_table_history added the optional 'schema' parameter to support schema-enabled tables.
  • create_abfss_path added the optional 'schema' parameter.
• sempy_labs.directlake
  • direct_lake_schema_sync added the 'remove_from_model' parameter (#448). This function also now returns a dataframe.

Service Principal

The following functions now support service principal authentication:

• list_environments
• publish_environment
• list_eventhouses
• list_graphql_apis
• list_kql_databases
• list_lakehouses
• create_managed_private_endpoint
• list_managed_private_endpoints
• delete_managed_private_endpoint
• list_mirrored_databases
• list_sql_databases
• list_warehouses
• provision_workspace_identity
• deprovision_workspace_identity
• delete_user_from_workspace
• update_workspace_user
• list_workspace_users
• unassign_workspace_from_capacity
• list_workspace_role_assignments
• delete_workspace

Bug Fixes

• #551

Maintenance

• Refactored 'resolve' functions to support Service Principal. This will enable many more functions (listed above) in Semantic Link Labs to support Service Principal authentication.

New Functions

• sempy_labs
  • Git
    • get_my_git_credentials
    • update_my_git_credentials
  • Mounted Data Factories
    • list_mounted_data_factories
    • delete_mounted_data_factory
    • get_mounted_data_factory_definition
• sempy_labs.admin
  • Artifacts
    • list_unused_artifacts
  • Capacities
    • list_capacity_users
  • Subscriptions
    • list_user_subscriptions
    • list_report_subscriptions
  • Workspaces
    • add_user_to_workspace (#539)
    • delete_user_from_workspace
    • restore_deleted_workspace

Updated Functions

• sempy_labs
  • vertipaq_analyzer Now returns a dictionary of dataframes (#481, #538).
  • The following functions changed the 'capacity_name' parameter to 'capacity' and now accept either the capacity name or ID: resolve_capacity_id, delete_premium_capacity, delete_fabric_capacity, create_vnet_gateway
• sempy_labs.directlake
  • update_direct_lake_partition_entity Added the 'schema' parameter for working with schema-enabled lakehouses. Setting this parameter to None keeps the existing schema.
• sempy_labs.lakehouse
  • list_shortcuts Moved this function to the lakehouse subpackage. It will remain in the sempy_labs subpackage for some time so as not to break existing code but please update your code to use this funtion in this new location (where it should have been all along). Added the 'path' parameter and improved the code (thanks @lBilali!).
  • create_shortcut_onelake
    • Now checks whether the shortcut already exists before creating the shortcut (#521).
• sempy_labs.tom
  • add_to_perspective Added the 'include_all' property, relevant for tables only.
  • has_incremental_refresh_policy Updated the parameter to take a TOM object instead of a table name. This is a breaking change.

Bug Fixes

• #518
• #522
• #524

New Functions

• sempy_labs
  • Eventhouses
    • get_eventhouse_definition
  • Semantic Models
    • get_semantic_model_refresh_schedule
    • enable_semantic_model_scheduled_refresh
  • Delta Tables
    • get_delta_table_history
  • SQL Databases (Thanks @achrafcei!)
    • ConnectSQLDatabase
    • get_sql_database_tables
    • get_sql_database_columns
  • Job Scheduler
    • create_item_schedule_cron
    • create_item_schedule_daily
    • create_item_schedule_weekly
• sempy_labs.admin
  • Widely Shared Artifacts
    • list_widely_shared_artifacts Both of the widely shared artifacts APIs can be called from this single function. Simply specify the 'api_name' parameter accordingly.
  • Apps
    • list_apps
    • list_app_users
  • Semantic Models
    • list_dataset_users
  • Reports
    • list_report_users
  • Workspaces
    • list_workspace_users
  • Capacities
    • patch_capacity
  • Tenants
    • list_capacity_tenant_settings_overrides (use this instead of list_capacities_delegated_tenant_settings
    • delete_capacity_tenant_setting_override
    • update_tenant_setting
    • update_capacity_tenant_setting_override
    • list_workspaces_tenant_settings_overrides
    • list_domain_tenant_settings_overrides
• sempy_labs.tom
  • get_bim Gets the bim file for the semantic model

Updated Functions

• sempy_labs
  • run_model_bpa Now supports rules based on calculated tables and calculated columns
  • model_bpa_rules Updated DAX expression rules to check calculated tables & calculated columns.
  • deploy_semantic_model Added the 'perspective' parameter. Set this parameter to a perspective within the model to reduce the deployed model to only the objects within that perspective. Dependent objects (i.e. columns, measures, tables) are also added into the deployed model to ensure an errorless model. This technique is akin to the master model technique.
  • create_eventhouse Added the 'definition' parameter which accepts the 'EventhouseProperties.json' definition.
  • initialize_git_connection Added the 'initialization_strategy' parameter. Thanks @hurtn!
  • export_report Added the 'lakehouse' and 'lakehouse_workspace' parameters so this function can export a report to any lakehouse/workspace (#494).
  • delta_analyzer this function now supports analyzer partitioned delta tables. Also added the 'column_stats' parameter. If this is set to False, only the first 3 dataframes are returned (thereby executing faster).
  • evaluate_dax_impersonation Better handling of optional columns (#499).
  • ConnectLakehouse, ConnectWarehouse updated default timeout to 30 seconds.
• sempy_labs.graph
  • send_mail added the 'content_type' parameter which allows you to send either Text or HTML emails. Thanks @pawarbi for the suggestion!
• sempy_labs.lakehouse
  • create_shortcut_onelake added the 'source_path' and 'destination_path' parameters to make the function more flexible in working not just with tables but also with files (and able to map not just to a folder but to subfolders (#475).
  • delete_shortcut added the 'shortcut_path' parameter to make the function more flexible in working not just with tables but also with files (#480).
• sempy_labs.tom
  • remove_translation Added the 'property' parameter so you can remove not just translated names but also descriptions and display folders.
  • remove_object Updated accordingly for the update to remove_translation

Bug Fixes

• #442
• #467
• #473
• #495
• #500
• Fixed issue with graph.list_teams

Improvements

• Updated Functions

  • sempy_labs
    • delta_analyzer Added 'lakehouse' and 'workspace' parameters so now you can analyze any delta table from any lakehouse/workspace - not just in the lakehouse attached to the notebook. Note that if you export the delta analyzer results they will be saved to delta tables in the lakehouse attached to the notebook.
    • create_abfss_path Made the 'delta_table_name' parameter optional so this function can also build the abfss path of a given lakehouse (not just a delta table).
    • Connection & Gateway functions now support Service Principal Authentication. Thanks @ecotte!
  • sempy_labs.admin
    • scan_workspaces Limited to 100 workspaces (per API limit). Improvements for passing workspace name/IDs. Thanks @ecotte!

• General updates

  • Most functions in semantic link labs can be executed using pure python notebooks. Some functions (in some instances) require PySpark notebooks. If you run a function which requires a PySpark notebook in a pure python notebook, a friendly error message will notify you as such.

Bug Fixes

• #398
• #444
• #445
• #447
• Bug in report_rebind has been resolved.

Improvements

• New Functions

  • sempy_labs
    • delta_analyzer Provides statistics about delta tables, specifically relevant regarding their use in Direct Lake semantic models. This code is based on the work of @dax-tips! More info can be found here.
    • list_synonyms Lists the synonyms from a semantic model's linguistic schema
    • GraphQL
      • list_graphql_apis
      • create_graphql_api
  • sempy_labs.admin
    • get_capacity_state (#424).
  • $${\color{green}NEW!}$$ sempy_labs.graph functions to support Microsoft Graph)
    • Users
      • get_user
      • list_users
      • send_mail
      • resolve_user_id
    • Groups
      • list_groups
      • list_group_owners
      • list_group_members
      • add_group_members
      • add_group_owners
      • resolve_group_id
      • renew_group
    • Teams
      • list_teams
  • sempy_labs.lakehouse
    • reset_shortcut_cache
    • run_table_maintenance
  • sempy_labs.migration
    • migrate_direct_lake_to_import In-place migration of a semantic model from Direct Lake mode to Import mode.

• Updated Functions

  • sempy_labs
    • list_deployment_pipeline_stages parameters now accept either name or ID.
    • list_deployment_pipeline_stage_items parameters now accept either name or ID. Changed parameter 'stage_name' to 'stage' as it can be either name or ID.
  • sempy_labs.admin
    • All 'domain' functions accept either name or ID. The parameter is now 'domain' instead of 'domain_name'.
  • sempy_labs.lakehouse
    • lakehouse_attached No longer uses Spark to determine if a lakehouse is attached to the notebook.

Bug Fixes

• #423
• #430
• #436

Maintenance

• Functions which query Microsoft APIs now use an internal function (in Semantic Link Labs) to reduce and simplify code.
• Functions which return pandas dataframes and specify data types have been refactored to reduce and simplify code.

Notebooks

• Delta Analyzer Shows how to use the new delta_analyzer function.
• Service Principal Added examples for using the new wrapper functions for Microsoft Graph which were released in this version.

Bug Fixes

• Fixed minor critical issue with service principal authentication.

Improvements

• Authentication via Service Principal is now supported for the admin and tom (connect_semantic_model) subpackages. For connect_semantic_model, Service Principal Authentication is also supported for connecting to semantic models hosted on Azure Analysis Services.

To see code examples for authenticating via Service Principal, click here.

New Functions

• sempy_labs
  • Authentication
    • service_principal_authentication Context manager to support Service Principal authentication.
  • Capacities
    • list_skus
    • list_skus_for_capacity
  • Job Scheduler
    • list_item_schedules
    • run_on_demand_item_job
  • Subscriptions
    • list_subscriptions
    • get_subscription
  • Tenants
    • list_tenants
  • Resource Groups
    • list_resource_groups
    • get_resource_group
    • create_or_update_resource_group
    • check_resource_group_existence
  • Storage Accounts
    • list_storage_accounts
    • create_storage_account

Updated Functions

• sempy_labs
  • run_model_bpa added the 'check_dependencies' parameter. Set this to False for semantic models which are in shared workspaces so that the dependencies DMV check is not done and the remainder of the BPA rules can run (#189).
  • The following functions now leverage the Service Principal Authentication context manager: create_fabric_capacity, suspend_fabric_capacity, resume_fabric_capacity, delete_fabric_capacity, delete_embedded_capacity, update_fabric_capacity, check_fabric_capacity_name_availablility, create_resource_group, list_skus_for_capacity, list_skus, list_subscriptions, get_subscription, list_tenants, create_or_update_resource_group, create_storage_account, list_storage_accounts, check_resource_group_existence, list_resource_groups, get_resource_group
• sempy_labs.admin
  • All relevant functions now support authentication via Service Principal.
• sempy_labs.tom
  • connect_semantic_model Now supports Service Principal authentication via the service_principal_authencation context manager. This method also supports connecting to Azure Analysis Services (AAS) semantic models (simply enter the Azure AS server name in the the 'workspace' parameter and make sure to use the service principal authentication).

Dependencies

• Removed dependency on the azure.mgmt.resource python SDK. Removing this dependency will improve pip install times for Semantic Link Labs while maintaining all existing functionality.
• Updated semantic-link-sempy to 0.8.5

Removed Functionality

[!IMPORTANT] If you are impacted by any of the aforementioned changes, please raise an issue on GitHub with your concern (and ideally your company name as well)

• The P->F sku migration capability no longer migrates capacity settings. This is due to a restriction on certain APIs which are no longer accessible.
• Getting the source of a Direct Lake semantic model (lakehouse/warehouse & workspace) now only works when the source exists in the same workspace as the semantic model. This is due to a restriction on an API which is no longer accessible.
• Getting all downstream reports from a semantic model (cross-workspace) is no longer possible. This functionality is limited to reports which are in the same workspace as the semantic model. This is due to a restriction on an API which is no longer accessible.

Bug Fixes

• #375
• #383
• #408

Notebooks

• Service Principal Contains instructions on how to use functions while authenticating via Service Principal.
• Semantic Model Management Contains instructions for backing up, copying and restoring semantic models.

Improvements

• New Functions

  • sempy_labs
    • Job Scheduler
      • list_item_job_instances (per request)
    • Git (the following functions replace the 'connect_workspace_to_git' function.
      • connect_workspace_to_azure_dev_ops
      • connect_workspace_to_github
  • sempy_labs.tom
    • remove_role_member

• Updated Functions

  • sempy_labs
    • Most (relevant) functions now accept dataset ID or Name; workspace ID or Name.
  • sempy_labs.directlake
    • Cache warming functions leverage updated DAX which yields better performance.

Bug Fixes

• #363
• #370
• Fixed list_dataflows
• Fixed get_capacity_id
• Fixed get_model_calc_dependencies issue which could result in an infinite loop.
• Fixed unqualified_columns logic.
• Fixed qualified_measures logic.

Improvements

• New Functions

  • sempy_labs
    • list_server_properties Shows the server properties for a given workspace.
    • list_semantic_model_errors Shows if the model has any errors and their error messages.
    • get_tenant_id
    • bind_semantic_model_to_gateway
  • sempy_labs.tom
    • add_role_member
  • sempy_labs.admin
    • scan_workspaces Wrapper function for the Scanner API.

• Updated Functions

  • sempy_labs
    • run_model_bpa Setting 'extended=True' no longer requires annotations to be saved to the model.
    • list_dashboards Bug fixed in resolving the workspace.
    • run_model_bpa, get_model_calc_dependencies, refresh_semantic_model The 'dataset' parameter now takes either the name or ID of the semantic model.
    • get_notebook_definition now works for any type of notebook (.py, .sql etc.)
    • create_notebook Added the 'type' parameter so you can create other types of notebooks ('py, 'sql').
  • sempy_labs.admin
    • list_activity_events Additional columns added (#340).
  • sempy_labs.directlake
    • check_fallback_reason The 'dataset' parameter now takes either the name or ID of the semantic model.
  • sempy_labs.tom
    • TOMWrapper The 'dataset' parameter now takes either the name or ID of the semantic model. Same for connect_semantic_model.

Bug Fixes

• #331
• #335

Improvements

• New Functions
  • sempy_labs
    • get_semantic_model_definition (#300)
  • sempy_labs
    • get_capacity_assignment_status
• Updated Functions
  • sempy_labs
    • get_dax_query_dependencies Added the 'show_vertipaq_stats' parameter. The 'dax_string' parameter now accepts either a single DAX query or a list of DAX queries.
  • sempy_labs.report.ReportWrapper
    • list_visual_objects now shows the Object Display Name (if it was customized within the visual).

Bug Fixes

• sempy_labs.admin
  • assign_workspaces_to_capacity Fixed issue where the function didn't resolve if workspace was set to None.
• #186
• #314
• #317
• #326

Bug Fixes

• #254
• #280

Improvements

• New Functions

  • sempy_labs
    • Connections
      • create_cloud_connection
      • create_vnet_connection
      • create_on_prem_connection
      • list_connection_role_assignments
      • delete_connection_role_assignment
      • delete_connection
    • Gateways
      • list_gateways
      • delete_gateway
      • list_gateway_role_assigments
      • delete_gateway_role_assignment
      • list_gateway_members
      • create_vnet_gateway
      • delete_gateway_member
      • update_on_premises_gateway
      • update_vnet_gateway
    • Authentication
      • ServicePrincipalTokenProvider Class which generates a token provider via Azure Key Vault or Service Principal keys. This is the foundation for authenticating relevant functions via Service Principal. Thanks @ecotte!
      • ServicePrincipalTokenProvider.from_azure_key_vault Obtains a token provider using Azure Key Vault credentials.
      • ServicePrincipalTokenProvider.from_aad_application_key_authentication Obtains a token provider using Service Principal keys.
  • sempy_labs.admin
    • list_git_connections
    • list_reports

• Updated Functions

  • sempy_labs
    • list_connections Now supports pagination.
    • initialize_git_connection Now returns commit hash. Thanks @hurtn!
    • refresh_semantic_model Added 'commit_mode' parameter. Thanks @gbrueckl!
  • sempy_labs.report
    • get_report_definition Added the 'return_dataframe' parameter which defaults to True. If set to False, the function returns the json dictionary output.
  • sempy_labs.report.ReportWrapper
    • list_visuals Title, SubTitle, AltText now support non-literal values (#218) Thanks @stephbruno!
  • sempy_labs.admin Thanks @ecotte!
    • list_workspaces Now uses the Fabric API and defaults to returning all workspaces. 'filter' parameter is no longer supported. New parameters available: capacity, workspace, workspace_state, workspace_type.
    • list_capacities Now supports capacity name or Id.
    • assign_workspaces_to_capacity Now supports workspace name or Ids.
    • unassign_workspaces_from_capacity Now supports capacity name or Id.
    • revoke_external_data_share Supports workspace name or Id.
    • list_items Supports capacity name or Id, workspace name or Id.
    • list_item_access_details Supports Item Id or name & type. Supports workspace Id or Name.
    • list_activity_events Added the 'return_dataframe' parameter, allowing for returning the json dictionary output (if set to False).

Bug Fixes

• sempy_labs
  • update_from_git
  • update_semantic_model_from_bim
  • #288
  • #290

Bug Fixes

• #274
• #277
• sempy_labs.migration
  • create_pqt_file Fixed the file naming convention when multiple pqt files are generated.

Improvements

• New Functions
  • sempy_labs
    • DAX
      • get_dax_query_dependencies Obtains the columns on which a DAX query depends, including model dependencies (inspired by Chris Webb's blog post).
      • get_dax_query_memory_size Obtains the total size, in bytes, used by all columns that a DAX query depends on (inspired by Chris Webb's blog post).
    • Dataflows
      • list_upstream_dataflows Thanks to Alex Powers, this shows all dataflows upstream of a given dataflow.
    • Mirroring
      • list_mirrored_databases
      • start_mirroring
      • stop_mirroring
      • create_mirrored_database
      • delete_mirrored_database
      • get_mirroring_status
      • get_tables_mirroring_status
      • get_mirrored_database_definition
      • update_mirrored_database_definition
  • sempy_labs.admin
    • list_modified_workspaces
  • sempy_labs.report
    • download_report Downloads a Power BI report and saves it as a .pbix file in the Files within the Lakehouse attached to the notebook.
  • sempy_labs.tom
    • set_value_filter_behavior (learn more here)
• Updated Functions
  • sempy_labs.tom
    • add_calculation_group Added the 'column_name' parameter (#261).

Bug Fixes

• #163
• #235
• #244
• #246
• #259
• #260
• #261
• #266
• #267
• #273
• #275
• #276

Notebooks

• Embedded videos within notebooks for easier learning.

Improvements in 0.8.4

• New Functions
  • sempy_labs
    • Semantic Models
      • get_semantic_model_refresh_history
    • Warehouses
      • get_warehouse_tables
      • get_warehouse_columns
    • Notebooks
      • create_notebook
      • update_notebook_definition
    • Workloads
      • get_workloads
      • patch_workload
    • Managed Private Endpoints
      • create_managed_private_endpoint
      • delete_managed_private_endpoint
      • list_managed_private_endpoints
  • sempy_labs.report
    • get_report_datasources
  • sempy_labs.directlake
    • update_direct_lake_model_connection
• Updated Functions
  • sempy_labs
    • refresh_semantic_model If the refresh fails, this function now prints out the failure message(s). Added the 'visualize' parameter which if set to True shows a real-time visual of the refresh statistics per Phil Seamark's blog.
    • import_notebook_from_web Added the 'overwrite' parameter.
    • model_bpa_rules Ensure all rules have descriptions.
  • sempy_labs.admin
    • list_activity_events Updated 'Creation Time' column to be of datatype 'DateTime'.
    • list_workspaces Added the 'filter' parameter (#204).
    • Updated the 'admin' functions which reference workspaces to leverage the admin version of list_workspaces.

General updates

• Direct Lake migration now supports relationships based on datetime (#243).

• Bug fixes

  • #86
  • #212
  • #225
  • #226
  • #229
  • #232
  • #239
  • sempy_labs
    • update_fabric_capacity
  • sempy_labs.tom
    • set_sort_by_column
    • mark_as_date_table

Notebook updates

• SQL Added the get_warehouse_tables, get_warehouse_columns functions.
• Semantic Model Refresh Added cells for visualizing a refresh and getting the refresh history for a semantic model.

Improvements in 0.8.3

• New Functions
  • sempy_labs
    • migrate_fabric_trial_capacity
    • create_resource_group
    • get_data_pipeline_definition
    • create_external_data_share
    • revoke_external_data_share
    • list_external_data_shares_in_item
  • sempy_labs.admin
    • list_activity_events
  • sempy_labs.tom
    • add_changed_property
    • remove_changed_property
• Updated Functions
  • sempy_labs
    • create_warehouse added a parameter for creating a warehouse with case-insensitive collation.
    • Capacity migration functions have been updated to use the admin APIs.
  • sempy_labs.tom
    • connect_semantic_model Adds lineage tags, source lineage tags and ChangedProperty accordingly to ensure that models (especially Direct Lake) work between making changes in XMLA clients and the Fabric service.
• sempy_labs.report
  • export_report Updated per PR #65.

Bug Fixes in 0.8.3

• #184
• #185
• #198
• sempy_labs
  • deploy_semantic_model Fixed issue with inaccurate subfunction parameter call.
  • run_model_bpa The function showed a warning in some environments which has been resolved.
• sempy_labs.tom
  • generate_measure_descriptions Fixed for when 'measure_name' is None. The output is now a pandas dataframe showing the auto-generated measure descriptions. Note that this function is only viable if your capacity is a paid F64 or higher (trials not included).
  • update_lineage_tags Fixed bug.

Notebooks

• Updated the Capacity Migration notebook to incorporate migrating a Fabric Trial capacity to a Fabric paid capacity.

Bug fixes in 0.8.2

• Fixed library loading issue related to deltalake & pyarrow by reverting back to spark for now.

Improvements in 0.8.1

• sempy_labs
  • list_mirrored_warehouses
  • create_kql_database
  • delete_kql_database
  • list_kql_databases
  • create_eventhouse
  • delete_eventhouse
  • list_eventhouses
  • delete_warehouse
  • create_eventstream
  • delete_eventstream
  • list_eventstreams
  • create_data_pipeline
  • delete_data_pipeline
  • list_data_pipelines
  • create_kql_queryset
  • delete_kql_queryset
  • list_kql_querysets
  • create_ml_model
  • delete_ml_model
  • list_ml_models
  • create_ml_experiment
  • delete_ml_experiment
  • list_ml_experiments
  • list_sql_endpoints
  • list_datamarts
  • convert_to_friendly_case (#165)
• sempy_labs.tom
  • generate_measure_descriptions Uses an LLM to auto-generate descriptions for any/all measures in a semantic model based on the DAX expression.
  • is_calculated_column
  • update_lineage_tags Use this function to ensure that lineage tags and source lineage tags are properly set on your semantic model to ensure compatibility with the Power BI / Fabric web service.

Updates in 0.8.1

• sempy_labs.tom
  • Added the 'is_nullable' and 'is_available_in_mdx' parameters to the update_column function.

Bug Fixes in 0.8.1

• #172
• #174
• Edit Tables functionality in the web browser not working after creating/modifying a semantic model using TOM. This is resolved by properly setting the LineageTag, SourceLineageTag for required objects as well as the 'SchemaName' property for partitions in Direct Lake mode.
• Fixed get_model_calc_dependencies and get_measure_dependencies so that the warning previously shown is resolved and no longer shows.
• Fixed bug in run_report_bpa
• Site containing documentation for the Direct Lake guardrails changed. Fixed get_direct_lake_guardrails

Misc

• Added Featured Scenarios section to README.md

Improvements in 0.8.0

• New Functions
  • sempy_labs
    • ConnectLakehouse.query Run a SQL query (or queries) against a Fabric lakehouse.
    • list_semantic_model_object_report_usage Shows how many times each semantic model object is used in downstream reports.
    • list_report_semantic_model_objects Shows where semantic model objects are used in downstream reports (across visuals and filters).
    • migrate_workspaces Migrates workspaces to a different capacity.
    • migrate_capacities Migrates a capacity (or capacities) to a new F sku capacity including all workspaces and capacity settings.
    • migrate_spark_settings Migrates the spark settings from a capacity to a new capacity.
    • migrate_notification_settings Migrates the notification settings from a capacity to a new capacity.
    • migrate_access_settings Migrates the access settings from a capacity to a new capacity.
    • migrate_delegated_tenant_settings Migrates the delegated tenant settings from a capacity to a new capacity.
    • migrate_disaster_recovery_settings Migrates the disaster recovery settings from a capacity to a new capacity.
  • sempy_labs.admin
    • assign_workspaces_to_capacity
    • list_capacities
    • list_tenant_settings
    • list_capacities_delegated_tenant_settings
    • unassign_workspaces_from_capacity
    • list_external_data_shares
    • revoke_external_data_share
    • list_workspaces
    • list_datasets
    • list_item_access_details
    • list_access_entities
    • list_workspace_access_details
    • list_items
    • list_domains
    • list_domain_workspaces
    • assign_domain_workspaces
    • assign_domain_workspaces_by_capacities
    • create_domain
    • update_domain
    • delete_domain
    • resolve_domain_id
    • unassign_domain_workspaces
    • unassign_all_domain_workspaces
  • sempy_labs.report
    • report_bpa_rules Hosts the default Report Best Practice Analyzer rules.
    • run_report_bpa Runs the Report Best Practice Analyzer.
  • sempy_labs.report.ReportWrapper
    • list_pages Lists all pages within a report.
    • list_visuals Lists all visuals within a report.
    • list_report_filters Lists all report filters within a report.
    • list_page_filters Lists all page filters within a report.
    • list_visual_filters Lists all visual filters within a report.
    • list_visual_objects Lists all visual objects (i.e. measures/columns) which are used in visuals within a report.
    • list_visual_interactions Lists all visual interactions within a report.
    • list_custom_visuals Lists all custom visuals within a report.
    • list_bookmarks Lists all bookmarks within a report.
    • list_report_level_measures Lists all report-level measures within a report.
    • list_semantic_model_objects Lists all semantic model objects (i.e. measures/columns) used within a report.
    • get_theme Gets the theme file used for a report.
    • set_theme Sets the theme file to be used for a report.
    • set_active_page Sets the active page for a report (page viewed upon opening the report).
    • set_page_type Sets the page type for a page within a report.
    • set_page_visibility Sets whether a page is hidden/visible.
    • hide_tooltip_and_drillthrough_pages Hides pages which are used as tooltip or for drillthrough.
    • disable_show_items_with_no_data Disables the 'show items with no data' property for all visuals in a report.
    • remove_unnecessary_custom_visuals Removes custom visuals in a report which are not used in the report.
    • migrate_report_level_measures Migrates report-level measures to the upstream semantic model.
    • resolve_page_name
    • resolve_page_display_name
• Updated Functions
  • sempy_labs.tom
    • Added 'lineage_tag' and 'source_lineage_tag' as optional parameters for relevant functions
    • Added 'data_category' and 'detail_rows_expression' as an optional parameters for the [add_measure] function.

Bug Fixes in 0.8.0

• #153
• #158
• #166
• delete_premium_capacity Fixed issue in response status code catch.
• list_qso_settings Fixed bug re workspace.

Notebook updates in 0.8.0

• Capacity Migration Notebook for assisting in migrating P skus to F skus.
• Report Analysis Notebook for running Report BPA and other ReportWrapper functions.
• SQL Notebook for running SQL/T-SQL against warehouses/lakehouses.

Improvements in 0.7.4

• New Functions
  • sempy_labs
    • create_environment Creates a new environment within a workspace.
    • delete_environment Deletes an environment.
    • publish_environment Publishes an environment.
    • resolve_environment_id Obtains the environment id based on an environment name.
    • list_connections Lists available connections.
    • list_item_connections Lists a Fabric item's connections.
    • create_fabric_capacity Creates a Fabric capacity.
    • suspend_fabric_capacity Suspends a Fabric capacity.
    • resume_fabric_capacity Resumes a Fabric capacity.
    • update_fabric_capacity Updates a Fabric capacity.
    • delete_fabric_capacity Deletes a Fabric capacity.
    • delete_premium_capacity Deletes a Power BI Premium capacity.
    • delete_embedded_capacity Deletes an Embedded capacity (A sku).
    • resolve_capacity_id Obtains the Id of a capacity based on the capacity name.
• Updated Functions
  • sempy_labs
    • run_model_bpa
      • The 'language' parameter now accepts the language name (or the language code). For example, language='japanese'.
      • Additional languages added for auto-translation without the need to call spark (when running the default rules).
    • translate_semantic_model
      • The 'language' parameter now accepts the language name (or the language code). For example, language='japanese'.
    • save_as_delta_table
      • Added the 'schema' parameter which allows you to specify a schema for the delta table to ensure proper column data types.
    • set_semantic_model_storage_format
      • This function will only update the storage format if the request is different than the current storage format.
    • set_workspace_default_storage_format
      • This function will only update the storage format if the request is different than the current storage format.
    • ConnectWarehouse.query
      • This function now supports both SQL & T-SQL queries. Multiple queries are also supported (#133).

Bug Fixes in 0.7.4

• sempy_labs
  • #100
  • #139

Misc Updates in 0.7.4

• Added Version History to README.md

Improvements in 0.7.3

• New functions
  • sempy_labs
    • backup_semantic_model Backs up a semantic model to an ADLS Gen2 storage account file.
    • restore_semantic_model Restores a semantic model from an ADLS Gen2 storage account file.
    • copy_semantic_model_backup_file Copies a semantic model backup file from one location to another (within an ADLS Gen2 storage account).
    • list_backups Shows all semantic model backup files within a workspace.
    • list_storage_account_files Lists all files within an ADLS Gen2 storage account.
    • get_semantic_model_size Gets the size (in bytes) of a semantic model.
    • provision_workspace_identity Provisions a workspace identity.
    • deprovision_workspace_identity Deprovisions a workspace identity.
    • list_deployment_pipelines Lists all deployment pipelines.
    • list_deployment_pipeline_stages List all deployment pipeline stages.
    • list_deployment_pipeline_stage_items Lists all deployment pipeline stage items.
    • list_dataflows Lists all dataflows.
    • connect_workspace_to_git Connects a workspace to Git (#48).
    • disconnect_workspace_from_git Disconnects a workspace from Git (#48).
    • get_git_status Gets the Git status (#48).
    • get_git_connection Gets the Git connection (#48).
    • initialize_git_connection Initializes the Git connection (#48).
    • commit_to_git Commits changes to Git (#48).
    • update_from_git Updates changes from Git (#48).
    • ConnectWarehouse Run a SQL query against a Fabric warehouse.
    • resolve_warehouse_id resolves a warehouse name to an Id.
    • update_semantic_model_from_bim Updates a semantic model's definition based on a .bim file.
  • sempy_labs.directlake
    • generate_shared_expression Generates a shared expression for either a lakehouse or workspace which can be used when creating a Direct Lake semantic model.
• Updated Functions
  • sempy_labs
    • create_blank_semantic_model added the 'overwrite' parameter.
    • deploy_semantic_model added the 'overwrite' parameter.
  • sempy_labs.tom
    • Added the 'source_lineage_tag' parameter to relevant functions.

Bug fixes in 0.7.3

• #108
• #109
• #110
• #116
• #119

Notebooks

• Migration to Direct Lake Added the 'overwrite' parameter within the create_blank_semantic_model function.
• Model Optimization Added a cell in the notebook which demonstrates how to write your own custom BPA rules for the run_model_bpa function.
• Warehouse Added this notebook for easily running SQL queries against a Fabric warehouse.

Bug fixes

• Made a fix to the qso_sync function so that it only updates the semantic model storage mode to 'Large' if it is currently set to 'Small'. This function is also disabled for running against default semantic models.

Improvements in 0.7.1

• New Functions
  • sempy_labs
    • vacuum_lakehouse_tables Vacuums lakehouse table(s). Thanks to Miles Cole!
• Updated Functions
  • sempy_labs
    • list_shortcuts fixed and the API is now publicly available.
    • run_model_bpa_bulk
      • Added the 'skip_models' parameter which allows you to always skip running BPA for specific semantic models. By default this always skips following: default semantic models, 'ModelBPA' and 'Fabric Capacity Metrics'.
    • model_bpa_rules
      • Added new rule: Dual mode is only relevant for dimension tables if DirectQuery is used for the corresponding fact table.

Bug fixes in 0.7.1

• Issue with setting query scale out (#101).
• Fixed bug in add_user_to_workspace and update_workspace_user functions.

Improvements in 0.7.0

• New functions
  • sempy_labs
    • run_model_bpa_bulk Scan semantic models across workspaces in one go and saves the results to a delta table in your Fabric lakehouse (#78).
    • create_model_bpa_semantic_model Dynamically generates a semantic model to be used in analyzing the model Best Practice Analyzer results.
    • list_reports_using_semantic_model Lists all the reports which feed from a given semantic model - across any workspace.
    • get_notebook_definition Retrieves the Fabric notebook definition.
    • import_notebook_from_web Load any Jupyter Notebook (.ipynb) from the web (i.e. GitHub) into a Fabric workspace.
    • is_default_semantic_semantic_model Easily check if a semantic model is a default semantic model.
    • resolve_dataset_from_report Identifies the semantic model which feeds the report.
    • resolve_item_type Identifies the item type (i.e. Lakehouse, SemanticModel).
    • get_capacity_id
    • get_capacity_name
    • resolve_workspace_capacity
    • resolve_capacity_name
  • sempy_labs.report
    • create_model_bpa_report Dynamically generates a report to be used in analyzing the model Best Practice Analyzer report.
    • get_report_definition Retrieves the Power BI report definition files.
    • update_report_from_reportjson Updates a Power BI report based on a report.json file.
  • sempy_labs.directlake
    • generate_direct_lake_semantic_model Dynamically generates a Direct Lake semantic model based on a user-specified list of lakehouse tables (#55).
    • get_direct_lake_source Obtains the lakehouse and SQL endpoint or Warehouse for any Direct Lake semantic model - even across different workspaces.
• Updated functions
  • sempy_labs
    • run_model_bpa Now has the 'language' parameter for auto-translating the Rule Name, Category and Description into any language. For example: language='it-IT' will translate the rules into Italian.
    • run_model_bpa, run_model_bpa_bulk, vertipaq_analyzer The following properties are now also saved when exporting this data to a delta table: Capacity Name, Capacity Id, Workspace Id, Configured By.
    • clear_cache Updated to check whether the semantic model is the default semantic model and if so yield a useful error as XMLA operations are not allowed against default semantic models.
    • translate_semantic_model Now returns a pandas dataframe showing all translations in the semantic model.
    • save_as_delta_table The 'merge_schema' parameter has been added. Setting this to True enables spark to merge the schema between the dataframe and delta table.
    • refresh_semantic_model added the 'max_parallelism' parameter (#66).
  • sempy_labs.tom
    • Added support for setting Format String Expressions within the add_measure, add_calculation_item, update_measure, update_calculation_item functions.
    • Added the 'object_names' parameter in the add_field_parameter function (#60).
  • sempy_labs.report
    • report_rebind_all Specifying the 'report_workspace' parameter as None will find all reports in all workspaces which use the semantic model and rebind them to the new semantic model.
  • sempy_labs.migration
    • Updated migration functions to support handling special characters in table/column names. Special characters are preserved in the table/column names within the semantic model but are removed in the PQT/lakehouse layer as they are not supported.
    • Updated create_pqt_file function to handle Dataflows Gen2's limitation of 50 tables per Dataflow Gen2. If the .pqt file would have more than 50 tables, multiple .pqt files are created and saved.

Bug fixes in 0.7.0

• Fixed an issue with regard to the default lakehouse and its workspace in the run_model_bpa and veritpaq_analyzer functions (#42, #55).
• Raise an error when the get_lakehouse_tables function is used improperly (#51).
• Fixed a bug in create_field_parameter (#68).
• Fixed long running operation issue and fortified similar functions to optimize long running operation performance (#81).
• Fixed issue (#86) to support pagination for GET API calls in all relevant functions.
• Fixed remove_object function (#83).

Notebooks in 0.7.0

• Added the Best Practice Analyzer Report notebook to provide guidance on how to run the model BPA in bulk and dynamically set up its corresponding model and report for multi-capacity/workspace/model analysis.
• Added new notebook which provides examples for refreshing and cancelling refreshes of semantic models: Semantic Model Refresh

Misc updates in 0.7.0

• Semantic Link 0.7.7 is installed by default.

Improvements in 0.6.0

• New functions:
  • sempy_labs
    • deploy_semantic_model
    • delete_custom_pool
    • list_capacities Semantic Link has this function as well but here in Semantic Link Labs the output dataframe contains an additional column showing the admin accounts for the capacity.
  • sempy_labs.directlake
    • add_table_to_direct_lake_semantic_model
  • sempy_labs.tom
    • is_calculated_table
    • update_measure
    • update_column
    • update_role
    • update_calculation_item
• Updated functions
  • The run_model_bpa and model_bpa_rules functions have been updated to use TOM directly (instead of dataframes as done previously). Using your own rules or modifying the existing rules is simpler now as the rules rely on basic TOM plus the functions contained within the Semantic Link Labs library. Simply follow the example of the model_bpa_rules code and use the returned dataframe as the 'rules' parameter for the run_model_bpa function.
  • The get_semantic_model_bim has been updated to contain a new parameter 'lakehouse_workspace' which should be used in case you want to save the .bim file to the lakehouse attached to your notebook and that lakehouse resides in a different workspace from the semantic model. This function has also been updated to leverage the 'lro_wait' parameter in Semantic Link for easily resolving long running operations (#26).

Bug fixes in 0.6.0

• Fixed bug in assign_workspace_to_capacity.
• Fixed bug in get_measure_dependencies.
• Various other bug fixes and code improvements.

Renamed functions in 0.6.0

• Renamed the 'hybrid_tables' function to all_hybrid_tables to align with other 'all_'* functions.
• Renamed the 'date_tables' function to all_date_tables to align with other 'all_'* functions.

Notebooks

• Tabular Object Model
  • Added examples for renaming objects (tables, columns)