18 Commits

Author SHA1 Message Date
Mose Müller
93d38651e8 Merge pull request #251 from tiqi-group/release-v0.10.18
updates to version v0.10.18
2025-06-27 08:48:25 +02:00
Mose Müller
72a3c199d9 updates to version v0.10.18 2025-06-27 08:48:07 +02:00
Mose Müller
7914e2fa7b Merge pull request #250 from tiqi-group/feat/client_auto_update_proxy
feat: adds auto_update_proxy argument to pydase.Client
2025-06-27 08:44:35 +02:00
Mose Müller
0a4f898fde docs: updates python client section 2025-06-27 08:43:36 +02:00
Mose Müller
a9aa55fc99 client: adds auto_update_proxy argument
If False, this disables automatic updates from the server by not
subscribing to the "nofity" event. This is useful for request-only where
real-time synchronization is not needed.
2025-06-27 08:02:33 +02:00
Mose Müller
fd5a230fa4 Merge pull request #249 from tiqi-group/feat/improve-client-proxy-serialization
chore: improve client proxy serialization
2025-06-23 14:11:31 +02:00
Mose Müller
243b46aadb test: adds test for ProxyClass
This test timed out before implementing the changes.
2025-06-23 14:09:52 +02:00
Mose Müller
0f1ca84df5 client: updates proxy.serialize logic
The proxy needs to properly handle serialization requests. If such a
requests comes from the asyncio loop used by the socketio client, this
would result in a deadlock. This happens, for example, when the observer
is notified of a change triggered within a socketio event. To prevent
this, I am checking the current loop against the socketio client loop.
If it's the same, return the _service_representation value, which is set
when pydase.Client connects to the server. I do the same when the client
is not connected (to prevent BadNamespaceErrors).
Every other invokation of serialize results in an API call to the
server.
2025-06-23 09:11:43 +02:00
Mose Müller
6438a07305 client: updates proxy._service_representation every time the client connects 2025-06-23 09:01:01 +02:00
Mose Müller
80bfd209df Merge pull request #248 from tiqi-group/docs/adds_doi_badge
docs: adds DOI badge
2025-06-20 10:46:48 +02:00
Mose Müller
e065b1fb22 docs: adds DOI badge 2025-06-20 10:45:01 +02:00
Mose Müller
977cee32b9 Merge pull request #247 from tiqi-group/feat/adding-direct-api-access-tests
feat: adds client tests for direct api functions
2025-06-19 14:04:30 +02:00
Mose Müller
96f695020b adds client tests for direct api functions 2025-06-19 14:03:34 +02:00
Mose Müller
33ce01865a Merge pull request #246 from tiqi-group/feat/direct-api-access-client
Feat: direct api access client
2025-06-19 13:57:25 +02:00
Mose Müller
f5374573cd docs: adds "Direct API Access" section to python-client.md 2025-06-19 13:54:52 +02:00
Mose Müller
43c6b5e817 fix: getter_proxy didn't return value 2025-06-19 13:52:31 +02:00
Mose Müller
37380c6d24 adds get_value, update_value and trigger_method functions to pydase.Client 2025-06-19 13:45:36 +02:00
Mose Müller
ae21656e83 pulls get_value out of ProxyClassMixin 2025-06-19 13:38:51 +02:00
8 changed files with 205 additions and 30 deletions

View File

@@ -5,6 +5,7 @@
[![Python Versions](https://img.shields.io/pypi/pyversions/pydase)](https://pypi.org/project/pydase/)
[![Documentation Status](https://readthedocs.org/projects/pydase/badge/?version=stable)](https://pydase.readthedocs.io/en/stable/)
[![License: MIT](https://img.shields.io/github/license/tiqi-group/pydase)][License]
[![DOI](https://zenodo.org/badge/DOI/10.5281/zenodo.15703190.svg)](https://doi.org/10.5281/zenodo.15703190)
`pydase` is a Python library that simplifies the creation of remote control interfaces for Python objects. It exposes the public attributes of a user-defined class via a [Socket.IO](https://python-socketio.readthedocs.io/en/stable/) web server, ensuring they are always in sync with the service state. You can interact with these attributes using an RPC client, a RESTful API, or a web browser. The web browser frontend is auto-generated, displaying components that correspond to each public attribute of the class for direct interaction.
`pydase` implements an [observer pattern][Observer Pattern] to provide the real-time updates, ensuring that changes to the class attributes are reflected across all clients.

View File

@@ -23,7 +23,39 @@ The proxy acts as a local representation of the remote service, enabling intuiti
The proxy class automatically synchronizes with the server's attributes and methods, keeping itself up-to-date with any changes. This dynamic synchronization essentially mirrors the server's API, making it feel like you're working with a local object.
### Accessing Services Behind Firewalls or SSH Gateways
## Automatic Proxy Updates
By default, the client listens for attribute and structure changes from the server and dynamically updates its internal proxy representation. This ensures that value changes or newly added attributes on the server appear in the client proxy without requiring reconnection or manual refresh.
This is useful, for example, when [integrating the client into another service](#integrating-the-client-into-another-service). However, if you want to avoid this behavior (e.g., to reduce network traffic or avoid frequent re-syncing), you can disable it. When passing `auto_update_proxy=False` to the client, the proxy will not track changes after the initial connection:
```python
client = pydase.Client(
url="ws://localhost:8001",
auto_update_proxy=False
)
```
## Direct API Access
In addition to using the `proxy` object, users may access the server API directly via the following methods:
```python
client = pydase.Client(url="ws://localhost:8001")
# Get the current value of an attribute
value = client.get_value("device.voltage")
# Update an attribute
client.update_value("device.voltage", 5.0)
# Call a method on the remote service
result = client.trigger_method("device.reset")
```
This bypasses the proxy and is useful for lower-level access to individual service endpoints.
## Accessing Services Behind Firewalls or SSH Gateways
If your service is only reachable through a private network or SSH gateway, you can route your connection through a local SOCKS5 proxy using the `proxy_url` parameter.
@@ -75,6 +107,7 @@ if __name__ == "__main__":
```
In this example:
- The `MyService` class has a `proxy` attribute that connects to a `pydase` service at `<ip_addr>:<service_port>`.
- By setting `block_until_connected=False`, the service can start without waiting for the connection to succeed.
- The `client_id` is optional. If not specified, it defaults to the system hostname, which will be sent in the `X-Client-Id` HTTP header for logging or authentication on the server side.

View File

@@ -1,6 +1,6 @@
[project]
name = "pydase"
version = "0.10.17"
version = "0.10.18"
description = "A flexible and robust Python library for creating, managing, and interacting with data services, with built-in support for web and RPC servers, and customizable features for diverse use cases."
authors = [
{name = "Mose Müller",email = "mosemueller@gmail.com"}

View File

@@ -12,7 +12,12 @@ import aiohttp
import socketio # type: ignore
from pydase.client.proxy_class import ProxyClass
from pydase.client.proxy_loader import ProxyLoader
from pydase.client.proxy_loader import (
ProxyLoader,
get_value,
trigger_method,
update_value,
)
from pydase.utils.serialization.deserializer import loads
from pydase.utils.serialization.types import SerializedDataService, SerializedObject
@@ -65,6 +70,8 @@ class Client:
proxy_url: An optional proxy URL to route the connection through. This is useful
if the service is only reachable via an SSH tunnel or behind a firewall
(e.g., `socks5://localhost:2222`).
auto_update_proxy: If False, disables automatic updates from the server. Useful
for request-only clients where real-time synchronization is not needed.
Example:
Connect to a service directly:
@@ -93,7 +100,7 @@ class Client:
```
"""
def __init__(
def __init__( # noqa: PLR0913
self,
*,
url: str,
@@ -101,6 +108,7 @@ class Client:
sio_client_kwargs: dict[str, Any] = {},
client_id: str | None = None,
proxy_url: str | None = None,
auto_update_proxy: bool = True, # new argument
):
# Parse the URL to separate base URL and path prefix
parsed_url = urllib.parse.urlparse(url)
@@ -118,6 +126,7 @@ class Client:
self._sio_client_kwargs = sio_client_kwargs
self._loop: asyncio.AbstractEventLoop | None = None
self._thread: threading.Thread | None = None
self._auto_update_proxy = auto_update_proxy
self.proxy: ProxyClass
"""A proxy object representing the remote service, facilitating interaction as
if it were local."""
@@ -224,24 +233,25 @@ class Client:
async def _setup_events(self) -> None:
self._sio.on("connect", self._handle_connect)
self._sio.on("disconnect", self._handle_disconnect)
self._sio.on("notify", self._handle_update)
if self._auto_update_proxy:
self._sio.on("notify", self._handle_update)
async def _handle_connect(self) -> None:
logger.debug("Connected to '%s' ...", self._url)
serialized_object = cast(
"SerializedDataService", await self._sio.call("service_serialization")
)
ProxyLoader.update_data_service_proxy(
self.proxy, serialized_object=serialized_object
)
serialized_object["type"] = "DeviceConnection"
if self.proxy._service_representation is not None:
if self._auto_update_proxy:
serialized_object = cast(
"SerializedDataService", await self._sio.call("service_serialization")
)
ProxyLoader.update_data_service_proxy(
self.proxy, serialized_object=serialized_object
)
serialized_object["type"] = "DeviceConnection"
# need to use object.__setattr__ to not trigger an observer notification
object.__setattr__(self.proxy, "_service_representation", serialized_object)
if TYPE_CHECKING:
self.proxy._service_representation = serialized_object # type: ignore
self.proxy._notify_changed("", self.proxy)
self.proxy._notify_changed("", self.proxy)
self.proxy._connected = True
async def _handle_disconnect(self) -> None:
@@ -253,3 +263,77 @@ class Client:
data["data"]["full_access_path"],
loads(data["data"]["value"]),
)
def get_value(self, access_path: str) -> Any:
"""Retrieve the current value of a remote attribute.
Args:
access_path: The dot-separated path to the attribute in the remote service.
Returns:
The deserialized value of the remote attribute, or None if the client is not
connected.
Example:
```python
value = client.get_value("my_device.temperature")
print(value)
```
"""
if self._loop is not None:
return get_value(
sio_client=self._sio,
loop=self._loop,
access_path=access_path,
)
return None
def update_value(self, access_path: str, new_value: Any) -> Any:
"""Set a new value for a remote attribute.
Args:
access_path: The dot-separated path to the attribute in the remote service.
new_value: The new value to assign to the attribute.
Example:
```python
client.update_value("my_device.power", True)
```
"""
if self._loop is not None:
update_value(
sio_client=self._sio,
loop=self._loop,
access_path=access_path,
value=new_value,
)
def trigger_method(self, access_path: str, *args: Any, **kwargs: Any) -> Any:
"""Trigger a remote method with optional arguments.
Args:
access_path: The dot-separated path to the method in the remote service.
*args: Positional arguments to pass to the method.
**kwargs: Keyword arguments to pass to the method.
Returns:
The return value of the method call, if any.
Example:
```python
result = client.trigger_method("my_device.calibrate", timeout=5)
print(result)
```
"""
if self._loop is not None:
return trigger_method(
sio_client=self._sio,
loop=self._loop,
access_path=access_path,
args=list(args),
kwargs=kwargs,
)
return None

View File

@@ -65,19 +65,31 @@ class ProxyClass(ProxyClassMixin, pydase.components.DeviceConnection):
self.reconnect = reconnect
def serialize(self) -> SerializedObject:
if self._service_representation is None:
serialization_future = cast(
current_loop = asyncio.get_event_loop()
if not self.connected or current_loop == self._loop:
logger.debug(
"Client not connected, or called from within client event loop - using "
"fallback serialization"
)
if self._service_representation is None:
serialized_service = pydase.components.DeviceConnection().serialize()
else:
serialized_service = self._service_representation
else:
future = cast(
"asyncio.Future[SerializedDataService]",
asyncio.run_coroutine_threadsafe(
self._sio.call("service_serialization"), self._loop
),
)
result = future.result()
# need to use object.__setattr__ to not trigger an observer notification
object.__setattr__(
self, "_service_representation", serialization_future.result()
)
object.__setattr__(self, "_service_representation", result)
if TYPE_CHECKING:
self._service_representation = serialization_future.result()
self._service_representation = result
serialized_service = result
device_connection_value = cast(
"dict[str, SerializedObject]",
@@ -93,7 +105,7 @@ class ProxyClass(ProxyClassMixin, pydase.components.DeviceConnection):
"dict[str, SerializedObject]",
# need to deepcopy to not overwrite the _service_representation dict
# when adding a prefix with add_prefix_to_full_access_path
deepcopy(self._service_representation["value"]),
deepcopy(serialized_service["value"]),
),
**device_connection_value,
}

View File

@@ -74,6 +74,21 @@ def update_value(
)
def get_value(
sio_client: socketio.AsyncClient,
loop: asyncio.AbstractEventLoop,
access_path: str,
) -> Any:
async def get_result() -> Any:
return await sio_client.call("get_value", access_path)
result = asyncio.run_coroutine_threadsafe(
get_result(),
loop=loop,
).result()
return ProxyLoader.loads_proxy(result, sio_client, loop)
class ProxyDict(dict[str, Any]):
def __init__(
self,
@@ -242,16 +257,11 @@ class ProxyClassMixin:
self, attr_name: str, serialized_object: SerializedObject
) -> None:
def getter_proxy() -> Any:
async def get_result() -> Any:
return await self._sio.call(
"get_value", serialized_object["full_access_path"]
)
result = asyncio.run_coroutine_threadsafe(
get_result(),
return get_value(
sio_client=self._sio,
loop=self._loop,
).result()
return ProxyLoader.loads_proxy(result, self._sio, self._loop)
access_path=serialized_object["full_access_path"],
)
dict.__setitem__(self._proxy_getters, attr_name, getter_proxy) # type: ignore

View File

@@ -177,3 +177,16 @@ def test_client_id(
pydase.Client(url="ws://localhost:9999", client_id="my_service")
assert "Client [id=my_service] connected" in caplog.text
def test_get_value(
pydase_client: pydase.Client, caplog: pytest.LogCaptureFixture
) -> None:
pydase_client.update_value("sub_service.name", "Other name")
assert pydase_client.get_value("sub_service.name") == "Other name"
assert (
pydase_client.trigger_method("my_async_method", input_str="Hello World")
== "Hello World"
)

View File

@@ -0,0 +1,22 @@
import asyncio
from unittest.mock import AsyncMock, call, patch
import pytest
from pydase import components
from pydase.client.proxy_class import ProxyClass
@pytest.mark.asyncio
async def test_serialize_fallback_inside_event_loop() -> None:
loop = asyncio.get_running_loop()
mock_sio = AsyncMock()
proxy = ProxyClass(sio_client=mock_sio, loop=loop, reconnect=lambda: None)
with patch.object(
components.DeviceConnection, "serialize", return_value={"value": {}}
) as mock_fallback:
result = proxy.serialize()
mock_fallback.assert_has_calls(calls=[call(), call()])
assert isinstance(result, dict)