[DRAFT] userspace LL/audio test PR by kv2019i · Pull Request #10558 · thesofproject/sof

kv2019i · 2026-02-19T17:31:12Z

SOF has recently gained ability to run DP (=preemptable audio tasks) in Zephyr user-space.

This PR is an early stage pull-request for changes to extend this capability to all of the audio pipeline code, and specifically the LL (low-latency) tasks.

This early stage as the design is not set in stone and the PR uses a number of short cuts in order to move (and tests) incrementally larger sets of audio functionality.

kv2019i · 2026-02-19T17:32:45Z

Running the pipeline_two_components_user test added in this PR, on a Intel PTL, looks like this:

START - pipeline_two_components_user
[    0.000163] <inf> sof_boot_test: pipeline_two_components: copier module_id = 3
[    0.000163] <inf> sof_boot_test: pipeline_two_components: running test with user memory domain
[    0.000163] <inf> pipe: pipeline_new: pipeline new pipe_id 2 priority 0
[    0.000163] <dbg> ipc: ipc4_get_drv: found type 22, uuid 0xa00bc350U
[    0.000163] <dbg> module_adapter: module_adapter_new_ext: start
[    0.000163] <dbg> module_adapter: module_adapter_mem_alloc: using ll user heap for module
[    0.000165] <dbg> module_adapter: module_init: comp:2 0x3 entry
[    0.000165] <dbg> dma: z_impl_sof_dma_get: dma_get(), dma-probe id = 0
[    0.000165] <inf> dma: z_impl_sof_dma_get: dma_get() ID 0 sref = 1 busy channels 0
[    0.000165] <dbg> module_adapter: module_init: comp:2 0x3 done
[    0.000165] <dbg> module_adapter: module_adapter_new_ext: comp:2 0x3 done
[    0.000165] <dbg> ipc: ipc4_add_comp_dev: add comp 0x3
[    0.000165] <dbg> ll_schedule: zephyr_domain_thread_tid: entry
[    0.000165] <dbg> component: comp_grant_access_to_thread: grant access to mutex 0x400bf798 for thread 0x400bf6c0
[    0.000165] <dbg> component: comp_grant_access_to_thread: grant access to mutex 0x400bf798 for thread 0x401894e0
[    0.000165] <inf> sof_boot_test: pipeline_two_components: host copier created, comp_id = 0x3
[    0.000165] <dbg> ipc: ipc4_get_drv: found type 22, uuid 0xa00bc350U
[    0.000165] <dbg> module_adapter: module_adapter_new_ext: start
[    0.000165] <dbg> module_adapter: module_adapter_mem_alloc: using ll user heap for module
[    0.000165] <dbg> module_adapter: module_init: comp:2 0x10003 entry
[    0.000165] <inf> copier: copier_dai_init: comp:2 0x10003 dd 0x4019d280 initialized, index -1
[    0.000165] <dbg> dma: z_impl_sof_dma_get: dma_get(), dma-probe id = 0
[    0.000165] <inf> dma: z_impl_sof_dma_get: dma_get() ID 0 sref = 1 busy channels 0
[    0.000165] <inf> ipc: dai_config: comp:2 0x10003 dai type = 3 index = 0 dd 0x4019d280
[    0.000165] <dbg> ipc: dai_config: comp:2 0x10003 Alloc dai_spec_config 0xa019d480 size size 84
[    0.000165] <dbg> module_adapter: module_init: comp:2 0x10003 done
[    0.000165] <dbg> module_adapter: module_adapter_new_ext: comp:2 0x10003 done
[    0.000165] <dbg> ipc: ipc4_add_comp_dev: add comp 0x10003
[    0.000165] <dbg> ll_schedule: zephyr_domain_thread_tid: entry
[    0.000165] <dbg> component: comp_grant_access_to_thread: grant access to mutex 0x400bf7e0 for thread 0x400bf6c0
[    0.000165] <dbg> component: comp_grant_access_to_thread: grant access to mutex 0x400bf7e0 for thread 0x401894e0
[    0.000165] <inf> sof_boot_test: pipeline_two_components: DAI copier created, comp_id = 0x10003
[    0.000166] <dbg> buffer: buffer_alloc: buffer_alloc()
[    0.000166] <dbg> buffer: buffer_alloc_struct: buffer_alloc_struct()
[    0.000166] <dbg> userspace_helper: user_grant_dai_access_all: Granted DAI access to thread 0x401894e0 for 45 devices
[    0.000166] <dbg> userspace_helper: user_grant_dma_access_all: Granted DMA device access: dma@72c00 to thread 0x401894e0
[    0.000166] <dbg> userspace_helper: user_grant_dma_access_all: Granted DMA device access: dma@72800 to thread 0x401894e0
[    0.000166] <dbg> userspace_helper: user_grant_dma_access_all: Granted DMA device access: dma@79800 to thread 0x401894e0
[    0.000166] <dbg> userspace_helper: user_grant_dma_access_all: Granted DMA device access: dma@79400 to thread 0x401894e0
[    0.000166] <inf> sof_boot_test: pipeline_two_components: user thread started, waiting for completion
[    0.000170] <dbg> pipe: pipeline_reset: pipe:2 0x3 pipe reset
[    0.000170] <dbg> pipe: pipeline_comp_reset: pipe:2 0x3 current->comp.id = 0x3, dir = 0
[    0.000170] <dbg> module_adapter: module_adapter_reset: comp:2 0x3 resetting
[    0.000170] <dbg> copier: copier_reset: comp:2 0x3 entry
[    0.000170] <dbg> buffer: comp_buffer_free: buf:0 0x0 buffer_free()
[    0.000170] <dbg> module_adapter: module_adapter_reset: comp:2 0x3 done
[    0.000170] <dbg> pipe: pipeline_comp_reset: pipe:2 0x3 current->comp.id = 0x10003, dir = 0
[    0.000170] <dbg> module_adapter: module_adapter_reset: comp:2 0x10003 resetting
[    0.000170] <dbg> copier: copier_reset: comp:2 0x10003 entry
[    0.000170] <dbg> buffer: comp_buffer_free: buf:0 0x0 buffer_free()
[    0.000170] <dbg> module_adapter: module_adapter_reset: comp:2 0x10003 done
[    0.000170] <dbg> pipe: pipeline_disconnect: comp:2 0x3 disconnect buffer 0 as sink
[    0.000170] <dbg> pipe: pipeline_disconnect: comp:2 0x10003 disconnect buffer 0 as source
[    0.000170] <dbg> buffer: comp_buffer_free: buf:0 0x0 buffer_free()
[    0.000170] <dbg> buffer: comp_buffer_free: buf:0 0x0 buffer_free()
[    0.000170] <dbg> module_adapter: module_adapter_reset: comp:2 0x10003 done
[    0.000170] <dbg> pipe: pipeline_disconnect: comp:2 0x3 disconnect buffer 0 as sink
[    0.000170] <dbg> pipe: pipeline_disconnect: comp:2 0x10003 disconnect buffer 0 as source
[    0.000170] <dbg> buffer: comp_buffer_free: buf:0 0x0 buffer_free()
[    0.000170] <dbg> module_adapter: module_adapter_free: comp:2 0x3 start
[    0.000170] <inf> dma: z_impl_sof_dma_put: dma_put(), dma = 0x400c8488, sref = 0
[    0.000170] <dbg> module_adapter: module_adapter_free: comp:2 0x10003 start
[    0.000170] <inf> dma: z_impl_sof_dma_put: dma_put(), dma = 0x400c8518, sref = 0
[    0.000170] <dbg> pipe: pipeline_free: pipe:2 0x3 entry
[    0.000170] <inf> sof_boot_test: pipeline_two_components: two component pipeline test complete
 PASS - pipeline_two_components_user in 0.023 seconds

kv2019i · 2026-03-09T17:13:40Z

V2 snapshot pushed:

pipeline_two_components() tests now passes on Intel PTL hardware. a pipeline with two components is created, resources set up, pipeline is run with LL scheduler and then torn down freeing up all resources
introduces change to schedule.h interface to support LL scheduler
multiple limitations still in code (marked with WIP/HACK prefixes): limited to single core, some impact to non-user builds

kv2019i · 2026-03-17T18:30:33Z

V3 snapshot pushed:

added skeleton implementation for user-space IPC handling (only one IPC message type supported for now)
added a test case (ipc4_create_pipeline_check) to test the above

kv2019i · 2026-03-17T18:31:20Z

Test output for the new test added in V3:

[    0.000063] <inf> ipc: ipc_cmd: rx   : 0x110a1800|0x0
[    0.000063] <dbg> ipc: ipc_user_forward_cmd: IPC: forward cmd 110a1800
[    0.000063] <dbg> ipc: ipc_user_thread_fn: IPC user wake, mask 1
[    0.000063] <dbg> ipc: ipc_pipeline_new: ipc: pipeline id = 10
[    0.000063] <inf> ipc: ipc4_create_pipeline: pipe_desc a00f9f74, instance 10
[    0.000063] <inf> pipe: pipeline_new: pipeline new pipe_id 10 priority 3
[    0.000063] <wrn> pipe: pipeline_new: pipeline trace settings cannot be copied
[    0.000063] <wrn> pipe: pipeline_new: pipeline position reporting not available
[    0.000063] <inf> ipc: ipc4_create_pipeline: pipeline_new() -> 0xa01ba580
[    0.000063] <inf> ipc: ipc4_create_pipeline: success
[    0.000063] <err> ipc_service: ipc_service_release_rx_buffer: Endpoint not registered

[    0.000063] <wrn> ipc: ipc_platform_complete_cmd: ipc_service_release_rx_buffer() failed: -2
[    0.000063] <dbg> ipc: ipc_cmd: tx-reply     : 0x31000000|0x0
[    0.000063] <wrn> ipc: ipc_msg_send: Skipping IPC worker schedule. TODO to fix

[    0.000063] <inf> sof_boot_test: ipc4_create_pipeline_check: ipc_cmd() returned for pipeline id=10
[    0.000063] <inf> sof_boot_test: ipc4_create_pipeline_check: pipeline verified in IPC comp list
[    0.000063] <dbg> pipe: pipeline_free: pipe:10 0x0 entry
[    0.000063] <inf> sof_boot_test: ipc4_create_pipeline_check: ipc4 create pipeline test complete
[    0.000063] <inf> main: sof_app_main: SOF on intel_adsp
[    0.000063] <err> ipc_service: ipc_service_get_tx_buffer_size: Endpoint not registered

[    0.000063] <err> ipc_service: ipc_service_send: Endpoint not registered

[    0.000063] <err> main: sof_app_main: SOF initialization failed
[    0.000063] <inf> main: sof_app_main: SOF initialized
===================================================================
PROJECT EXECUTION SUCCESSFUL

kv2019i · 2026-03-17T18:33:59Z

src/ipc/ipc-common.c

+	/* works? yes */
+	//return 0;
+
+	printk("ipc %p\n", ipc);


Oops, these shouldn't be here. :)

kv2019i · 2026-03-17T18:35:53Z

src/ipc/ipc4/helper.c


 	/* create the pipeline */
-	pipe = pipeline_new(NULL, pipe_desc->primary.r.instance_id,
+	pipe = pipeline_new(heap, pipe_desc->primary.r.instance_id,


@lyakh @jsarha @lgirdwood This is where you'd plug in the vregions stuff to pass a separate heap to each pipe (based on topology description of its needs). In this series, as a placeholder, I use the zephyr_ll_user_heap() instead.

right, maybe put a comment there for now to make re-discovery easier

lyakh

last reviewed commit so far "schedule: zephyr_ll: implement thread_init/free domain ops"

lyakh · 2026-03-17T16:37:46Z

src/audio/component.c

+#ifdef CONFIG_SOF_USERSPACE_LL
+void comp_grant_access_to_thread(const struct comp_dev *dev, struct k_thread *th)
+{
+	assert(dev->list_mutex);


description a bit confusing - this is only granting access to a mutex. Also list_mutex is only added to comp_dev in the next commit.

lyakh · 2026-03-18T08:59:18Z

src/audio/buffers/comp_buffer.c

 	}

-	stream_addr = rballoc_align(flags, size, align);
+	stream_addr = sof_heap_alloc(heap, flags, size, align);


the commit, that is mentioned in the commit message, only moved buffer context objects to particular heaps. This commit moves actual data buffers to them too, which is different and (arguably) more risky

lyakh · 2026-03-18T10:44:29Z

zephyr/lib/dma.c

 #define HDA_DMA_BUFFER_PERIOD_COUNT	4

-SHARED_DATA struct sof_dma dma[] = {
+APP_TASK_DATA SHARED_DATA struct sof_dma dma[] = {


do I understand correctly, that this kind of userspace access makes that data writable to userspace?

lyakh · 2026-03-18T10:49:20Z

src/audio/host-zephyr.c

 		comp_err(dev, "requested channel %d is busy", hda_chan);
 		return -ENODEV;
 	}
-	hd->chan = &hd->dma->chan[channel];


is this also not needed for the legacy mode? Also below

lyakh · 2026-03-18T11:00:24Z

src/audio/copier/host_copier.h

 	uint64_t next_sync;
 	uint64_t period_in_cycles;
 #endif
+	struct k_heap *heap;


wasn't this already referenced in the previous commit?

lyakh · 2026-03-18T11:21:44Z

src/audio/dai-zephyr.c


-	k_spinlock_init(&dd->dai->lock);
+#ifdef CONFIG_SOF_USERSPACE_LL
+	dd->dai->lock = k_object_alloc(K_OBJ_MUTEX);


check for NULL? Possibly in other locations too

lyakh · 2026-03-18T11:24:25Z

src/audio/dai-zephyr.c

 	k_mutex_lock(dai->lock, K_FOREVER);
-	props = dai_get_properties(dai->dev, direction, stream_id);
-	hs_id = props->dma_hs_id;
+	ret = dai_get_properties_copy(dai->dev, direction, stream_id, &props);


I'm guessing this is made a syscall in one of the commits

lyakh · 2026-03-18T11:27:53Z

src/audio/module_adapter/module_adapter.c

 		mod_heap = &mod_heap_user->heap;
 	} else {
+#ifdef CONFIG_SOF_USERSPACE_LL
+		mod_heap = zephyr_ll_user_heap();


looks good, but this else is entered under multiple conditions, might need to double-check

lyakh · 2026-03-18T11:34:11Z

src/schedule/zephyr_ll.c

 	.schedule_task_before	= zephyr_ll_task_schedule_before,
 	.schedule_task_after	= zephyr_ll_task_schedule_after,
-	.schedule_task_free	= zephyr_ll_task_free,
+	.schedule_task_free	= zephyr_ll_task_sched_free,


let's "spend" 3 more characters and make it ..._schedule_free()

lyakh · 2026-03-18T12:01:00Z

src/schedule/zephyr_domain.c

-			return -ENOMEM;
-		}
+		tr_err(&ll_tr, "Failed to allocate thread object for core %d", core);
+		dt->handler = NULL;


duplicate of line 318

lyakh · 2026-03-18T13:07:30Z

zephyr/test/userspace/test_ll_task.c

+{
+	const struct sof_man_fw_desc *desc = basefw_vendor_get_manifest();
+	const struct sof_man_module *mod;
+	uint32_t i;


int / unsigned int

lyakh · 2026-03-18T13:07:55Z

zephyr/test/userspace/test_ll_task.c

+	uint32_t i;
+
+	if (!desc)
+		return -1;


lyakh · 2026-03-18T13:08:04Z

zephyr/test/userspace/test_ll_task.c

+			return (int)i;
+	}
+
+	return -1;


lyakh · 2026-03-18T13:09:01Z

zephyr/test/userspace/test_ll_task.c

+	union ipc4_connector_node_id node_id;
+	uint32_t dma_buffer_size;
+	uint32_t config_length;
+} __packed __aligned(4);


does __aligned actually make sense in a type definition?

lyakh · 2026-03-18T13:35:48Z

src/ipc/ipc-common.c

+			pipe_msg.extension.dat = ipc_user->ipc_msg_ext;
+
+			/* Execute pipeline creation in user context */
+			ipc_user->result = ipc_pipeline_new(ipc_user->ipc, (ipc_pipe_new *)&pipe_msg);


that's brave! ;-) I'd put a huge "TODO" here to make sure not to ship this by chance :-)

lyakh · 2026-03-18T13:53:37Z

src/ipc/ipc4/helper.c


 	/* create the pipeline */
-	pipe = pipeline_new(NULL, pipe_desc->primary.r.instance_id,
+	pipe = pipeline_new(heap, pipe_desc->primary.r.instance_id,


right, maybe put a comment there for now to make re-discovery easier

kv2019i · 2026-03-27T13:43:41Z

V4 snapshot pushed:

this is a significant milestone as this version allows to set up a full pipeline in user-space and this can be tested at aplay level (tested on Intel PTL with playback PCM0 of upstream sof-ptl-nocodec.tplg topology)
no changes needed to Zephyr or topology
limitations: multiple WIP changes that break other functionality and e.g. IPC implementation is very much in progress

kv2019i · 2026-03-27T13:46:07Z

Example output with V4 patchset:

--cut--
$ aplay -l
**** List of PLAYBACK Hardware Devices ****
card 0: sofnocodec [sof-nocodec], device 0: Port0 (*) []
  Subdevices: 1/1
  Subdevice #0: subdevice #0
card 0: sofnocodec [sof-nocodec], device 1: Port1 (*) []
  Subdevices: 1/1
  Subdevice #0: subdevice #0
card 0: sofnocodec [sof-nocodec], device 2: Port2 (*) []
  Subdevices: 1/1
  Subdevice #0: subdevice #0
card 0: sofnocodec [sof-nocodec], device 31: Deepbuffer Port0 (*) []
  Subdevices: 1/1
  Subdevice #0: subdevice #0
$ aplay -Dplughw:0,0 -d120 -fdat -traw /dev/zero && echo success
Playing raw data '/dev/zero' : Signed 16 bit Little Endian, Rate 48000 Hz, Stereo
success
$
--cut--

kv2019i · 2026-03-30T17:11:36Z

V5 pushed:

start IPC integration with user/kernel split from Ipc user kernel split #10660 partially merged (from @jsarha and @lgirdwood ) -- I tried to merge the full thing but routing all IPC messages to user thread does not work yet, so left the topmost patches out for now
no other changes (and no rebase)

kv2019i · 2026-04-01T13:08:35Z

V6 pushed:

rebase only, no functionality changes
a couple of PRs from "already submitted group" merged to main so removed from this PR
added Add CONFIG_SOF_OS_LINUX_COMPAT_PRIORITY and use it to fix UAOL regression #10672 to the series to make the test pass again with SOF main

kv2019i · 2026-04-01T14:40:19Z

V7 submitted:

added more changes from Ipc user kernel split #10660 , but not yet the change to route all user IPC to user thread. it turns out there are still multiple issues to tackle, so we are better off to incrementally move more IPC types to be processed in user thread (versus moving all in a single commit)
added fix to granting permissions to IPC thread
add new CONFIG_HOST_DMA_IPC_POSITION_UPDATES to drop unused functionality from IPC4 builds

kv2019i · 2026-04-10T11:53:38Z

V8 submitted:

one more IPC routed to user IPC thread (DELETE_PIPELINE)
introduced sys_mutex as a way to replace spinlocks in code that has to work both in kernel and user threads based on build configuration (core changes submitted separately as ipc4: replace fw_reg spinlock with mutex #10693 )
no rebase yet to make the diff to V7 useful

kv2019i · 2026-04-10T12:05:12Z

V9 submitted:

rebase only, no functional change

kv2019i · 2026-04-14T11:24:17Z

V10:

fast-forward update with two commits on top, one a WIP code change to fix a build issue and another to add a overlay file for Intel PTL
code can be now compiled with:

./scripts/xtensa-build-zephyr.py ptl  -o app/os_linux_overlay.conf -o app/overlays/ptl/ll_userspace_overlay.conf ptl

at least following test works with upstream sof-ptl-nocodec.tplg (no special Linux/sof-dev dependencies)

aplay -Dplughw:0,0 -d3 -fdat -traw /dev/zero

kv2019i · 2026-04-15T12:00:50Z

V11 pushed:

MOD_CONFIG_GET/SET, MOD_BIND/UNBIND, MOD_INIT/DELETE_INSTANCE moved to user-space (a bit rough code, but functionality at least works)
no rebase (will do that in V12)
UPDATE: with upstream sof-ptl-nocodec.tplg , one needs drivers: dai: make max dai_config blob size configurable zephyrproject-rtos/zephyr#107341 for Zephyr or otherwise copier set_config will fail

Commit 07f53cb ("agent: add basic workflows for agents") added rules in .agent/rules. As Copilot doesn't at least currently automatically pick up .agent/rules, add a separate .github instruction file pointing copilot to the .agent/rules, so we have a single place for mandatory agent guidance. If a single convention is established in the industry, we can drop these, but for now it's not the case. Signed-off-by: Kai Vehmanen <kai.vehmanen@linux.intel.com> (cherry picked from commit 4432e9e)

This is a mostly mechanical split of initial ipc logic into kernel and user files. This is the 1st stage in supporting both privileged kernel and non privileged userspace IPC commands and security surfaces. At a high level library loading and PM will reside as kernel IPC and pipeline and module will become user IPCs. There will be no impact for devices without MMU. Signed-off-by: Liam Girdwood <liam.r.girdwood@linux.intel.com> (cherry picked from commit e65c6d1)

The ll_block()/ll_unblock() macros use irq_local_disable() and irq_local_enable() for the same-core binding path, or when CONFIG_CROSS_CORE_STREAM is not enabled. These are not available in user-space. Use zephyr_ll_lock_sched()/zephyr_ll_unlock_sched() when building with CONFIG_SOF_USERSPACE_LL to acquire the LL scheduler's own k_mutex instead. Signed-off-by: Kai Vehmanen <kai.vehmanen@linux.intel.com>

Add a dedicated user-space thread for handling IPC commands that operate on audio pipelines when CONFIG_SOF_USERSPACE_LL is enabled. The kernel IPC handler forwards CREATE_PIPELINE messages to the user thread via k_event signaling and collects the result through a k_sem handshake. The IPC task_mask IPC_TASK_IN_THREAD bit prevents host completion until the user thread finishes. Key changes: - add ipc_user struct and user-space IPC thread with event loop - allocate IPC context statically in a dedicated memory partition - replace sof_get()->ipc with ipc_get() returning static context - forward CREATE_PIPELINE to user thread via ipc_user_forward_cmd() - allocate pipeline and IPC container from user-space heap This is a in-progress implementation that only handles one IPC message type and is thus not a full implementation. This does allow to proceed to test IPC user thread creation and the basic mechanism to handle messages. Signed-off-by: Kai Vehmanen <kai.vehmanen@linux.intel.com>

Incremental change to also handle PIPELINE_DELETE IPC in the user-space IPC thread. Signed-off-by: Kai Vehmanen <kai.vehmanen@linux.intel.com>

Make IPC user thread stack size configurable with SOF_IPC_USER_THREAD_STACK_SIZE (default 4096). Also pin the IPC user thread on primar CPU. Signed-off-by: Jyri Sarha <jyri.sarha@linux.intel.com> Signed-off-by: Kai Vehmanen <kai.vehmanen@linux.intel.com>

Use sof_heap_alloc() and the new sof_sys_user_heap_get() to route the allocs to correct heap based on SOF build options. If the audio pipeline code is run completely in user-space, a compatible heap should be used. Signed-off-by: Kai Vehmanen <kai.vehmanen@linux.intel.com>

Make ipc_msg_reply() a system call, so it can be called from audio thread even when audio thread is running in a user-space thread. Signed-off-by: Kai Vehmanen <kai.vehmanen@linux.intel.com>

Use sof_dma_get_status() call to allow the audio pipeline to be run in user-space. Signed-off-by: Kai Vehmanen <kai.vehmanen@linux.intel.com>

Replace rfree() calls with sof_heap_free() using the system user heap for IPC component and pipeline objects. In ipc4_create_pipeline(), replace the conditional zephyr_ll_user_heap() with the generic sof_sys_user_heap_get() to unify the allocation path across configurations. Signed-off-by: Kai Vehmanen <kai.vehmanen@linux.intel.com>

Mark the fw_reg mutex with APP_SYSUSER_BSS, allowing the lock to be used when DAI module is run in user-space. Signed-off-by: Kai Vehmanen <kai.vehmanen@linux.intel.com>

Use the component mutex when code is run in user-space instead of directly blocking interrupts. Signed-off-by: Kai Vehmanen <kai.vehmanen@linux.intel.com>

Do not use IRQ disable/enable when built for user-space. The driver list is immutable by IPC processing time so no lock is needed. Signed-off-by: Kai Vehmanen <kai.vehmanen@linux.intel.com>

Add a warning and a comment to all places where k_object_free() is called in code that may be run in user threads. This will result in resource leaks, but there is currently no immediate solution to how to free these objects from user threads. We may need to revisit the partition of functionality between system and user. Signed-off-by: Kai Vehmanen <kai.vehmanen@linux.intel.com>

- add arch_schedulers_get_for_core() for task-carried core routing - route 8 task-aware scheduler callers via task->core under CONFIG_SOF_USERSPACE_LL - fix zephyr_domain_thread_tid() to accept core parameter instead of hardcoding core 0 - create domain threads for secondary cores in secondary_core_init() - remove FIXME workaround from arch_schedulers_get() Signed-off-by: Kai Vehmanen <kai.vehmanen@linux.intel.com>

No need to copy the trace context object to buffer object, when audio pipelines are running in user-space. Signed-off-by: Kai Vehmanen <kai.vehmanen@linux.intel.com>

To make ipc4_create_buffer() usable from user-space, do not call cpu_get_id() but instead rely on "src->ipc_config.core". If code is run in kernel space, check the core matching current active core, but skip the check if run in user-space (as check is privileged). Signed-off-by: Kai Vehmanen <kai.vehmanen@linux.intel.com>

Make ipc_comp_connect() safe to run in user-space with limited functionality. The core id queries are privileged, so limit connections to cases where pipeline is running on 0. Signed-off-by: Kai Vehmanen <kai.vehmanen@linux.intel.com>

Move handling of SOF_IPC4_MOD_CONFIG_GET/GET to user-space IPC thread when SOF is built with CONFIG_SOF_USERSPACE_LL. Handling these IPC messages require calls to module interface get/set_attribute() methods, which must be run in user-space. Signed-off-by: Kai Vehmanen <kai.vehmanen@linux.intel.com>

Move handling of SOF_IPC4_MOD_BIND/UNBIND to user-space IPC thread when SOF is built with CONFIG_SOF_USERSPACE_LL. Handling these IPC messages require calls to module interface bind/unbind() methods, which must be run in user-space. Signed-off-by: Kai Vehmanen <kai.vehmanen@linux.intel.com>

Move handling of SOF_IPC4_IPC4_MOD_INIT_INSTANCE partially to user-space IPC thread when SOF is built with CONFIG_SOF_USERSPACE_LL. Module init involves multiple privileged actions, so part of module init handling is still done in kernel space, but the module specific initialization is run in user-space. Signed-off-by: Kai Vehmanen <kai.vehmanen@linux.intel.com>

Add a new test to userspace_ll set that takes a step towards running full audio pipelines in user-space. The test creates a pipeline with two components (IPC4 host and DAI copiers), does pipeline prepare, one copy cycle in prepared state and tears down the pipeline. One user-space thread is created to manage the pipelines. This would be equivalent to user IPC handler thread. Another user-space thread is created for the LL scheduler. This test has some limitation, but is a useful test point to test resource allocations in pipeline, component and module adapter code. The code adds a reference test case where the same flow is fully run in kernel space. Signed-off-by: Kai Vehmanen <kai.vehmanen@linux.intel.com>

Add a test that sends SOF_IPC4_GLB_CREATE_PIPELINE message via ipc_cmd() interface. This test can be used to test SOF when built with CONFIG_SOF_USERSPACE_LL. Handling of audio pipeline IPC messages (like CREATE_PIPELINE) will be routed to a user-space IPC thread. Signed-off-by: Kai Vehmanen <kai.vehmanen@linux.intel.com>

Place the pipeline position lookup table in the sysuser memory partition and replace k_spinlock with a dynamically allocated k_mutex when CONFIG_SOF_USERSPACE_LL is enabled. Spinlocks disable interrupts which is a privileged operation unavailable from user-mode threads. The mutex pointer is stored in a separate APP_SYSUSER_BSS variable outside the SHARED_DATA struct so Zephyr's kernel object tracking can recognize it for syscall verification. Move pipeline_posn_init() from task_main_start() to primary_core_init() before platform_init(), so the mutex is allocated before ipc_user_init() grants thread access to it. In pipeline_posn_get(), bypass the sof_get() kernel singleton and access the shared structure directly when running in user-space. Grant the ipc_user_init thread access to the pipeline position mutex via new pipeline_posn_grant_access() helper. Signed-off-by: Kai Vehmanen <kai.vehmanen@linux.intel.com>

This is a set of temporary changes to audio code to remove calls to privileged interfaces that are not mandatory to run simple audio tests. These need proper solutions to be able to run all use-cases in user LL version. Signed-off-by: Kai Vehmanen <kai.vehmanen@linux.intel.com>

kv2019i · 2026-04-15T13:04:50Z

V12 pushed:

rebase-only, no change to functionality
NOTE: like with V11, one needs drivers: dai: make max dai_config blob size configurable zephyrproject-rtos/zephyr#107341 to test with upstream sof-ptl-nocodec.tplg

kv2019i force-pushed the feat/userspace-ll-wip branch from 9cdb1be to 37b0412 Compare March 9, 2026 17:07

kv2019i force-pushed the feat/userspace-ll-wip branch from 37b0412 to 7317b18 Compare March 17, 2026 18:29

kv2019i commented Mar 17, 2026

View reviewed changes

lyakh reviewed Mar 18, 2026

View reviewed changes

kv2019i force-pushed the feat/userspace-ll-wip branch from 7317b18 to c029d49 Compare March 27, 2026 13:37

kv2019i force-pushed the feat/userspace-ll-wip branch from c029d49 to 9c778e4 Compare March 30, 2026 17:09

kv2019i mentioned this pull request Mar 31, 2026

userspace: split ipc files into user and kernel features #10666

Merged

kv2019i force-pushed the feat/userspace-ll-wip branch from 9c778e4 to c4b127f Compare April 1, 2026 13:06

kv2019i force-pushed the feat/userspace-ll-wip branch from c4b127f to ad359d6 Compare April 1, 2026 14:36

kv2019i mentioned this pull request Apr 9, 2026

ipc4: replace fw_reg spinlock with mutex #10693

Merged

kv2019i force-pushed the feat/userspace-ll-wip branch from ad359d6 to c7e9a37 Compare April 10, 2026 11:48

kv2019i force-pushed the feat/userspace-ll-wip branch from c7e9a37 to 8af1be4 Compare April 10, 2026 12:04

kv2019i force-pushed the feat/userspace-ll-wip branch from aa5efe0 to 35a61b6 Compare April 15, 2026 11:58

kv2019i added 2 commits April 15, 2026 15:54

(---section submitted PRs START)

f9f41fd

kv2019i and others added 28 commits April 15, 2026 15:54

(---section: IPC user support START)

a50f2ad

WIP: ipc: ipc4: route PIPELINE_DELETE to user-space handler

3f1be0c

Incremental change to also handle PIPELINE_DELETE IPC in the user-space IPC thread. Signed-off-by: Kai Vehmanen <kai.vehmanen@linux.intel.com>

ipc: turn ipc_msg_reply() into a system call

c983dcd

Make ipc_msg_reply() a system call, so it can be called from audio thread even when audio thread is running in a user-space thread. Signed-off-by: Kai Vehmanen <kai.vehmanen@linux.intel.com>

ipc: ipc4: use correct API to get DMA status

421398e

Use sof_dma_get_status() call to allow the audio pipeline to be run in user-space. Signed-off-by: Kai Vehmanen <kai.vehmanen@linux.intel.com>

ipc4: make fw_reg mutex available to user-space

d624e43

Mark the fw_reg mutex with APP_SYSUSER_BSS, allowing the lock to be used when DAI module is run in user-space. Signed-off-by: Kai Vehmanen <kai.vehmanen@linux.intel.com>

ipc: ipc-helper: make ipc_comp_free() user-space compatible

9531c3a

Use the component mutex when code is run in user-space instead of directly blocking interrupts. Signed-off-by: Kai Vehmanen <kai.vehmanen@linux.intel.com>

ipc: ipc4: helper: make ipc4_search_for_drv() userspace compatible

f5d7f08

Do not use IRQ disable/enable when built for user-space. The driver list is immutable by IPC processing time so no lock is needed. Signed-off-by: Kai Vehmanen <kai.vehmanen@linux.intel.com>

ipc: ipc-helper: trace context not used in user-space

9af9d13

No need to copy the trace context object to buffer object, when audio pipelines are running in user-space. Signed-off-by: Kai Vehmanen <kai.vehmanen@linux.intel.com>

(---section: IPC user support STOP)

cf6a0ac

(---section test-case START)

c5b5bb0

(---section WIP mandatory changes START)

1b4ce65

kv2019i force-pushed the feat/userspace-ll-wip branch from 35a61b6 to 214c051 Compare April 15, 2026 13:03

Conversation

kv2019i commented Feb 19, 2026

Uh oh!

kv2019i commented Feb 19, 2026

Uh oh!

kv2019i commented Mar 9, 2026

Uh oh!

kv2019i commented Mar 17, 2026

Uh oh!

kv2019i commented Mar 17, 2026

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

lyakh left a comment

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

kv2019i commented Mar 27, 2026

Uh oh!

kv2019i commented Mar 27, 2026

Uh oh!

kv2019i commented Mar 30, 2026

Uh oh!

kv2019i commented Apr 1, 2026

Uh oh!

kv2019i commented Apr 1, 2026

Uh oh!

kv2019i commented Apr 10, 2026

Uh oh!

kv2019i commented Apr 10, 2026

Uh oh!

kv2019i commented Apr 14, 2026

Uh oh!

kv2019i commented Apr 15, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

kv2019i commented Apr 15, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

kv2019i commented Apr 15, 2026 •

edited

Loading