Independent Research

Audio AI, Speech Systems & Human–AI Creative Tools

I conduct independent applied research at the intersection of audio engineering, machine learning, and human–AI interaction. My current work focuses on how AI-assisted and agentic systems can support professional audio workflows while preserving intelligibility, speaker identity, editorial control, reproducibility, and human judgment.

  • Audio ML
  • Speech Systems
  • Human–AI Interaction
  • Agentic Systems
Researcher
Sercan Solmaz
Organization
Sercan Solmaz Eğitim Danışmanlık ve Prodüksiyon Hizmetleri
Research context
Independent / Industry Research
Primary field
Computer Science, Data Science, AI & Machine Learning
Methodology
Computational / Dry Lab
Location
Türkiye

Research Areas

Audio Machine Learning & Speech Enhancement

Evaluation of machine-learning systems for dialogue restoration, noise reduction, source separation, speech enhancement, and perceptual audio quality.

The goal is not only to improve objective quality metrics, but also to understand how automated processing affects intelligibility, naturalness, speaker characteristics, and real-world production decisions.

Speech Recognition & Transcript-Driven Editing

Research into speech-to-text, speaker diarization, transcript-based media editing, semantic search, and the relationship between linguistic representations and non-destructive audio/video editing workflows.

A central question is how accurately language-level decisions can be translated into reliable timeline-level edits.

Human–AI Interaction in Creative Production

Exploration of how AI systems can assist audio engineers, editors, musicians, podcasters, and other creative professionals without removing meaningful human control.

This includes human-in-the-loop workflows, explainability, confidence-aware automation, reversible editing, and practical evaluation of AI-assisted production systems.

Agentic & Reproducible Research Workflows

Investigation of agentic AI systems for experiment orchestration, literature analysis, benchmarking, software development, documentation, and reproducible computational research.

The focus is on workflows in which AI agents can assist with complex research tasks while keeping methods, decisions, data, and outputs traceable and auditable.

Current Research Project

Benchmarking Local AI-Assisted Speech Restoration and Transcript-Driven Editing Workflows

Research Question

To what extent can locally executable AI systems improve spoken-word production workflows while maintaining speech intelligibility, perceptual quality, speaker identity, editorial accuracy, and meaningful human control?

Project description

Current speech and media AI systems often perform individual tasks—such as transcription, noise reduction, speaker detection, source separation, or semantic analysis—very well in isolation.

However, fewer studies examine how these systems behave when combined into complete production workflows.

This research investigates the performance, limitations, and practical trade-offs of integrated AI-assisted speech production pipelines.

Research Scope

  • speech enhancement and dialogue restoration
  • automatic speech recognition
  • speaker diarization
  • source separation
  • transcript-driven editing
  • semantic analysis of spoken content
  • AI-assisted editorial decision support
  • human-in-the-loop workflow design
  • local and privacy-preserving inference
  • agentic orchestration of research and media-processing workflows

Methodology

The research uses a computational and experimental benchmarking approach.

Multiple models and processing pipelines will be evaluated using controlled spoken-word recordings as well as representative real-world production material.

Where appropriate, evaluation will combine objective measurements with structured human listening and editorial assessments.

Measured dimensions

  • speech intelligibility
  • transcription error rates
  • speaker identification accuracy
  • perceptual speech quality
  • speaker-character preservation
  • processing latency
  • computational resource requirements
  • edit accuracy
  • workflow completion time
  • human intervention requirements

Special attention will be given to cases where objective quality metrics and human perception disagree.

All experiments will aim to be reproducible, with model versions, processing parameters, evaluation methodology, and computational environment documented whenever licensing and data constraints permit.

6–12 Month Research Plan

  1. Stage 1

    Evaluation Framework

    Establish a reproducible evaluation framework for speech enhancement, transcription, diarization, and transcript-driven editing systems.

  2. Stage 2

    Model & Pipeline Comparison

    Compare individual models and integrated pipelines across different recording conditions and production scenarios.

  3. Stage 3

    Agent-Assisted Experimentation

    Investigate agent-assisted workflows that can execute experiments, compare results, identify failure cases, and generate reproducible research artifacts while retaining human oversight.

  4. Stage 4

    Open Research Outputs

    Consolidate findings into openly documented reference workflows, benchmarking tools, research notes, and technical reports.

Planned Open Outputs

Open-source benchmarking tools

Software for comparing speech-processing and AI-assisted editing workflows.

Evaluation protocols

Reproducible procedures for testing speech restoration, transcription, diarization, and editing systems.

Reference workflows

Documented AI-assisted production pipelines that can be reproduced by other researchers and practitioners.

Research datasets or evaluation subsets

Redistributable test material and annotations where data rights permit publication.

Technical reports and research notes

Public documentation of methodology, experiments, results, limitations, and negative findings.

Open-source experimental software

Tools developed during the research that may be useful to the wider audio, speech, and AI research communities.

Research Principles

Reproducibility

Research results should be repeatable wherever technically and legally possible. Model versions, parameters, datasets, and evaluation methods should therefore be documented.

Human Evaluation

Numerical metrics alone are not sufficient for evaluating creative and perceptual audio systems. Human listening and editorial assessment remain essential components of the research.

Human Control

AI should support informed creative and technical decisions rather than obscure them. Systems should favor reversible actions, transparent decision-making, and meaningful user control.

Privacy

Local processing and privacy-preserving workflows are particularly important when working with speech recordings, unpublished media, and professional production material.

Open Research

Whenever intellectual-property, licensing, and privacy constraints allow, software, evaluation methodology, findings, and research artifacts will be made publicly accessible.

About the Researcher

Sercan Solmaz

Sercan Solmaz is an audio engineer, music producer, educator, musician, and developer working across professional audio, music technology, media production, and artificial intelligence.

His professional background spans approximately two decades of work with recording systems, music production, audio technology, post-production, education, and creative technology.

His current technical work focuses on AI-assisted audio and video systems, local machine-learning workflows, agentic software, speech technologies, and tools for creative professionals.

This combination of long-term professional audio practice and software experimentation informs a research approach centered on real production environments rather than isolated model performance.

Research Collaboration

I am interested in collaboration with researchers, engineers, and organizations working in areas including:

  • audio machine learning
  • speech enhancement
  • automatic speech recognition
  • human–computer interaction
  • creative AI
  • agentic systems
  • media intelligence
  • computational audio
  • AI-assisted production tools

I am also interested in participating in benchmark design, early-stage technology evaluation, research interviews, experimental tool testing, and open research initiatives.

Contact

Sercan Solmaz

Independent Research — Audio AI & Human–AI Creative Systems

Location
Türkiye