Company Logo
      • ISS Development Philosophy
      • Meet Our Team
      • Request a Consultation
            • Appointment Setter System Architecture
            • iss - architecture proposal 1
            • iss - architecture proposal 2
            • iss appointment setter system architecture
            • LLM Phone Caller System Architecture
            • Phonify - Simulated Telephony Environment
                • create a new Database in Ruby
                • Docker Installation Guide
                • Docker stop and remove unwanted containers
                • error - remote origin already exists
                • error 'backend' does not have a commit checked out
                • FreeSwitch Server - MVP critical, refining, and enterprise-production documentation
                • Implementing Google and Microsoft OAuth in Next.js with App Router
                • ISS setter system prompt
                • Pushing to a git remote repository
                • rails db create command
                • Rails New Command Flags Analysis
                • Set up audio streaming from Next to Ruby to mini-omni
                • Set up FreeSWITCH in Docker
                • setup a Rails API backend for a Next.js frontend
                • Update ownership of project files
                • database thoughts for the iss-appointment-setter
                • Financial Priorities and Revenue Roadmap
                • Hey Jake - IPS
                • important outputs from docker install freeswitch command
                • ISS Profit Estimation and Stakeholder Proposal
                • learning freeswitch
                • possible next steps
                • Revenue Model - ISS Appointment Setter for Individuals
            • Containerized NextJS frontend
            • Containerized Ruby on Rails backend
            • docker-compose.yml full stack template
            • ISS Technology Suite - Our Cutting-Edge Tech Stack
          • Introducing the ISS Appointment Setter
          • ISS Appointment Setter
        • 10 Innovative AI-Powered Products for the Future
        • Bespoke Communication Ecosystems
        • Enterprise AI Integration - Intelligent Staffing Systems
        • ISS-Setter for Teams - Intelligent Staffing Systems
      • Flexible Partnerships for Innovative Ventures
      • Revolutionize Your Industry with AI-Powered Communication Solutions
      • The Power of Custom AI Software Ownership
    Home

    ❯

    Our Portolio

    ❯

    ISS Appointment Setter

    ❯

    Tech Stack

    ❯

    Resources

    ❯

    Guides

    ❯

    Set up audio streaming from Next to Ruby to mini-omni

    Set up audio streaming from Next to Ruby to mini-omni

    Oct 28, 20241 min read

    • Set up basic Next.js audio recording
    • Implement Next.js audio streaming to Rails
    • Create Rails endpoint to receive audio stream
    • Test audio streaming from Next.js to Rails
    • Set up mini-omni API client in Rails
    • Implement Rails to mini-omni API audio forwarding
    • Create simple speech-to-text test on mini-omni server
    • Verify mini-omni server receives audio stream
    • Implement mini-omni streaming response
    • Handle streaming response in Rails
    • Forward streaming response from Rails to Next.js
    • Display streaming response in Next.js UI
    • Implement error handling and edge cases
    • Add user authentication and authorization
    • Optimize performance and reduce latency
    • Conduct end-to-end testing
    • Document API and usage instructions

    Graph View

    Backlinks

    • possible next steps
    • GitHub
    • LinkedIn
    • Consultation
    • Team