Speech AI Engineer Job at Vorto, San Francisco, CA

SkxTMEJSd0hPRlFvcTRzN3dtYmpLM0pnaFE9PQ==
  • Vorto
  • San Francisco, CA

Job Description

About VORTO

Vorto is on a mission to increase sustainability and create more jobs by making supply chains more efficient across the entire value chain. Through powerful AI technology, Vorto's autonomous supply chain platform seeks to reduce carbon emissions caused by supply chain transportation, improve the lives of approximately 3.5 million truck drivers and create more jobs across all players in B2B transactions. We operate in a very fast-paced and nimble environment that is highly focused on a team-first, accomplishment-oriented culture that is passionate about the organization's success. Our products have been developed by a world-class engineering team that simplifies complex business problems to a degree where adoption is effortless. We encourage you to visit our careers page and read this blog post to learn more about our culture.

What You'll Do

  • Own the Speech interface layer: real-time speech-to-intent pipeline using models like Whisper or Deepgram

  • Build conversational UX flows for tasks like:

    • Load search and booking

    • Navigation and status updates

    • Voice journaling and micro-coaching

  • Optimize for real-world conditions: noisy cabs, unreliable signal, driver interruptions

  • Design fallback logic and graceful failure handling when voice commands are ambiguous or partial

  • Develop personalization features to learn and adapt to each driver’s preferences, tone, and goals over time

Personalization Responsibilities

You’ll lead the design of systems that help the assistant become a

relationship-level tool, not just a command engine:

  • Build a driver memory graph to store goals, language patterns, habits, and personality traits

  • Develop logic for driver-specific intent recognition and natural phrasing (e.g., “get me home this weekend”)

  • Implement adaptive prompting based on driver profile tags (e.g., preferred tone, motivational style)

  • Enable the system to reference past conversations, track personal milestones, and make coaching feel deeply contextual and human

  • Use retrieval-augmented generation (RAG) or custom embeddings to let the assistant "remember" and evolve

Technologies You Might Use

  • Speech: Whisper, Deepgram, Google Speech-to-Text

  • NLU / LLMs: GPT-4o, Rasa, LangChain, custom intent parsers

  • Frontend: React Native (for fallback UI), WebRTC, Twilio Voice

  • Infra: Node.js, Python, Firebase, Supabase, Postgres, Pinecone

You Might Be a Fit If You

  • Have built or contributed to voice or AI-driven products with personalization or memory features

  • Understand the difference between "generic commands" and relationship-based coaching

  • Know how to ship fast, but keep latency and UX top of mind

  • Are excited to build tools that respect and elevate working-class users

  • Are obsessed with human-first AI design

Benefits

At VORTO we are committed to developing our employees and providing them exciting opportunities to grow and prosper in their careers. We encourage you to visit our careers page and read this blog post to learn more about our culture.

We offer a competitive benefits package as well as numerous additional perks including:

  • Competitive compensation package

  • Health, Dental and Vision Insurance

  • 401k with matching

  • Company paid life and short-term disability insurance

  • Company paid parking or transit pass

  • Relocation offered when applicable

  • Modern office space in downtown Denver

  • Daily coffee, tea, drinks & snacks

  • Team happy hours

VORTO is an Equal Opportunity Employer.

This position will be posted until a qualified candidate is hired.

Disclaimer: This job description is not designed to cover or contain a comprehensive listing of activities, duties or responsibilities that are required of the employee. Other duties, responsibilities and activities may change or be assigned.

Job Tags

Full time, Temporary work, Work at office, Relocation,

Similar Jobs

TRANE TECHNOLOGIES

Maintenance Technician-Electrician (3rd Shift) ) Job at TRANE TECHNOLOGIES

 ...computerized machine controls, repair and maintain machines, equipment, buildings, and grounds. Responsibilities: Makes major electrical, mechanical, and construction repairs and installation involving schematics and/or blueprint interpretation. Troubleshoots... 

StretchLab - Walnut Creek

Personal Trainer/Fitness Instructor Job at StretchLab - Walnut Creek

 ...Job Description StretchLab Walnut Creekis seeking passionate personal trainers and fitness instructorsinterested in helping people improve...  ...our 3 day Flexologist Training Program, which includes 20 hours of online tutorials and 2 days of in-person/hands-on training... 

Costco Wholesale

Gas Station Attendant Job at Costco Wholesale

Overview Gas Station Attendant role at Costco Wholesale. The listing outlines typical responsibilities...  ...package of benefits including paid time off, health benefits (medical/dental/...  ...Seniority level Not ApplicableEmployment type Full-timeJob function Management and... 

Spry Methods

Cloud Infrastructure DevOps Engineer Job at Spry Methods

 ...unique opportunity to develop and maintain solutions across multiple cloud platforms. In this role, you will leverage infrastructure-as-...  ...cloud-native services such as AWS Lambda, Azure Functions, and Google Cloud Functions. What You Need to Succeed (Minimum... 

Ace Hardware

Store Manager Job at Ace Hardware

 ...Leaders must delegate, train, and monitor the progress of all associates and all facets of the hardware store. The primary responsibilities of in-store management are to manage the sales, expenses, profits, assets, and team members' personal development to ensure customers...