TactileLens
A phone app that tells blind and low-vision users what an object feels like — its material, ripeness, softness, smoothness, and weight class — by combining camera, LiDAR, and AI reasoning in everyday settings like kitchens, closets, and grocery aisles.
Blind and low-vision adults navigating tactile-rich daily tasks
- Point-camera material and texture classifier with spoken descriptions ('likely a ripe avocado, slightly soft')
- Confidence-aware narration that explicitly tells the user when the app is unsure, so they don't over-trust it
- Offline-first mode for kitchens and stores with poor connectivity
- Personal object library so repeat items like a favorite jacket or medication bottle get faster and more consistent answers
Multimodal vision-language models are finally learning chain-of-thought over perception, and modern phones ship the cameras and LiDAR needed to deliver tactile-proxy reasoning as a consumer app.
89% of visually impaired own smartphones and existing apps (Google Lookout, Be My Eyes with 750-800K blind users, SightSense) show real demand for camera-based object recognition, though tactile-proxy features specifically are an unproven sub-niche.19 Essential Apps for Blind or Visually Impaired Individuals ↗Be My Eyes Announces Major Community Milestones ↗
General object/scene description is crowded by Google Lookout, Be My Eyes, Envision AI, SightSense, and Aira, but material/ripeness/softness/smoothness is a narrow unclaimed angle, with TacReasoner being the only recent academic work in this tactile-language space.Lookout - Assisted vision - Apps on Google Play ↗SightSense ↗
Be My Eyes serves 750-800K blind users for free and raised $6.1M on that model; the BLV market is famously price-sensitive and saturated with free alternatives, making paid conversion difficult without clear-cut consumer app precedent.Be My Eyes Raises $6.1 Million to Accelerate Adoption of its AI-powered accessibility products ↗
Visual impairment prevalence is stable/slowly rising with aging populations, and tactile-rich daily tasks (food prep, clothing, groceries) will persist as core BLV challenges for the foreseeable future.19 Essential Apps for Blind or Visually Impaired Individuals ↗
Inferring ripeness, softness, smoothness, and especially weight class from phone RGB+LiDAR is genuinely unreliable - these are physical/tactile properties that visual proxies handle poorly, and the app would need very high accuracy to be trusted for safety-relevant tasks like food.