University & Competitions

AR Road-Marking Navigation App

A navigation app that recognizes signals and lanes in the camera view and overlays the route in AR

Encouragement Award, 2021 Regional XR Challenge

Period | 2021.05 ~ 2021.11

  • #Python
  • #OpenCV
  • #Unity
  • #TensorFlow
  • #Android NDK

Seeing the signal and the right lane directly on screen while driving

Problem

  • Drivers have to switch between the map and the road to follow signals and choose lanes
  • Varied traffic lights and surroundings made it hard to get both accuracy and speed from one method

My Role

  • Implemented intersection and road-marking recognition with OpenCV
  • Improved lane detection with Canny edge detection, HoughLinesP and ROI settings
  • Took part in building the Unity-based AR navigation prototype
  • Planned the service and validated the technology for Busan's complex road layout

Result

  • Demo that shows the direction and lane for the current signal and plays a sound when it changes
  • Won the Encouragement Award at the 2021 Regional XR Challenge
Service view: signal and lane shown on screen
Service view: signal and lane shown on screen
Signal recognition: object detection and Inception V3 transfer learning
Signal recognition: object detection and Inception V3 transfer learning
Lane detection: Canny edge, ROI, Hough transform
Lane detection: Canny edge, ROI, Hough transform