grid detection in opencv python
I have an image that has items inside a grid. One stage of the problem is to detect and build a mask of the full grid, which can be slightly rotated clock or anticlockwise. My current CV pipeline extracts (probabilistic) Hough lines from an image and then uses its contours to filter for a set of rectangles (call the actual and the detected sets R' and R respectively). However due to occlusions and lighting conditions the hough lines (and consequently all downstream contours and lines segments) are incomplete (R << R'). Schematically the problem i must solve is to infer the missing grid components (R'- R) given the detected grid cells. One strategy I am considering is the following. Foreach detected rectangle contour r in R do: 1- using fitLine() find vertical and horizontal lines that pass through the center of r (see code and image below) rect = cv2.minAreaRect(r) box = cv2.boxPoints(rect) box = np.int0(box) cx = np.int0(rect) cy = np.int0(rect) w = np.int0(rect) h = np.int0(rect) cv2.drawContours(img,[box],0,255,1) [vx,vy,x,y] = cv2.fitLine(box, cv2.DIST_L2,0,0.01,0.01) lefty = int((-x*vy/vx) + y) righty = int(((cols-x)*vy/vx)+y) start = (cols-1,righty) end = (0,lefty) cv2.line(img,start,end,255,1) # HORIZONTAL nx,ny = 1,-vx/vy mag = np.sqrt((1+ny**2)) vx,vy = nx/mag,ny/mag # Now find two extreme points on the line to draw line lefty = int((-x*vy/vx) + y) righty = int(((cols-x)*vy/vx)+y) start = (cols-1,righty) end = (0,lefty) cv2.putText(img,'start',(start-60,start),font,0.5,255,1) cv2.putText(img,'end',end,font,0.5,255,1) cv2.line(img,start,end,255,1) 2- create a mask of same size and rotation as the source rectangle and move along the line define in (1), drawing the same shape rectangle as the source if there is no previously detected contour in the same area ie. My questions are: is there a more efficient and better way to solve this problem? What is best way to move the mask along the line that is at an angle (given by cv2.minAreaRect)? thank you
Functions that help to understand json(dict) structure
Scapy How converting hex to new packet
Write and read test files in dictionary format
Python 3.x Connect to account with request POST
AttributeError: module 'networkx' has no attribute 'Graph'
How to exclude selected domains from python crawl script in google search
Python - Py2exe error
Anaconda import packages from another environment
How to Drag & Drop Multiple rows of a QTableView in pyqt5
Handle prompts in Python - popen
How to create an infinite iterator to generate an incrementing alphabet pattern?
Python RTMP Authenticiation Script
How to change background colour in Kivy
Is it correct to use kwargs in the following scenario of python code?
List comprehension with elements appearing twice
How to unread a single char in Python?