grid detection in opencv python
I have an image that has items inside a grid. One stage of the problem is to detect and build a mask of the full grid, which can be slightly rotated clock or anticlockwise. My current CV pipeline extracts (probabilistic) Hough lines from an image and then uses its contours to filter for a set of rectangles (call the actual and the detected sets R' and R respectively). However due to occlusions and lighting conditions the hough lines (and consequently all downstream contours and lines segments) are incomplete (R << R'). Schematically the problem i must solve is to infer the missing grid components (R'- R) given the detected grid cells. One strategy I am considering is the following. Foreach detected rectangle contour r in R do: 1- using fitLine() find vertical and horizontal lines that pass through the center of r (see code and image below) rect = cv2.minAreaRect(r) box = cv2.boxPoints(rect) box = np.int0(box) cx = np.int0(rect) cy = np.int0(rect) w = np.int0(rect) h = np.int0(rect) cv2.drawContours(img,[box],0,255,1) [vx,vy,x,y] = cv2.fitLine(box, cv2.DIST_L2,0,0.01,0.01) lefty = int((-x*vy/vx) + y) righty = int(((cols-x)*vy/vx)+y) start = (cols-1,righty) end = (0,lefty) cv2.line(img,start,end,255,1) # HORIZONTAL nx,ny = 1,-vx/vy mag = np.sqrt((1+ny**2)) vx,vy = nx/mag,ny/mag # Now find two extreme points on the line to draw line lefty = int((-x*vy/vx) + y) righty = int(((cols-x)*vy/vx)+y) start = (cols-1,righty) end = (0,lefty) cv2.putText(img,'start',(start-60,start),font,0.5,255,1) cv2.putText(img,'end',end,font,0.5,255,1) cv2.line(img,start,end,255,1) 2- create a mask of same size and rotation as the source rectangle and move along the line define in (1), drawing the same shape rectangle as the source if there is no previously detected contour in the same area ie. My questions are: is there a more efficient and better way to solve this problem? What is best way to move the mask along the line that is at an angle (given by cv2.minAreaRect)? thank you
need help about SVM in Python and Matlab
How can a portal user modify his own partner data in Odoo 8?
Name or service not known
how to append a row from one dataframe to a new dataframe
Theano: ifelse TypeError
Can generators be recursive?
Adding django action to installed app
Python running manage.py migrate wont work with MySQL db [duplicate]
Error on Python serial import
Db in openshift is shutdown every 30 minutes
KNN classifier not working in python on raspberrypi
pandas.DataFrame.loc , Labeling data in new column
Scikit learn GridSearchCV fit method ValueError Found array with 0 sample
Python Figure not responding after I ask for input?
Python BST not working
Convert Excel style date with pandas