grid detection in opencv python
I have an image that has items inside a grid. One stage of the problem is to detect and build a mask of the full grid, which can be slightly rotated clock or anticlockwise. My current CV pipeline extracts (probabilistic) Hough lines from an image and then uses its contours to filter for a set of rectangles (call the actual and the detected sets R' and R respectively). However due to occlusions and lighting conditions the hough lines (and consequently all downstream contours and lines segments) are incomplete (R << R'). Schematically the problem i must solve is to infer the missing grid components (R'- R) given the detected grid cells. One strategy I am considering is the following. Foreach detected rectangle contour r in R do: 1- using fitLine() find vertical and horizontal lines that pass through the center of r (see code and image below) rect = cv2.minAreaRect(r) box = cv2.boxPoints(rect) box = np.int0(box) cx = np.int0(rect) cy = np.int0(rect) w = np.int0(rect) h = np.int0(rect) cv2.drawContours(img,[box],0,255,1) [vx,vy,x,y] = cv2.fitLine(box, cv2.DIST_L2,0,0.01,0.01) lefty = int((-x*vy/vx) + y) righty = int(((cols-x)*vy/vx)+y) start = (cols-1,righty) end = (0,lefty) cv2.line(img,start,end,255,1) # HORIZONTAL nx,ny = 1,-vx/vy mag = np.sqrt((1+ny**2)) vx,vy = nx/mag,ny/mag # Now find two extreme points on the line to draw line lefty = int((-x*vy/vx) + y) righty = int(((cols-x)*vy/vx)+y) start = (cols-1,righty) end = (0,lefty) cv2.putText(img,'start',(start-60,start),font,0.5,255,1) cv2.putText(img,'end',end,font,0.5,255,1) cv2.line(img,start,end,255,1) 2- create a mask of same size and rotation as the source rectangle and move along the line define in (1), drawing the same shape rectangle as the source if there is no previously detected contour in the same area ie. My questions are: is there a more efficient and better way to solve this problem? What is best way to move the mask along the line that is at an angle (given by cv2.minAreaRect)? thank you
Schedule Python Script - Windows 7
slicing arrays in numpy/scipy
Recommendations for a simple 2D graphics python library that can output to screen and pdf?
Reading numpy arrays outside of Python
Return value from thread
Is this control structure a code smell?
Django: How do I validate unique_together from within the model
Munging non-printable characters to dots using string.translate()
Error when using astWCS trying to create WCS object
if there any better way to read bb function souce code.i was very faint
PyQt4 signals and slots
Sql Alchemy What is wrong?
How do I plot a graph in Python?
Reordering matrix elements to reflect column and row clustering in naiive python
making urllib request in Python from the client side
Grid within a frame?