wow!! that sounds like a really good project.it will reduce computation time for sure. There is a conversion matrix for converting rgb to ycbcr https://msdn.microsoft.com/en-us/library/ff635643.aspx
I'm sure you wont be troubled to implement the matrix multiplication in verilog